-- Logs begin at Mon 2022-07-11 20:12:37 UTC, end at Mon 2022-07-11 21:22:11 UTC. -- Jul 11 20:46:25.252214 dv-cinder-849022-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 11 20:46:25.259606 dv-cinder-849022-2-smb devstack@keystone.service[80367]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 11 20:46:25.264007 dv-cinder-849022-2-smb devstack@keystone.service[80367]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 11 20:46:25 2022] *** Jul 11 20:46:25.264007 dv-cinder-849022-2-smb devstack@keystone.service[80367]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 11 20:46:25.264007 dv-cinder-849022-2-smb devstack@keystone.service[80367]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 11 20:46:25.264007 dv-cinder-849022-2-smb devstack@keystone.service[80367]: nodename: dv-cinder-849022-2-smb Jul 11 20:46:25.264007 dv-cinder-849022-2-smb devstack@keystone.service[80367]: machine: x86_64 Jul 11 20:46:25.264007 dv-cinder-849022-2-smb devstack@keystone.service[80367]: clock source: unix Jul 11 20:46:25.264007 dv-cinder-849022-2-smb devstack@keystone.service[80367]: pcre jit disabled Jul 11 20:46:25.264007 dv-cinder-849022-2-smb devstack@keystone.service[80367]: detected number of CPU cores: 4 Jul 11 20:46:25.264007 dv-cinder-849022-2-smb devstack@keystone.service[80367]: current working directory: / Jul 11 20:46:25.264007 dv-cinder-849022-2-smb devstack@keystone.service[80367]: detected binary path: /usr/bin/uwsgi-core Jul 11 20:46:25.264007 dv-cinder-849022-2-smb devstack@keystone.service[80367]: your processes number limit is 47680 Jul 11 20:46:25.264007 dv-cinder-849022-2-smb devstack@keystone.service[80367]: your memory page size is 4096 bytes Jul 11 20:46:25.264007 dv-cinder-849022-2-smb devstack@keystone.service[80367]: detected max file descriptor number: 2048 Jul 11 20:46:25.264007 dv-cinder-849022-2-smb devstack@keystone.service[80367]: lock engine: pthread robust mutexes Jul 11 20:46:25.264007 dv-cinder-849022-2-smb devstack@keystone.service[80367]: thunder lock: enabled Jul 11 20:46:25.264007 dv-cinder-849022-2-smb devstack@keystone.service[80367]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 11 20:46:25.264007 dv-cinder-849022-2-smb devstack@keystone.service[80367]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 11 20:46:25.308369 dv-cinder-849022-2-smb devstack@keystone.service[80367]: Python main interpreter initialized at 0x55645a7909c0 Jul 11 20:46:25.308369 dv-cinder-849022-2-smb devstack@keystone.service[80367]: python threads support enabled Jul 11 20:46:25.308369 dv-cinder-849022-2-smb devstack@keystone.service[80367]: your server socket listen backlog is limited to 100 connections Jul 11 20:46:25.308369 dv-cinder-849022-2-smb devstack@keystone.service[80367]: your mercy for graceful operations on workers is 90 seconds Jul 11 20:46:25.308709 dv-cinder-849022-2-smb devstack@keystone.service[80367]: mapped 403077 bytes (393 KB) for 2 cores Jul 11 20:46:25.308786 dv-cinder-849022-2-smb devstack@keystone.service[80367]: *** Operational MODE: preforking *** Jul 11 20:46:25.309054 dv-cinder-849022-2-smb devstack@keystone.service[80367]: *** uWSGI is running in multiple interpreter mode *** Jul 11 20:46:25.309054 dv-cinder-849022-2-smb devstack@keystone.service[80367]: spawned uWSGI master process (pid: 80367) Jul 11 20:46:25.309260 dv-cinder-849022-2-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 11 20:46:25.310708 dv-cinder-849022-2-smb devstack@keystone.service[80367]: spawned uWSGI worker 1 (pid: 80374, cores: 1) Jul 11 20:46:25.311719 dv-cinder-849022-2-smb devstack@keystone.service[80367]: spawned uWSGI worker 2 (pid: 80375, cores: 1) Jul 11 20:46:25.312096 dv-cinder-849022-2-smb devstack@keystone.service[80367]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 11 20:46:30.748138 dv-cinder-849022-2-smb devstack@keystone.service[80375]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 20:46:30.748138 dv-cinder-849022-2-smb devstack@keystone.service[80375]: from cryptography.utils import int_from_bytes Jul 11 20:46:30.749094 dv-cinder-849022-2-smb devstack@keystone.service[80374]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 20:46:30.749094 dv-cinder-849022-2-smb devstack@keystone.service[80374]: from cryptography.utils import int_from_bytes Jul 11 20:46:30.749516 dv-cinder-849022-2-smb devstack@keystone.service[80375]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 20:46:30.749516 dv-cinder-849022-2-smb devstack@keystone.service[80375]: from cryptography.utils import int_from_bytes Jul 11 20:46:30.749646 dv-cinder-849022-2-smb devstack@keystone.service[80374]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 20:46:30.749646 dv-cinder-849022-2-smb devstack@keystone.service[80374]: from cryptography.utils import int_from_bytes Jul 11 20:46:30.797974 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 11 20:46:30.798141 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 11 20:46:30.798231 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 11 20:46:30.798320 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 11 20:46:30.798404 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] command line args: [] {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 11 20:46:30.798485 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] command line args: [] {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 11 20:46:30.798618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 11 20:46:30.798698 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 11 20:46:30.798821 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ================================================================================ {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 11 20:46:30.798908 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ================================================================================ {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 11 20:46:30.799094 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] admin_token = **** {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.799175 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] admin_token = **** {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.799345 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] config_dir = [] {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.799425 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] config_dir = [] {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.799532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.799618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.799702 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] config_source = [] {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.799780 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] config_source = [] {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.799882 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] debug = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.799991 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] debug = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.800103 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.800427 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.800563 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.800668 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.800773 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.800876 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.800981 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.801120 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.801217 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.801312 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] list_limit = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.801414 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.801524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] log_config_append = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.801627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] list_limit = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.801730 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.801826 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] log_config_append = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.801919 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] log_dir = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.802026 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.802127 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] log_file = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.802230 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] log_dir = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.802358 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.802435 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] log_file = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.802551 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.802627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.802741 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.802824 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.802903 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.803022 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.803097 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.803220 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.803306 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.803380 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.803503 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.803580 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.803696 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.803777 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.803884 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.804001 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.804141 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.804263 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.804375 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.804500 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.804608 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.804736 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.804853 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.804972 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.805102 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.805222 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.805376 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.805507 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.805729 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.805861 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.40/identity {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.806042 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] publish_errors = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.806229 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.40/identity {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.806315 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.806558 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] publish_errors = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.807198 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.807312 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.807397 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.807523 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.807639 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.807764 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.807897 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.808049 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.808174 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] standard_threads = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.808295 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.808418 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.808542 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] standard_threads = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.808664 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.808786 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.808907 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.808907 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] use_journal = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.809138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.809254 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] use_json = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.809368 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.809482 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] use_stderr = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.809603 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] use_journal = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.809718 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] use_syslog = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.809841 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] use_json = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.809841 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] use_stderr = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.810056 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.810176 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] use_syslog = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.810290 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.810410 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 20:46:30.810605 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.810724 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.810845 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.810962 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.811076 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.811197 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.811320 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.811448 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.811570 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.811693 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.811809 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.811929 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.812069 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.812185 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.812298 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.812410 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.812530 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.812644 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.812767 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.812881 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.812994 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.813107 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.813226 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.813340 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.813461 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.813585 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.813703 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.813818 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.813932 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.814054 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.814169 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.814283 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.814472 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.814592 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.814706 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.814833 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.814956 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.815077 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.815192 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.815313 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.815428 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.815553 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.815675 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.815796 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.815919 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.816087 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.816204 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.816399 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.816518 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.816633 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.816748 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.816862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.816977 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.817100 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.817216 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.817330 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.817444 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.817565 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.817680 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.817805 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.817921 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.818042 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.818157 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.818271 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.818392 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.818515 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.818637 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.818752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.818866 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.818981 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.819096 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.819218 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.819339 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.819455 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.819575 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.819690 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.819811 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.819811 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.820049 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.820164 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.820280 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.820433 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.820563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.820687 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.820787 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.820883 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.820985 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.820985 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.821172 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.821270 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.821366 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.821366 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.821551 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.821650 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.821763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.821886 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.822004 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.822185 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.822320 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.822456 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.822601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.822759 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.822908 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.823067 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.823237 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.823372 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.823508 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.823508 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.823737 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.823853 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.823957 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.824120 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.824120 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.824329 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.824454 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.824571 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.824676 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.824676 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.824894 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.825021 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.825139 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.825254 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.825359 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.825473 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.825597 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.825728 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.825853 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.825970 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.826085 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.826200 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.826321 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.826439 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.826562 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.826679 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.826795 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.826899 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.827013 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.827128 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.827251 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.827368 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.827484 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.827600 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.827749 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.827868 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.828083 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.828205 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.828320 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.828436 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.828552 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.828667 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.828791 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.828908 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.829024 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.829139 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.829255 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.829379 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.829507 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.829633 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.829751 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.829866 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.829988 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.830105 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.830221 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.830345 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.830462 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.830579 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.830695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.830810 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.830926 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.831049 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.831181 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.831303 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.831430 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.831548 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.831665 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.831792 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.831910 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.832076 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.832194 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.832311 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.832427 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.832555 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.832675 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.832791 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.832907 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.833023 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.833138 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.833261 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.833378 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.833501 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.833624 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.833741 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.833858 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.833984 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.834102 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.834218 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.834334 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.834451 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.834567 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.834694 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.834811 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.834934 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.835051 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.835167 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.835283 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.835407 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.835525 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.835641 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] auth.external = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.835757 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] auth.external = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.835874 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.836003 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.836133 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.836283 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.836415 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.836535 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.836658 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] auth.password = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.836776 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] auth.password = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.836893 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] auth.token = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.837010 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] auth.token = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.837134 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.837252 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.837369 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.837485 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.837601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.838292 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.838432 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.838550 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.838668 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.838786 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.838904 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.839119 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.839250 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.839377 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.839495 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] credential.caching = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.839613 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] credential.caching = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.839730 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.839847 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.840000 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.840122 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.840240 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.840357 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.840357 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.840593 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.840713 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.840836 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.840955 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.841072 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.841195 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.841321 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.841446 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.841446 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.841667 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.841667 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.841887 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.842015 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.842135 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.842252 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.842378 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.842504 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.842622 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.842815 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.842935 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.843052 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.843170 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.843170 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] federation.caching = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.843395 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.843521 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.843640 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] federation.caching = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.843640 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.843859 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.843859 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.844133 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.844264 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.844384 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.844501 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.844618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.844734 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.844851 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.844977 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.845099 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.845216 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.845334 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.845451 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.845568 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.845692 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.845811 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.845928 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.846045 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.846162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] identity.caching = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.846279 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.846408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.846526 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] identity.caching = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.846644 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.846761 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.846884 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.847001 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.847146 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.847266 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.847384 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.847500 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.847624 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.847748 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.847874 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.848009 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.848129 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.848245 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.848361 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.848478 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.848607 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.848734 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.848852 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.848975 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.849099 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.849217 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.849342 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.849467 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.849590 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.849708 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.849824 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.849941 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.850066 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.850184 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.850301 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.850417 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.850535 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.850659 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.850778 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.850894 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.851011 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.851127 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.851243 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.851367 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.851485 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.851603 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.851719 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.851835 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.851951 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.852100 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.852220 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.852337 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.852460 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.852579 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.852696 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.852821 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.852939 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.853055 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.853171 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.853287 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.854028 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.854164 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.854285 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.854403 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.854520 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.854637 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.854755 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.854880 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.854999 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.855126 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.855245 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.855363 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.855480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.855606 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.855726 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.855844 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.855961 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.856100 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.856217 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.856350 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.856471 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.856588 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.856706 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.856831 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.856948 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.857073 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.857192 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.857309 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.857434 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.857553 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.857671 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.857795 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.857922 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.858040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.858156 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.858274 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.858390 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.858519 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.858638 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.858755 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.858873 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.858990 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.859107 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.user = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.859236 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.859361 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.859479 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.user = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.859596 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.859714 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.859830 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.859960 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.860112 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.860229 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.860347 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.860464 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.860581 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.860710 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.860829 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.860946 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.861064 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.861182 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.861298 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.861423 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.861542 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.861659 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.861777 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.861894 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.862011 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.862136 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.862255 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.862372 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.862489 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.862606 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.862749 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.862879 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.862998 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.863123 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.863241 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.863358 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.863474 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.863600 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.863717 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.863834 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.863950 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.864097 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.864235 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.864359 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.864476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.864593 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.864710 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.864827 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.864944 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.865068 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.865186 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.865303 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.865420 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.865536 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.865661 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.865779 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.865896 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.865896 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.866116 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.866234 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.866428 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.866548 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.866665 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.866782 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.866904 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.867022 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.867146 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.867266 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.867382 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.867499 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.867615 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.867731 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.867859 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.868031 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] resource.caching = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.868152 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.868269 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.868387 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.868504 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.868632 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] resource.caching = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.868751 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.868869 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.869064 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.869195 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.869314 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.869441 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.869561 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.869678 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.869795 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.869912 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.870028 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.870153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.870272 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.870389 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.870506 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] role.caching = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.870624 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.870741 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] role.driver = sql {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.870866 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.870984 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.871107 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] role.caching = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.871225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.871342 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] role.driver = sql {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.871460 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.871585 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.871703 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.871820 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.871936 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.872072 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.872189 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.872320 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.872439 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.872558 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.872674 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.872792 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.872908 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.873034 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.873152 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.873268 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.873385 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.873772 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.873889 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.874014 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.874132 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.874249 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.874365 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.874482 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.874600 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.874725 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.874843 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.874963 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.875080 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.875197 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.875321 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.875439 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.875556 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.875674 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.875790 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.875907 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.876110 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.876231 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.876348 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.876464 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.876581 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.876698 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.876823 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.876941 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.877058 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.877175 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.877292 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.877292 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.877520 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.877520 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.877742 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.877859 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.877975 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.878092 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.878217 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.878335 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.878452 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.878569 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.878685 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.878685 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.878913 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.879031 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] token.caching = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.879147 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.879263 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.879379 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.879512 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.879639 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.879757 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.879876 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] token.caching = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.879876 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.880114 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.880232 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.880360 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.880480 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.880597 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.880597 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.880815 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.880933 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.881057 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.881175 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.881292 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.881408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.881525 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.881641 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.881766 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.881883 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.882001 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.882118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.882235 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.882351 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.882475 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.882593 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.882710 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.882826 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.882942 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.882942 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.883170 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.883287 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.883404 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] database.connection = **** {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.883528 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.883654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.883654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.883875 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.884032 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.884154 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] database.connection = **** {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.884280 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.884406 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.884525 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.884711 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.884862 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.885025 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.885192 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.885313 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.885430 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.885547 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.885702 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.885900 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.886022 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.886142 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.886260 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.886377 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.886494 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.886620 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.886739 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.886857 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.886975 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.887092 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.887211 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.887336 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.887456 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.887574 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.887692 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.887811 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.888004 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.888139 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.888261 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 11 20:46:30.888380 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.888380 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.888380 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 20:46:30.888380 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 11 20:46:30.915122 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:30.915303 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:30.915533 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:30.916258 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:30.916499 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:30.916731 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:30.924121 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:30.925249 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:30.952715 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:30.952944 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:30.953858 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:30.954096 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.095393 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.095600 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.143751 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.143995 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.144555 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.144791 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.208686 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.208915 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.209094 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.209199 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.209332 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.209415 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.209545 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.209626 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.209766 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.209849 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.209985 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.210207 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.234929 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.235160 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.235264 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.235380 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.235461 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.235597 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.235677 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.235810 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.235891 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.236048 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.236130 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.236262 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.236355 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.236511 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.247233 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.247635 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.260684 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.260915 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.261135 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.261216 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.261351 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.261432 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.261564 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.261653 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.261774 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.261855 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.261985 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.262065 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.262248 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.262467 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 20:46:31.279261 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.279472 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 20:46:31.279808 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.279903 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.280031 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 20:46:31.280113 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 20:46:31.280304 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.280411 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.280564 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.280656 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 20:46:31.280820 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.280900 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.281073 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.281153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.281390 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.281647 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.292666 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.292942 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.293027 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.293212 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.293306 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.293491 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.293571 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.293785 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.301665 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:46:31.302036 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:46:31.304934 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:46:31.305216 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.305326 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:46:31.305496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.305612 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.305775 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.305895 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.306051 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.306180 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.306306 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.306598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.306756 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.306838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.307058 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.307142 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.307289 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.307371 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.307560 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.307639 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.307825 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.307918 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.308115 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.334634 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.334915 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.336544 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:46:31.336627 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:46:31.336827 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.336910 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.342177 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:46:31.342338 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:46:31.342454 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.342619 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.342846 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.343012 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.350063 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:46:31.350296 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:46:31.350389 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.350581 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.355305 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:46:31.355589 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.355670 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:46:31.355868 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.355961 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.356174 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.356254 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.356450 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.356531 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.356720 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.356802 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.356984 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.357065 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.357246 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.357336 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.357510 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.376009 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.376282 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.376478 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.376755 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.381162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:46:31.381310 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:46:31.385323 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.385475 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.385705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.385866 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.390671 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:46:31.390888 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:46:31.394273 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:46:31.394503 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:46:31.397902 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.398163 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.398246 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.398464 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.398557 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.398746 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.398827 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.399025 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.399107 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.399301 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.399390 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.399579 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.418933 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:46:31.419199 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.419401 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:46:31.419495 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.419684 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.419770 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.419958 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.420240 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.427538 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.428119 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.429258 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.429532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.429825 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.430101 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.432787 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:46:31.433066 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.433342 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.433423 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:46:31.433618 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.433713 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.433896 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.433978 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.434179 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.434459 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.447062 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:46:31.447844 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.448147 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.448391 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:46:31.448475 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.448673 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.448756 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.448963 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.449248 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.449535 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.450200 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.450501 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.451094 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.451397 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.468899 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:46:31.469997 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:46:31.472102 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:46:31.473302 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:46:31.475362 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.476615 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.477194 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.478381 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.478968 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:46:31.479245 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.479532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.480250 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:46:31.480535 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.480818 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.486763 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.488077 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.488377 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:46:31.489800 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:46:31.491567 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.491856 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.492269 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.492562 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.493053 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.493349 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.493746 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.494128 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.502034 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:46:31.502321 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.502605 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.503575 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:46:31.503864 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.504173 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.511170 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:46:31.511447 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.511726 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.512023 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.512297 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.512641 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 20:46:31.512738 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.512924 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.513006 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.513205 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.513287 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.513479 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.513560 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.513747 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.513826 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.514013 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.514129 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.514274 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.514408 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.514538 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.514691 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.514808 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.514971 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.515245 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.515516 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.515779 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.516077 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.516353 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 20:46:31.553183 dv-cinder-849022-2-smb devstack@keystone.service[80375]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55645a7909c0 pid: 80375 (default app) Jul 11 20:46:31.554716 dv-cinder-849022-2-smb devstack@keystone.service[80374]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55645a7909c0 pid: 80374 (default app) Jul 11 20:46:31.557037 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71384b31-1cda-4ccb-a00c-802200dc6fe4 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:31.557333 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71384b31-1cda-4ccb-a00c-802200dc6fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:31.557612 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71384b31-1cda-4ccb-a00c-802200dc6fe4 None None] PATH_INFO: `/v3` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:31.561774 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 791 bytes} [Mon Jul 11 20:46:31 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:46:39.989625 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7cede-fea1-4e0f-bc5e-02ba99d718cf None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:39.990170 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7cede-fea1-4e0f-bc5e-02ba99d718cf None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:39.990170 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7cede-fea1-4e0f-bc5e-02ba99d718cf None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:39.995001 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1/2] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:46:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:46:40.000392 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c49d57-8de3-48f5-a888-09823984d54f None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:40.000776 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c49d57-8de3-48f5-a888-09823984d54f None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:40.000959 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c49d57-8de3-48f5-a888-09823984d54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:40.070107 dv-cinder-849022-2-smb devstack@keystone.service[80375]: INFO dbcounter [None req-71c49d57-8de3-48f5-a888-09823984d54f None None] Registered counter for database keystone Jul 11 20:46:40.091591 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG oslo_db.sqlalchemy.engines [None req-71c49d57-8de3-48f5-a888-09823984d54f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80375) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 20:46:40.097756 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writer thread running {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 20:46:40.277481 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG passlib.handlers.bcrypt [None req-71c49d57-8de3-48f5-a888-09823984d54f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80375) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 11 20:46:40.277831 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG passlib.handlers.bcrypt [None req-71c49d57-8de3-48f5-a888-09823984d54f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80375) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 11 20:46:40.332815 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-71c49d57-8de3-48f5-a888-09823984d54f None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:46:40.334468 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-71c49d57-8de3-48f5-a888-09823984d54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:46:40.474826 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 2/3] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:46:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 475 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 11 20:46:40.631346 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7cede-fea1-4e0f-bc5e-02ba99d718cf None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:46:40.701658 dv-cinder-849022-2-smb devstack@keystone.service[80374]: INFO dbcounter [None req-2de7cede-fea1-4e0f-bc5e-02ba99d718cf None None] Registered counter for database keystone Jul 11 20:46:40.720878 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG oslo_db.sqlalchemy.engines [None req-2de7cede-fea1-4e0f-bc5e-02ba99d718cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80374) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 20:46:40.726977 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writer thread running {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 20:46:40.848606 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7cede-fea1-4e0f-bc5e-02ba99d718cf None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:46:40.854219 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5058c8a9-e9e5-4b66-afe3-2590f45d8087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:46:40.855364 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058c8a9-e9e5-4b66-afe3-2590f45d8087 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:40.855794 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058c8a9-e9e5-4b66-afe3-2590f45d8087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:40.856044 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058c8a9-e9e5-4b66-afe3-2590f45d8087 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:40.866029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5058c8a9-e9e5-4b66-afe3-2590f45d8087 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:46:40.918146 dv-cinder-849022-2-smb devstack@keystone.service[80374]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5058c8a9-e9e5-4b66-afe3-2590f45d8087 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 11 20:46:40.918424 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5058c8a9-e9e5-4b66-afe3-2590f45d8087 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:46:40.928007 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 2/4] 10.222.0.40 () {58 vars in 1324 bytes} [Mon Jul 11 20:46:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 20:46:40.934607 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c49d57-8de3-48f5-a888-09823984d54f None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:46:40.949621 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c49d57-8de3-48f5-a888-09823984d54f None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:46:40.953993 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e36bee-8d3a-4200-90b6-4440dbfa85f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:46:40.955154 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e36bee-8d3a-4200-90b6-4440dbfa85f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:40.955448 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e36bee-8d3a-4200-90b6-4440dbfa85f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:40.955731 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e36bee-8d3a-4200-90b6-4440dbfa85f1 admin admin] PATH_INFO: `/v3/projects/ae8bc79b1b6b4f7088e951983d34a626` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:40.957262 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e36bee-8d3a-4200-90b6-4440dbfa85f1 admin admin] RBAC: Authorizing `identity:get_project(project_id=ae8bc79b1b6b4f7088e951983d34a626)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:46:41.010788 dv-cinder-849022-2-smb devstack@keystone.service[80375]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b8e36bee-8d3a-4200-90b6-4440dbfa85f1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 11 20:46:41.011358 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e36bee-8d3a-4200-90b6-4440dbfa85f1 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:46:41.015651 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 3/5] 10.222.0.40 () {56 vars in 1207 bytes} [Mon Jul 11 20:46:40 2022] GET /identity/v3/projects/ae8bc79b1b6b4f7088e951983d34a626 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:46:43.008218 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3012d-d4ee-4d2c-90e7-a9f6a9f3b29a None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:43.008748 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3012d-d4ee-4d2c-90e7-a9f6a9f3b29a None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:43.008836 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3012d-d4ee-4d2c-90e7-a9f6a9f3b29a None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:43.013641 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 3/6] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:46:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:46:43.019051 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f811d-11b9-4a33-9272-6e8f799908b1 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:43.019421 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f811d-11b9-4a33-9272-6e8f799908b1 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:43.019622 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f811d-11b9-4a33-9272-6e8f799908b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:43.037918 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-bc4f811d-11b9-4a33-9272-6e8f799908b1 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:46:43.039428 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-bc4f811d-11b9-4a33-9272-6e8f799908b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:46:43.047453 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 4/7] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:46:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 11 20:46:43.070099 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3012d-d4ee-4d2c-90e7-a9f6a9f3b29a None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:46:43.082158 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3012d-d4ee-4d2c-90e7-a9f6a9f3b29a None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:46:43.086340 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2210c-d561-4761-943b-9ff1444f5df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:46:43.086972 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2210c-d561-4761-943b-9ff1444f5df1 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:43.087262 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2210c-d561-4761-943b-9ff1444f5df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:43.088175 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2210c-d561-4761-943b-9ff1444f5df1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:43.096215 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2210c-d561-4761-943b-9ff1444f5df1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:46:43.097983 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2210c-d561-4761-943b-9ff1444f5df1 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:46:43.107287 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 4/8] 10.222.0.40 () {58 vars in 1324 bytes} [Mon Jul 11 20:46:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 20:46:43.112301 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f811d-11b9-4a33-9272-6e8f799908b1 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:46:43.121148 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f811d-11b9-4a33-9272-6e8f799908b1 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:46:43.125694 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27065c-fddb-444a-a91c-5394d87378ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:46:43.126546 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27065c-fddb-444a-a91c-5394d87378ae admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:43.126838 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27065c-fddb-444a-a91c-5394d87378ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:43.127114 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27065c-fddb-444a-a91c-5394d87378ae admin admin] PATH_INFO: `/v3/users/69c8f3089c874dc3bc848ee6f85bc4e4` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:43.128580 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27065c-fddb-444a-a91c-5394d87378ae admin admin] RBAC: Authorizing `identity:get_user(user_id=69c8f3089c874dc3bc848ee6f85bc4e4)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:46:43.130386 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27065c-fddb-444a-a91c-5394d87378ae admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:46:43.131927 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 5/9] 10.222.0.40 () {56 vars in 1198 bytes} [Mon Jul 11 20:46:43 2022] GET /identity/v3/users/69c8f3089c874dc3bc848ee6f85bc4e4 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:46:45.217494 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d17e1-ac3f-465c-b898-3de647c28bf7 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:45.218101 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d17e1-ac3f-465c-b898-3de647c28bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:45.218101 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d17e1-ac3f-465c-b898-3de647c28bf7 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:45.219510 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 5/10] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:46:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:46:45.224854 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e977bae-fd26-4bf9-887b-6d42bd45d5bc None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:45.225276 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e977bae-fd26-4bf9-887b-6d42bd45d5bc None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:45.225560 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e977bae-fd26-4bf9-887b-6d42bd45d5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:45.246875 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-7e977bae-fd26-4bf9-887b-6d42bd45d5bc None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:46:45.248196 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-7e977bae-fd26-4bf9-887b-6d42bd45d5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:46:45.261908 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9529d378-7524-434b-b629-7bf358c3a9cb None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:45.262199 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9529d378-7524-434b-b629-7bf358c3a9cb None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:45.262479 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9529d378-7524-434b-b629-7bf358c3a9cb None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:45.263830 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 6/11] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:46:45.268950 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f610882-71d5-418e-ba5f-4d845fe3bef7 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:45.269382 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f610882-71d5-418e-ba5f-4d845fe3bef7 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:45.269730 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f610882-71d5-418e-ba5f-4d845fe3bef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:45.309548 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG passlib.handlers.bcrypt [None req-5f610882-71d5-418e-ba5f-4d845fe3bef7 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80374) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 11 20:46:45.309958 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG passlib.handlers.bcrypt [None req-5f610882-71d5-418e-ba5f-4d845fe3bef7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80374) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 11 20:46:45.336352 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 6/12] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:46:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:46:45.355695 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-5f610882-71d5-418e-ba5f-4d845fe3bef7 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:46:45.357466 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-5f610882-71d5-418e-ba5f-4d845fe3bef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:46:45.360353 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e977bae-fd26-4bf9-887b-6d42bd45d5bc None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:46:45.388058 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:46:45.467479 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 7/13] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:46:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:46:45.481340 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e977bae-fd26-4bf9-887b-6d42bd45d5bc None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:46:45.490733 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f610882-71d5-418e-ba5f-4d845fe3bef7 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:46:45.519836 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d3d51-3807-4e7e-a1ea-9d61d3155798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:46:45.520764 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d3d51-3807-4e7e-a1ea-9d61d3155798 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:45.521057 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d3d51-3807-4e7e-a1ea-9d61d3155798 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:45.521344 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d3d51-3807-4e7e-a1ea-9d61d3155798 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:45.534793 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d3d51-3807-4e7e-a1ea-9d61d3155798 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:46:45.547545 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-5b6d3d51-3807-4e7e-a1ea-9d61d3155798 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:46:45.547545 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:46:45.547545 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:46:45.547545 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:46:45.547545 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:46:45.547545 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:46:45.547545 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:46:45.547545 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:46:45.547545 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:46:45.547545 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:46:45.547545 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:46:45.547545 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:46:45.547545 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:46:45.547545 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:46:45.547545 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:46:45.547545 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:46:45.548573 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:46:45.548573 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:46:45.548573 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:46:45.548573 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:46:45.548573 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:46:45.548573 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:46:45.548573 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:46:45.548573 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:46:45.548573 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:46:45.548573 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:46:45.548573 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:46:45.548573 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:46:45.548573 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:46:45.548573 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:46:45.548573 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:46:45.548573 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:46:45.549494 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:46:45.549494 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:46:45.549494 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:46:45.549494 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:46:45.549494 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:46:45.549494 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:46:45.549494 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:46:45.549494 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:46:45.549494 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:46:45.549494 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:46:45.549494 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:46:45.549494 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:46:45.549494 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 7/14] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 11 20:46:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:46:45.555127 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d3d51-3807-4e7e-a1ea-9d61d3155798 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:46:45.597600 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f610882-71d5-418e-ba5f-4d845fe3bef7 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:46:45.600525 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:46:45.644186 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178219e-82f1-457b-99db-70f47819af7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:46:45.645109 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178219e-82f1-457b-99db-70f47819af7a None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:45.645402 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178219e-82f1-457b-99db-70f47819af7a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:45.645685 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178219e-82f1-457b-99db-70f47819af7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:45.648392 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:46:45.669922 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d3d51-3807-4e7e-a1ea-9d61d3155798 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:46:45.705795 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0cfc55-5e1d-4286-88f7-31125c43df8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:46:45.706483 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0cfc55-5e1d-4286-88f7-31125c43df8f None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:45.706777 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0cfc55-5e1d-4286-88f7-31125c43df8f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:45.707051 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0cfc55-5e1d-4286-88f7-31125c43df8f None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:45.707823 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0cfc55-5e1d-4286-88f7-31125c43df8f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:46:45.708167 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0cfc55-5e1d-4286-88f7-31125c43df8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:46:45.709599 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0cfc55-5e1d-4286-88f7-31125c43df8f None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:46:45.722088 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 8/15] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:46:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:46:45.729434 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0178219e-82f1-457b-99db-70f47819af7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:46:45.730879 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0cfc55-5e1d-4286-88f7-31125c43df8f None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:46:45.731043 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0178219e-82f1-457b-99db-70f47819af7a None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:46:45.838387 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0cfc55-5e1d-4286-88f7-31125c43df8f None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:46:45.839049 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 8/16] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:46:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 20:46:45.844624 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178219e-82f1-457b-99db-70f47819af7a None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:46:45.847609 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:46:45.877757 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c194859-0f92-459c-b6c6-37fa34269f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:46:45.878637 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c194859-0f92-459c-b6c6-37fa34269f19 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:45.878923 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c194859-0f92-459c-b6c6-37fa34269f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:45.879199 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c194859-0f92-459c-b6c6-37fa34269f19 None admin] PATH_INFO: `/v3/users/69c8f3089c874dc3bc848ee6f85bc4e4` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:45.880462 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c194859-0f92-459c-b6c6-37fa34269f19 None admin] RBAC: Authorizing `identity:get_user(user_id=69c8f3089c874dc3bc848ee6f85bc4e4)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:46:45.882114 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c194859-0f92-459c-b6c6-37fa34269f19 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:46:45.883742 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 9/17] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:46:45 2022] GET /identity/v3/users/69c8f3089c874dc3bc848ee6f85bc4e4 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:46:45.889275 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c194859-0f92-459c-b6c6-37fa34269f19 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:46:45.905739 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:46:45.949411 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178219e-82f1-457b-99db-70f47819af7a None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:46:45.988525 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735660d0-2fc6-432e-9144-07212a650bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:46:45.989343 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735660d0-2fc6-432e-9144-07212a650bde None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:45.989644 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735660d0-2fc6-432e-9144-07212a650bde None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:45.990913 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735660d0-2fc6-432e-9144-07212a650bde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:45.996004 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c194859-0f92-459c-b6c6-37fa34269f19 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:46:46.012797 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735660d0-2fc6-432e-9144-07212a650bde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:46:46.014284 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735660d0-2fc6-432e-9144-07212a650bde None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:46:46.034396 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e0f50-ec48-401a-b790-26631368de55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:46:46.035214 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e0f50-ec48-401a-b790-26631368de55 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:46.035508 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e0f50-ec48-401a-b790-26631368de55 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:46.035793 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e0f50-ec48-401a-b790-26631368de55 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:46.036353 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-735660d0-2fc6-432e-9144-07212a650bde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:46:46.036353 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:46:46.036353 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:46:46.036353 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:46:46.036353 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:46:46.036353 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:46:46.036353 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:46:46.036353 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:46:46.036353 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:46:46.036353 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:46:46.036353 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:46:46.036353 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:46:46.036353 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:46:46.036353 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:46:46.036353 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:46:46.037095 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:46:46.037095 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:46:46.037095 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:46:46.037095 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:46:46.037095 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:46:46.037095 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:46:46.037095 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:46:46.037095 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:46:46.037095 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:46:46.037095 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:46:46.037095 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:46:46.037095 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:46:46.037095 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:46:46.037095 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:46:46.037095 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:46:46.037095 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:46:46.037095 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:46:46.037923 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:46:46.037923 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:46:46.037923 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:46:46.037923 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:46:46.038146 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e0f50-ec48-401a-b790-26631368de55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:46:46.038209 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 9/18] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:46:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:46:46.038562 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e0f50-ec48-401a-b790-26631368de55 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:46:46.040152 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 10/19] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:46:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:46:46.045697 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e0f50-ec48-401a-b790-26631368de55 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:46:46.045839 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735660d0-2fc6-432e-9144-07212a650bde None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:46:46.107386 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:46:46.131485 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:46:46.151049 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e0f50-ec48-401a-b790-26631368de55 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:46:46.152705 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735660d0-2fc6-432e-9144-07212a650bde None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:46:46.185853 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4394bffc-ae43-48c8-8ff8-04235822e1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:46:46.186530 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394bffc-ae43-48c8-8ff8-04235822e1e2 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:46.186821 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394bffc-ae43-48c8-8ff8-04235822e1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:46.187104 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394bffc-ae43-48c8-8ff8-04235822e1e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:46.187601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8209a-59fc-445d-bcae-cd770caae30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:46:46.187824 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4394bffc-ae43-48c8-8ff8-04235822e1e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:46:46.188171 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4394bffc-ae43-48c8-8ff8-04235822e1e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:46:46.188305 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8209a-59fc-445d-bcae-cd770caae30d None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:46.188596 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8209a-59fc-445d-bcae-cd770caae30d None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:46.188880 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8209a-59fc-445d-bcae-cd770caae30d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:46.189570 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4394bffc-ae43-48c8-8ff8-04235822e1e2 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:46:46.189722 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce8209a-59fc-445d-bcae-cd770caae30d None admin] RBAC: Adding query filter params (role.id=86273ff072f3438d822e870272491768, scope.domain.id=default, user.id=69c8f3089c874dc3bc848ee6f85bc4e4) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:46:46.190041 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce8209a-59fc-445d-bcae-cd770caae30d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:46:46.191484 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce8209a-59fc-445d-bcae-cd770caae30d None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:46:46.200476 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 10/20] 10.222.0.40 () {56 vars in 1322 bytes} [Mon Jul 11 20:46:46 2022] GET /identity/v3/role_assignments?user.id=69c8f3089c874dc3bc848ee6f85bc4e4&scope.domain.id=default&role.id=86273ff072f3438d822e870272491768 => generated 233 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:46:46.208092 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 11/21] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:46:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:46:48.375597 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182506f-3193-4745-b926-e7732cebda59 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:48.376142 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182506f-3193-4745-b926-e7732cebda59 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:48.376229 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182506f-3193-4745-b926-e7732cebda59 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:48.377581 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 11/22] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:46:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:46:48.392154 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecae96-6a76-48c2-bbee-faff2e2cc8f3 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:48.392624 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecae96-6a76-48c2-bbee-faff2e2cc8f3 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:48.392719 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecae96-6a76-48c2-bbee-faff2e2cc8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:48.417335 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-cfecae96-6a76-48c2-bbee-faff2e2cc8f3 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:46:48.418620 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-cfecae96-6a76-48c2-bbee-faff2e2cc8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:46:48.496162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 12/23] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:46:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:46:48.519268 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e182506f-3193-4745-b926-e7732cebda59 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:46:48.589452 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3ad61-f3e3-4d6a-90db-f22378a7934a None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:48.589784 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3ad61-f3e3-4d6a-90db-f22378a7934a None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:48.590026 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3ad61-f3e3-4d6a-90db-f22378a7934a None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:48.591508 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 13/24] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:46:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:46:48.598578 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b11224-1c58-49a1-8037-cf98fc5da51e None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:48.598869 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b11224-1c58-49a1-8037-cf98fc5da51e None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:48.599151 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b11224-1c58-49a1-8037-cf98fc5da51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:48.621087 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-e1b11224-1c58-49a1-8037-cf98fc5da51e None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:46:48.622352 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-e1b11224-1c58-49a1-8037-cf98fc5da51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:46:48.672521 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e182506f-3193-4745-b926-e7732cebda59 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:46:48.708345 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:46:48.719052 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:46:48.726680 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 14/25] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:46:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:46:48.736145 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc2cf1c-0826-4684-ac41-9e7c3b7e2e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:46:48.737234 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2cf1c-0826-4684-ac41-9e7c3b7e2e99 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:48.737730 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2cf1c-0826-4684-ac41-9e7c3b7e2e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:48.738212 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2cf1c-0826-4684-ac41-9e7c3b7e2e99 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:48.758754 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc2cf1c-0826-4684-ac41-9e7c3b7e2e99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:46:48.770151 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b11224-1c58-49a1-8037-cf98fc5da51e None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:46:48.788997 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-4fc2cf1c-0826-4684-ac41-9e7c3b7e2e99 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:46:48.788997 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:46:48.788997 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:46:48.788997 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:46:48.788997 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:46:48.788997 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:46:48.788997 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:46:48.788997 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:46:48.788997 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:46:48.788997 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:46:48.788997 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:46:48.788997 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:46:48.788997 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:46:48.788997 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:46:48.788997 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:46:48.788997 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:46:48.789907 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:46:48.789907 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:46:48.789907 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:46:48.789907 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:46:48.789907 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:46:48.789907 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:46:48.789907 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:46:48.789907 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:46:48.789907 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:46:48.789907 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:46:48.789907 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:46:48.789907 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:46:48.789907 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:46:48.789907 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:46:48.789907 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:46:48.789907 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:46:48.790763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:46:48.790763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:46:48.790763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:46:48.790763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:46:48.790763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:46:48.790763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:46:48.790763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:46:48.790763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:46:48.790763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:46:48.790763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:46:48.790763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:46:48.790763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:46:48.797125 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 12/26] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 11 20:46:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:46:48.802859 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc2cf1c-0826-4684-ac41-9e7c3b7e2e99 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:46:48.990478 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b11224-1c58-49a1-8037-cf98fc5da51e None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:46:49.020213 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc2cf1c-0826-4684-ac41-9e7c3b7e2e99 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:46:49.071052 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223aede-d86d-4928-bd88-6f58dd618130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:46:49.071948 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223aede-d86d-4928-bd88-6f58dd618130 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:49.072264 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223aede-d86d-4928-bd88-6f58dd618130 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:49.072546 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223aede-d86d-4928-bd88-6f58dd618130 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:49.090958 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abec60d-9dd2-469b-a182-5fa7809a77f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:46:49.091652 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abec60d-9dd2-469b-a182-5fa7809a77f4 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:49.091949 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abec60d-9dd2-469b-a182-5fa7809a77f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:49.092267 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abec60d-9dd2-469b-a182-5fa7809a77f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:49.092449 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d223aede-d86d-4928-bd88-6f58dd618130 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:46:49.093037 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abec60d-9dd2-469b-a182-5fa7809a77f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:46:49.093357 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abec60d-9dd2-469b-a182-5fa7809a77f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:46:49.093948 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d223aede-d86d-4928-bd88-6f58dd618130 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:46:49.094742 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abec60d-9dd2-469b-a182-5fa7809a77f4 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:46:49.122506 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 13/27] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:46:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:46:49.128628 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abec60d-9dd2-469b-a182-5fa7809a77f4 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:46:49.132440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-d223aede-d86d-4928-bd88-6f58dd618130 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:46:49.132440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:46:49.132440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:46:49.132440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:46:49.132440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:46:49.132440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:46:49.132440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:46:49.132440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:46:49.132440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:46:49.132440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:46:49.132440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:46:49.132440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:46:49.132440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:46:49.132440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:46:49.132440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:46:49.133289 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:46:49.133289 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:46:49.133289 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:46:49.133289 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:46:49.133289 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:46:49.133289 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:46:49.133289 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:46:49.133289 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:46:49.133289 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:46:49.133289 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:46:49.133289 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:46:49.133289 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:46:49.133289 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:46:49.133289 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:46:49.133289 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:46:49.133289 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:46:49.133289 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:46:49.134080 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:46:49.134080 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:46:49.134080 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:46:49.134080 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:46:49.136900 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 15/28] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:46:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:46:49.142292 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223aede-d86d-4928-bd88-6f58dd618130 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:46:49.214787 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:46:49.241853 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:46:49.302359 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223aede-d86d-4928-bd88-6f58dd618130 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:46:49.313243 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abec60d-9dd2-469b-a182-5fa7809a77f4 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:46:49.351890 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef272275-c309-4781-96de-fe29c414770f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:46:49.354066 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef272275-c309-4781-96de-fe29c414770f None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:49.355455 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef272275-c309-4781-96de-fe29c414770f None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:49.358498 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef272275-c309-4781-96de-fe29c414770f None admin] PATH_INFO: `/v3/users/69c8f3089c874dc3bc848ee6f85bc4e4` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:49.360438 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef272275-c309-4781-96de-fe29c414770f None admin] RBAC: Authorizing `identity:get_user(user_id=69c8f3089c874dc3bc848ee6f85bc4e4)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:46:49.362116 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef272275-c309-4781-96de-fe29c414770f None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:46:49.363980 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 14/29] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:46:49 2022] GET /identity/v3/users/69c8f3089c874dc3bc848ee6f85bc4e4 => generated 247 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:46:49.365506 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33161387-f2b1-4c83-b565-0207ed4fdfe2 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:49.366053 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33161387-f2b1-4c83-b565-0207ed4fdfe2 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:49.366639 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33161387-f2b1-4c83-b565-0207ed4fdfe2 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:49.368371 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 15/30] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:46:49.373196 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33161387-f2b1-4c83-b565-0207ed4fdfe2 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:46:49.388828 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b8ab7-bff1-4b13-8370-364b9ab1f85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:46:49.389729 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b8ab7-bff1-4b13-8370-364b9ab1f85e None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:49.390164 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b8ab7-bff1-4b13-8370-364b9ab1f85e None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:49.390581 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b8ab7-bff1-4b13-8370-364b9ab1f85e None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:49.391631 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b8ab7-bff1-4b13-8370-364b9ab1f85e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:46:49.392119 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b8ab7-bff1-4b13-8370-364b9ab1f85e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:46:49.393712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b8ab7-bff1-4b13-8370-364b9ab1f85e None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:46:49.410777 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 16/31] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:46:49.412405 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9885c-996b-4553-bb09-7740e5fb5d5b None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:49.413992 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9885c-996b-4553-bb09-7740e5fb5d5b None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:49.414484 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9885c-996b-4553-bb09-7740e5fb5d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:49.433730 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-ead9885c-996b-4553-bb09-7740e5fb5d5b None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:46:49.435178 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-ead9885c-996b-4553-bb09-7740e5fb5d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:46:49.512143 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 17/32] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:46:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:46:49.513796 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84984963-ddce-48ff-baec-bd51175eabf9 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:49.514300 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84984963-ddce-48ff-baec-bd51175eabf9 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:49.514773 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84984963-ddce-48ff-baec-bd51175eabf9 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:49.516254 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 18/33] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:46:49.517159 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84984963-ddce-48ff-baec-bd51175eabf9 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:46:49.537786 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33161387-f2b1-4c83-b565-0207ed4fdfe2 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:46:49.551936 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:46:49.577530 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6aa41-ea40-4f37-bf83-64dc74999218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:46:49.578694 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6aa41-ea40-4f37-bf83-64dc74999218 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:49.579232 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6aa41-ea40-4f37-bf83-64dc74999218 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:49.579722 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6aa41-ea40-4f37-bf83-64dc74999218 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:49.581192 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b6aa41-ea40-4f37-bf83-64dc74999218 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:46:49.582983 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b6aa41-ea40-4f37-bf83-64dc74999218 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:46:49.584913 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 16/34] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:46:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:46:49.586491 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ea2f0-90f2-45d8-8305-cc61bf0e3ecc None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:49.586976 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ea2f0-90f2-45d8-8305-cc61bf0e3ecc None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:49.588270 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ea2f0-90f2-45d8-8305-cc61bf0e3ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:49.592915 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:46:49.608493 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-c07ea2f0-90f2-45d8-8305-cc61bf0e3ecc None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:46:49.610105 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c07ea2f0-90f2-45d8-8305-cc61bf0e3ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:46:49.666790 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84984963-ddce-48ff-baec-bd51175eabf9 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:46:49.700923 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 17/35] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:46:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:46:49.702198 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ea2f0-90f2-45d8-8305-cc61bf0e3ecc None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:46:49.709286 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4060ba-504d-4d6e-b98d-1368f00cd349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:46:49.709969 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4060ba-504d-4d6e-b98d-1368f00cd349 None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:49.710274 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4060ba-504d-4d6e-b98d-1368f00cd349 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:49.710537 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4060ba-504d-4d6e-b98d-1368f00cd349 None admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:49.711247 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4060ba-504d-4d6e-b98d-1368f00cd349 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:46:49.713857 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4060ba-504d-4d6e-b98d-1368f00cd349 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:46:49.818815 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ea2f0-90f2-45d8-8305-cc61bf0e3ecc None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:46:49.829075 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:46:49.856415 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22f913-bcae-490d-ac71-84133f1b4feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:46:49.857151 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22f913-bcae-490d-ac71-84133f1b4feb None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:49.857444 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22f913-bcae-490d-ac71-84133f1b4feb None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:49.857725 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22f913-bcae-490d-ac71-84133f1b4feb None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:49.858591 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de22f913-bcae-490d-ac71-84133f1b4feb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:46:49.860046 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de22f913-bcae-490d-ac71-84133f1b4feb None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:46:49.922464 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 19/36] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Jul 11 20:46:49 2022] POST /identity/v3/projects => generated 301 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:46:49.923882 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4060ba-504d-4d6e-b98d-1368f00cd349 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:46:50.088706 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 18/37] 10.222.0.40 () {60 vars in 1131 bytes} [Mon Jul 11 20:46:49 2022] POST /identity/v3/roles => generated 219 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:46:50.089648 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22f913-bcae-490d-ac71-84133f1b4feb None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:46:50.192751 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:46:50.203405 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4060ba-504d-4d6e-b98d-1368f00cd349 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:46:50.237977 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22f913-bcae-490d-ac71-84133f1b4feb None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:46:50.243495 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce1200-0433-42e8-9681-e66374d12753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:46:50.244659 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce1200-0433-42e8-9681-e66374d12753 None admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:50.244960 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce1200-0433-42e8-9681-e66374d12753 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:50.245250 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce1200-0433-42e8-9681-e66374d12753 None admin] PATH_INFO: `/v3/domains/default/users/69c8f3089c874dc3bc848ee6f85bc4e4/roles/86273ff072f3438d822e870272491768` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:50.247956 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ce1200-0433-42e8-9681-e66374d12753 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=69c8f3089c874dc3bc848ee6f85bc4e4, role_id=86273ff072f3438d822e870272491768)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:46:50.249986 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ce1200-0433-42e8-9681-e66374d12753 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:46:50.274714 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38661138-f376-4331-81c3-16ba238643b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:46:50.276095 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38661138-f376-4331-81c3-16ba238643b3 None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:50.276923 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38661138-f376-4331-81c3-16ba238643b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:50.276923 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38661138-f376-4331-81c3-16ba238643b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:50.281388 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38661138-f376-4331-81c3-16ba238643b3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:46:50.281388 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38661138-f376-4331-81c3-16ba238643b3 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:46:50.363331 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 20/38] 10.222.0.40 () {58 vars in 1361 bytes} [Mon Jul 11 20:46:49 2022] PUT /identity/v3/domains/default/users/69c8f3089c874dc3bc848ee6f85bc4e4/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:46:50.364686 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe3c7c-dde8-4352-829a-7690c347f788 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:50.364992 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe3c7c-dde8-4352-829a-7690c347f788 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:50.365279 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe3c7c-dde8-4352-829a-7690c347f788 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:50.366560 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 21/39] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:46:50.367689 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df15a07-9392-4002-8fd8-1910f4f85af4 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:50.367995 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df15a07-9392-4002-8fd8-1910f4f85af4 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:50.368290 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df15a07-9392-4002-8fd8-1910f4f85af4 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:50.370591 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 22/40] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:46:50.373316 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d48fe-e2a1-4ace-b7de-3dea7de846e9 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:50.374051 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d48fe-e2a1-4ace-b7de-3dea7de846e9 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:50.374341 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d48fe-e2a1-4ace-b7de-3dea7de846e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:50.389958 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 19/41] 10.222.0.40 () {60 vars in 1131 bytes} [Mon Jul 11 20:46:50 2022] POST /identity/v3/roles => generated 225 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:46:50.392041 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2b248-ec3a-4e8d-a591-89e627ccb0cf None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:50.392623 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2b248-ec3a-4e8d-a591-89e627ccb0cf None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:50.393109 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2b248-ec3a-4e8d-a591-89e627ccb0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:50.394743 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-056d48fe-e2a1-4ace-b7de-3dea7de846e9 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:46:50.396657 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-056d48fe-e2a1-4ace-b7de-3dea7de846e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:46:50.418099 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-21e2b248-ec3a-4e8d-a591-89e627ccb0cf None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:46:50.420742 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-21e2b248-ec3a-4e8d-a591-89e627ccb0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:46:50.453439 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:46:50.496520 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 23/42] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:46:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:46:50.517353 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 20/43] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:46:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:46:50.521449 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d48fe-e2a1-4ace-b7de-3dea7de846e9 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:46:50.541958 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2b248-ec3a-4e8d-a591-89e627ccb0cf None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:46:50.630024 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:46:50.649382 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d48fe-e2a1-4ace-b7de-3dea7de846e9 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:46:50.678544 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2b248-ec3a-4e8d-a591-89e627ccb0cf None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:46:50.698505 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02e9ab-5393-42d8-8cfc-e6a4e7d1c6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:46:50.699322 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02e9ab-5393-42d8-8cfc-e6a4e7d1c6b9 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:50.699617 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02e9ab-5393-42d8-8cfc-e6a4e7d1c6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:50.699902 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02e9ab-5393-42d8-8cfc-e6a4e7d1c6b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:50.701953 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe02e9ab-5393-42d8-8cfc-e6a4e7d1c6b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:46:50.704138 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe02e9ab-5393-42d8-8cfc-e6a4e7d1c6b9 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:46:50.706553 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 24/44] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:46:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:46:50.711658 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02e9ab-5393-42d8-8cfc-e6a4e7d1c6b9 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:46:50.715000 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de68dc-aaa3-45a3-9642-60d0d1ad9849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:46:50.715687 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de68dc-aaa3-45a3-9642-60d0d1ad9849 None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:50.715995 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de68dc-aaa3-45a3-9642-60d0d1ad9849 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:50.716298 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de68dc-aaa3-45a3-9642-60d0d1ad9849 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:50.717052 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de68dc-aaa3-45a3-9642-60d0d1ad9849 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:46:50.718438 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de68dc-aaa3-45a3-9642-60d0d1ad9849 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:46:50.798345 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 21/45] 10.222.0.40 () {60 vars in 1131 bytes} [Mon Jul 11 20:46:50 2022] POST /identity/v3/roles => generated 223 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:46:50.827078 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02e9ab-5393-42d8-8cfc-e6a4e7d1c6b9 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:46:50.871154 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c094d-fdd7-48e0-9a0b-406ad8aaffbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:46:50.871860 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c094d-fdd7-48e0-9a0b-406ad8aaffbd None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:50.872173 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c094d-fdd7-48e0-9a0b-406ad8aaffbd None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:50.872457 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c094d-fdd7-48e0-9a0b-406ad8aaffbd None admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:50.873189 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43c094d-fdd7-48e0-9a0b-406ad8aaffbd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:46:50.874924 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43c094d-fdd7-48e0-9a0b-406ad8aaffbd None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:46:50.959466 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 25/46] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Jul 11 20:46:50 2022] POST /identity/v3/projects => generated 312 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 20:46:52.489258 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5989c4b-77f4-4797-822c-b6ffec8b675a None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:52.489786 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5989c4b-77f4-4797-822c-b6ffec8b675a None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:52.489870 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5989c4b-77f4-4797-822c-b6ffec8b675a None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:52.491198 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 22/47] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:46:52.497195 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf068225-58e5-4058-a70d-f90078ed8e70 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:52.497602 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf068225-58e5-4058-a70d-f90078ed8e70 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:52.497768 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf068225-58e5-4058-a70d-f90078ed8e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:52.504726 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:46:52.515602 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-cf068225-58e5-4058-a70d-f90078ed8e70 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:46:52.516827 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-cf068225-58e5-4058-a70d-f90078ed8e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:46:52.585452 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 26/48] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:46:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:46:52.609035 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5989c4b-77f4-4797-822c-b6ffec8b675a None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:46:52.628459 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:46:52.718572 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5989c4b-77f4-4797-822c-b6ffec8b675a None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:46:52.752364 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab2ab0-6511-4bcc-96e0-f73247329314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:46:52.753100 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab2ab0-6511-4bcc-96e0-f73247329314 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:52.753406 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab2ab0-6511-4bcc-96e0-f73247329314 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:52.753728 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab2ab0-6511-4bcc-96e0-f73247329314 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:52.763837 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eab2ab0-6511-4bcc-96e0-f73247329314 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:46:52.771401 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-5eab2ab0-6511-4bcc-96e0-f73247329314 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:46:52.771401 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:46:52.771401 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:46:52.771401 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:46:52.771401 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:46:52.771401 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:46:52.771401 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:46:52.771401 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:46:52.771401 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:46:52.771401 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:46:52.771401 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:46:52.771401 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:46:52.771401 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:46:52.771401 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:46:52.771401 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:46:52.771401 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:46:52.772248 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:46:52.772248 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:46:52.772248 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:46:52.772248 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:46:52.772248 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:46:52.772248 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:46:52.772248 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:46:52.772248 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:46:52.772248 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:46:52.772248 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:46:52.772248 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:46:52.772248 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:46:52.772248 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:46:52.772248 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:46:52.772248 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:46:52.772248 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:46:52.773001 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:46:52.773001 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:46:52.773001 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:46:52.773001 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:46:52.773001 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:46:52.773001 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:46:52.773001 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:46:52.773001 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:46:52.773001 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:46:52.773001 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:46:52.773001 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:46:52.773001 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:46:52.773001 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 23/49] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 11 20:46:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:46:52.779112 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf068225-58e5-4058-a70d-f90078ed8e70 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:46:52.876627 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf068225-58e5-4058-a70d-f90078ed8e70 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:46:52.909820 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd190c3-3082-4a9f-9e7b-2df82d6eabad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:46:52.910505 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd190c3-3082-4a9f-9e7b-2df82d6eabad None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:52.910798 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd190c3-3082-4a9f-9e7b-2df82d6eabad None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:52.911082 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd190c3-3082-4a9f-9e7b-2df82d6eabad None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:52.911847 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd190c3-3082-4a9f-9e7b-2df82d6eabad None admin] RBAC: Adding query filter params (name=admin) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:46:52.912198 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd190c3-3082-4a9f-9e7b-2df82d6eabad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:46:52.913608 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd190c3-3082-4a9f-9e7b-2df82d6eabad None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:46:52.915199 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:46:52.922666 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 27/50] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:46:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:46:52.928222 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab2ab0-6511-4bcc-96e0-f73247329314 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:46:53.009081 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:46:53.029682 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab2ab0-6511-4bcc-96e0-f73247329314 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:46:53.063456 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56839c68-bcb1-4f4e-9c31-9efe85d88b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:46:53.063654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a93dfc-5c3a-4f56-bcd6-80d51bacccef None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:53.063836 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a93dfc-5c3a-4f56-bcd6-80d51bacccef None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:53.064166 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a93dfc-5c3a-4f56-bcd6-80d51bacccef None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:53.064378 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56839c68-bcb1-4f4e-9c31-9efe85d88b8d None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:53.064667 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56839c68-bcb1-4f4e-9c31-9efe85d88b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:53.064949 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56839c68-bcb1-4f4e-9c31-9efe85d88b8d None admin] PATH_INFO: `/v3/users/69c8f3089c874dc3bc848ee6f85bc4e4` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:53.065560 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 28/51] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:46:53.066292 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56839c68-bcb1-4f4e-9c31-9efe85d88b8d None admin] RBAC: Authorizing `identity:get_user(user_id=69c8f3089c874dc3bc848ee6f85bc4e4)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:46:53.067777 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56839c68-bcb1-4f4e-9c31-9efe85d88b8d None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:46:53.069655 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 24/52] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:46:52 2022] GET /identity/v3/users/69c8f3089c874dc3bc848ee6f85bc4e4 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:46:53.073235 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a53781-0494-4827-8d10-6412043d85a3 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:53.073534 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a53781-0494-4827-8d10-6412043d85a3 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:53.073820 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a53781-0494-4827-8d10-6412043d85a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:53.076328 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56839c68-bcb1-4f4e-9c31-9efe85d88b8d None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:46:53.091924 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-69a53781-0494-4827-8d10-6412043d85a3 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:46:53.093166 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-69a53781-0494-4827-8d10-6412043d85a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:46:53.158619 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 29/53] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:46:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:46:53.174406 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56839c68-bcb1-4f4e-9c31-9efe85d88b8d None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:46:53.181432 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a53781-0494-4827-8d10-6412043d85a3 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:46:53.208397 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c869e31-c07a-4d8d-8dba-2097d8ef9496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:46:53.209194 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c869e31-c07a-4d8d-8dba-2097d8ef9496 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:53.209485 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c869e31-c07a-4d8d-8dba-2097d8ef9496 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:53.209778 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c869e31-c07a-4d8d-8dba-2097d8ef9496 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:53.210950 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c869e31-c07a-4d8d-8dba-2097d8ef9496 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:46:53.213047 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c869e31-c07a-4d8d-8dba-2097d8ef9496 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:46:53.214668 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 25/54] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:46:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:46:53.220239 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c869e31-c07a-4d8d-8dba-2097d8ef9496 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:46:53.236458 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:46:53.281914 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a53781-0494-4827-8d10-6412043d85a3 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:46:53.307649 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:46:53.315953 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40487317-d02d-45f3-81ac-246743024675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:46:53.316775 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40487317-d02d-45f3-81ac-246743024675 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:53.318410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40487317-d02d-45f3-81ac-246743024675 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:53.318410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40487317-d02d-45f3-81ac-246743024675 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:53.318666 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40487317-d02d-45f3-81ac-246743024675 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:46:53.320181 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40487317-d02d-45f3-81ac-246743024675 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:46:53.320812 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c869e31-c07a-4d8d-8dba-2097d8ef9496 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:46:53.321929 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 30/55] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:46:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:46:53.327717 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40487317-d02d-45f3-81ac-246743024675 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:46:53.357528 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d90d47-7bd9-4f32-8684-84dcdcca3fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:46:53.358197 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d90d47-7bd9-4f32-8684-84dcdcca3fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:53.358490 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d90d47-7bd9-4f32-8684-84dcdcca3fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:53.358773 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d90d47-7bd9-4f32-8684-84dcdcca3fb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:53.359612 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d90d47-7bd9-4f32-8684-84dcdcca3fb4 None admin] RBAC: Adding query filter params (role.id=86273ff072f3438d822e870272491768, scope.domain.id=default, user.id=69c8f3089c874dc3bc848ee6f85bc4e4) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:46:53.360016 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d90d47-7bd9-4f32-8684-84dcdcca3fb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:46:53.361546 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d90d47-7bd9-4f32-8684-84dcdcca3fb4 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:46:53.368887 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 26/56] 10.222.0.40 () {56 vars in 1322 bytes} [Mon Jul 11 20:46:53 2022] GET /identity/v3/role_assignments?user.id=69c8f3089c874dc3bc848ee6f85bc4e4&scope.domain.id=default&role.id=86273ff072f3438d822e870272491768 => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:46:53.434937 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40487317-d02d-45f3-81ac-246743024675 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:46:53.470591 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a6a90-78ac-44ef-b287-9b8b2ab772b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:46:53.471272 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a6a90-78ac-44ef-b287-9b8b2ab772b1 None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:53.471563 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a6a90-78ac-44ef-b287-9b8b2ab772b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:53.471847 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a6a90-78ac-44ef-b287-9b8b2ab772b1 None admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:53.472601 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a6a90-78ac-44ef-b287-9b8b2ab772b1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:46:53.474084 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a6a90-78ac-44ef-b287-9b8b2ab772b1 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:46:53.577010 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 31/57] 10.222.0.40 () {60 vars in 1140 bytes} [Mon Jul 11 20:46:53 2022] POST /identity/v3/projects => generated 298 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 20:46:55.634211 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab069527-fda4-4157-9580-b9541dbdc944 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:55.634726 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab069527-fda4-4157-9580-b9541dbdc944 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:55.634832 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab069527-fda4-4157-9580-b9541dbdc944 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:55.636212 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 27/58] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:46:55.641179 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca49013-0620-4bea-8e13-f55696b4a0a7 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:55.641576 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca49013-0620-4bea-8e13-f55696b4a0a7 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:55.641763 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca49013-0620-4bea-8e13-f55696b4a0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:55.658741 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-8ca49013-0620-4bea-8e13-f55696b4a0a7 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:46:55.659942 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-8ca49013-0620-4bea-8e13-f55696b4a0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:46:55.702622 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:46:55.726299 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 32/59] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:46:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:46:55.751259 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab069527-fda4-4157-9580-b9541dbdc944 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:46:55.933822 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:46:55.956725 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab069527-fda4-4157-9580-b9541dbdc944 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:46:55.990343 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b764c-a760-4859-9783-8fb59b671b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:46:55.991141 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b764c-a760-4859-9783-8fb59b671b1a None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:55.991434 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b764c-a760-4859-9783-8fb59b671b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:55.991718 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b764c-a760-4859-9783-8fb59b671b1a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:55.992930 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1b764c-a760-4859-9783-8fb59b671b1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:46:55.994386 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1b764c-a760-4859-9783-8fb59b671b1a None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:46:55.996508 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 28/60] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:46:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:46:56.002461 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca49013-0620-4bea-8e13-f55696b4a0a7 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:46:56.097338 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca49013-0620-4bea-8e13-f55696b4a0a7 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:46:56.129274 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56820caf-b51a-4b0f-8c0a-7c01887e6457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:46:56.129942 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56820caf-b51a-4b0f-8c0a-7c01887e6457 None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:56.130232 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56820caf-b51a-4b0f-8c0a-7c01887e6457 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:56.130512 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56820caf-b51a-4b0f-8c0a-7c01887e6457 None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:56.131212 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56820caf-b51a-4b0f-8c0a-7c01887e6457 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:46:56.132688 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56820caf-b51a-4b0f-8c0a-7c01887e6457 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:46:56.232317 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 33/61] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jul 11 20:46:56 2022] POST /identity/v3/users => generated 275 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:46:59.336113 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0ade7-ae29-4ef4-a801-779ca7b90b5b None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:59.337146 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0ade7-ae29-4ef4-a801-779ca7b90b5b None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:59.337641 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0ade7-ae29-4ef4-a801-779ca7b90b5b None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:59.339754 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 29/62] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:46:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:46:59.344953 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a390f7d-a274-4daf-a41d-20b3b7122e55 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:59.345798 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a390f7d-a274-4daf-a41d-20b3b7122e55 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:59.346284 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a390f7d-a274-4daf-a41d-20b3b7122e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:59.372962 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-8a390f7d-a274-4daf-a41d-20b3b7122e55 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:46:59.374776 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-8a390f7d-a274-4daf-a41d-20b3b7122e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:46:59.410469 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:46:59.461517 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 34/63] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:46:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:46:59.497631 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0ade7-ae29-4ef4-a801-779ca7b90b5b None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:46:59.548621 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec212f-251d-48c8-afd9-2bdf38f96947 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:59.548915 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec212f-251d-48c8-afd9-2bdf38f96947 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:59.549365 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec212f-251d-48c8-afd9-2bdf38f96947 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:59.550900 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 35/64] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:46:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:46:59.566273 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd94966-39c3-4a04-9892-11f30ccfb750 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:59.566803 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd94966-39c3-4a04-9892-11f30ccfb750 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:59.567231 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd94966-39c3-4a04-9892-11f30ccfb750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:59.584146 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-0cd94966-39c3-4a04-9892-11f30ccfb750 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:46:59.585606 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-0cd94966-39c3-4a04-9892-11f30ccfb750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:46:59.644432 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0ade7-ae29-4ef4-a801-779ca7b90b5b None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:46:59.680060 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b8865-8464-44b8-aa3d-8508f81194bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:46:59.681104 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b8865-8464-44b8-aa3d-8508f81194bd None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:59.681588 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b8865-8464-44b8-aa3d-8508f81194bd None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:59.682232 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b8865-8464-44b8-aa3d-8508f81194bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:59.692534 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 36/65] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:46:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:46:59.694113 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ab941-0f2b-4fc2-aee2-d4df8f030d88 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:59.694548 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ab941-0f2b-4fc2-aee2-d4df8f030d88 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:59.694965 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ab941-0f2b-4fc2-aee2-d4df8f030d88 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:59.695831 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b8865-8464-44b8-aa3d-8508f81194bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:46:59.696589 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 37/66] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:46:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:46:59.702684 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dde9e-a18f-4626-a057-51db141dc01a None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:59.703127 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dde9e-a18f-4626-a057-51db141dc01a None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:59.703566 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dde9e-a18f-4626-a057-51db141dc01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:59.704940 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-6d2b8865-8464-44b8-aa3d-8508f81194bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:46:59.704940 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:46:59.704940 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:46:59.704940 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:46:59.704940 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:46:59.704940 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:46:59.704940 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:46:59.704940 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:46:59.704940 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:46:59.704940 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:46:59.704940 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:46:59.704940 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:46:59.704940 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:46:59.704940 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:46:59.704940 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:46:59.704940 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:46:59.705940 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:46:59.705940 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:46:59.705940 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:46:59.705940 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:46:59.705940 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:46:59.705940 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:46:59.705940 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:46:59.705940 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:46:59.705940 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:46:59.705940 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:46:59.705940 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:46:59.705940 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:46:59.705940 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:46:59.705940 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:46:59.705940 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:46:59.705940 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:46:59.706893 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:46:59.706893 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:46:59.706893 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:46:59.706893 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:46:59.706893 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:46:59.706893 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:46:59.706893 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:46:59.706893 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:46:59.706893 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:46:59.706893 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:46:59.706893 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:46:59.706893 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:46:59.708275 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 30/67] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:46:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:46:59.714883 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b8865-8464-44b8-aa3d-8508f81194bd None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:46:59.728686 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:46:59.731068 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-2b8dde9e-a18f-4626-a057-51db141dc01a None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:46:59.732475 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-2b8dde9e-a18f-4626-a057-51db141dc01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:46:59.814052 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 38/68] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:46:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:46:59.815224 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8dde9e-a18f-4626-a057-51db141dc01a None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:46:59.844380 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:46:59.850408 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b8865-8464-44b8-aa3d-8508f81194bd None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:46:59.904844 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def50a1f-aa4d-4be3-9191-3973bacfbd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:46:59.906194 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def50a1f-aa4d-4be3-9191-3973bacfbd25 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:59.906652 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def50a1f-aa4d-4be3-9191-3973bacfbd25 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:59.907451 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def50a1f-aa4d-4be3-9191-3973bacfbd25 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:59.908715 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def50a1f-aa4d-4be3-9191-3973bacfbd25 None admin] RBAC: Adding query filter params (name=member) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:46:59.909183 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def50a1f-aa4d-4be3-9191-3973bacfbd25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:46:59.910726 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def50a1f-aa4d-4be3-9191-3973bacfbd25 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:46:59.920507 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 31/69] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 11 20:46:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:46:59.921547 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def50a1f-aa4d-4be3-9191-3973bacfbd25 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:46:59.938058 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8dde9e-a18f-4626-a057-51db141dc01a None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:46:59.978246 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34f059-df95-406f-84ed-4f740e368ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:46:59.980155 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34f059-df95-406f-84ed-4f740e368ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:46:59.980746 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34f059-df95-406f-84ed-4f740e368ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:46:59.981491 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34f059-df95-406f-84ed-4f740e368ca2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:46:59.989377 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:46:59.993232 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34f059-df95-406f-84ed-4f740e368ca2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:00.002118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-0c34f059-df95-406f-84ed-4f740e368ca2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:47:00.002118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:00.002118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:00.002118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:00.002118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:00.002118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:00.002118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:00.002118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:00.002118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:00.002118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:00.002118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:00.002118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:00.002118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:00.002118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:00.002118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:00.002118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:00.003082 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:00.003082 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:00.003082 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:00.003082 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:00.003082 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:00.003082 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:00.003082 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:00.003082 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:00.003082 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:00.003082 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:00.003082 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:00.003082 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:00.003082 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:00.003082 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:00.003082 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:00.003082 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:00.003886 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:00.003886 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:00.003886 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:00.003886 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:00.003886 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:00.003886 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:00.003886 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:00.003886 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:00.003886 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:00.003886 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:00.003886 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:47:00.003886 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:47:00.003886 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 39/70] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 11 20:46:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:00.005492 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018c39f-2750-4875-9bce-2dbff38108ca None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:00.005492 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018c39f-2750-4875-9bce-2dbff38108ca None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:00.005492 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018c39f-2750-4875-9bce-2dbff38108ca None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:00.006612 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 40/71] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:00.007100 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018c39f-2750-4875-9bce-2dbff38108ca None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:00.036030 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def50a1f-aa4d-4be3-9191-3973bacfbd25 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:00.069628 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7f149-4ced-42ee-ba18-b7f31dfeba6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:00.070450 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7f149-4ced-42ee-ba18-b7f31dfeba6f None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:00.070743 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7f149-4ced-42ee-ba18-b7f31dfeba6f None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:00.071029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7f149-4ced-42ee-ba18-b7f31dfeba6f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:00.081259 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef7f149-4ced-42ee-ba18-b7f31dfeba6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:00.089792 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-0ef7f149-4ced-42ee-ba18-b7f31dfeba6f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:47:00.089792 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:00.089792 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:00.089792 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:00.089792 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:00.089792 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:00.089792 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:00.089792 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:00.089792 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:00.089792 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:00.089792 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:00.089792 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:00.089792 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:00.089792 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:00.089792 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:00.089792 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:00.090672 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:00.090672 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:00.090672 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:00.090672 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:00.090672 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:00.090672 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:00.090672 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:00.090672 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:00.090672 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:00.090672 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:00.090672 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:00.090672 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:00.090672 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:00.090672 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:00.090672 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:00.090672 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:00.091627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:00.091627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:00.091627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:00.091627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:00.091627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:00.091627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:00.091627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:00.091627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:00.091627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:00.091627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:00.091627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:47:00.091627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:47:00.091627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 32/72] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jul 11 20:46:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:00.092485 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7f149-4ced-42ee-ba18-b7f31dfeba6f None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:00.096973 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:00.117106 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018c39f-2750-4875-9bce-2dbff38108ca None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:00.150271 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6fb65b-5b34-42fd-853e-c9c92036cab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:00.151717 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fb65b-5b34-42fd-853e-c9c92036cab9 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:00.152019 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fb65b-5b34-42fd-853e-c9c92036cab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:00.152295 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fb65b-5b34-42fd-853e-c9c92036cab9 None admin] PATH_INFO: `/v3/users/20a887b4089a485d92fa68e64ce9538a` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:00.165430 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6fb65b-5b34-42fd-853e-c9c92036cab9 None admin] RBAC: Authorizing `identity:get_user(user_id=20a887b4089a485d92fa68e64ce9538a)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:00.167663 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6fb65b-5b34-42fd-853e-c9c92036cab9 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:00.169379 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 41/73] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:47:00 2022] GET /identity/v3/users/20a887b4089a485d92fa68e64ce9538a => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:00.170570 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500e4d4-2e89-42a0-9fa8-1ee7241aa3f2 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:00.170863 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500e4d4-2e89-42a0-9fa8-1ee7241aa3f2 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:00.171154 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500e4d4-2e89-42a0-9fa8-1ee7241aa3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:00.187248 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-3500e4d4-2e89-42a0-9fa8-1ee7241aa3f2 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:00.188543 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-3500e4d4-2e89-42a0-9fa8-1ee7241aa3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:00.191604 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7f149-4ced-42ee-ba18-b7f31dfeba6f None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:00.219057 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:00.226993 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74d77c-3a2e-4078-a89a-655db3160567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:00.227681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74d77c-3a2e-4078-a89a-655db3160567 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:00.228009 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74d77c-3a2e-4078-a89a-655db3160567 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:00.228287 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74d77c-3a2e-4078-a89a-655db3160567 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:00.229766 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74d77c-3a2e-4078-a89a-655db3160567 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:00.230087 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74d77c-3a2e-4078-a89a-655db3160567 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:00.249948 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74d77c-3a2e-4078-a89a-655db3160567 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:00.249948 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 33/74] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:47:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:00.249948 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177e793-1391-490e-9ecc-f2f7d0311915 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:00.249948 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177e793-1391-490e-9ecc-f2f7d0311915 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:00.249948 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177e793-1391-490e-9ecc-f2f7d0311915 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:00.249948 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 34/75] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:00.249948 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177e793-1391-490e-9ecc-f2f7d0311915 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:00.263854 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 42/76] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:00.264596 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500e4d4-2e89-42a0-9fa8-1ee7241aa3f2 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:00.334176 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:00.358673 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177e793-1391-490e-9ecc-f2f7d0311915 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:00.366145 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500e4d4-2e89-42a0-9fa8-1ee7241aa3f2 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:00.391570 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddaf458-d882-4832-bdcf-54dc4ae1091f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:00.392309 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddaf458-d882-4832-bdcf-54dc4ae1091f None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:00.392601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddaf458-d882-4832-bdcf-54dc4ae1091f None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:00.392886 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddaf458-d882-4832-bdcf-54dc4ae1091f None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:00.393646 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddaf458-d882-4832-bdcf-54dc4ae1091f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:00.393971 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddaf458-d882-4832-bdcf-54dc4ae1091f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:00.395364 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddaf458-d882-4832-bdcf-54dc4ae1091f None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:00.398533 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f0105-9bf7-40fc-bf76-364294067ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:00.399188 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f0105-9bf7-40fc-bf76-364294067ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:00.399479 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f0105-9bf7-40fc-bf76-364294067ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:00.399760 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f0105-9bf7-40fc-bf76-364294067ee8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:00.403720 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 35/77] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:47:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:00.404560 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddaf458-d882-4832-bdcf-54dc4ae1091f None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:00.458945 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:00.467656 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454f0105-9bf7-40fc-bf76-364294067ee8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:00.473240 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454f0105-9bf7-40fc-bf76-364294067ee8 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:00.506129 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddaf458-d882-4832-bdcf-54dc4ae1091f None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:00.537735 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:00.540518 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd493a53-cafe-4437-8758-6724ad4612d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:00.541529 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd493a53-cafe-4437-8758-6724ad4612d5 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:00.541830 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd493a53-cafe-4437-8758-6724ad4612d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:00.542115 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd493a53-cafe-4437-8758-6724ad4612d5 None admin] PATH_INFO: `/v3/users/69c8f3089c874dc3bc848ee6f85bc4e4` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:00.543319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd493a53-cafe-4437-8758-6724ad4612d5 None admin] RBAC: Authorizing `identity:get_user(user_id=69c8f3089c874dc3bc848ee6f85bc4e4)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:00.544792 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd493a53-cafe-4437-8758-6724ad4612d5 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:00.546425 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 36/78] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:47:00 2022] GET /identity/v3/users/69c8f3089c874dc3bc848ee6f85bc4e4 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:00.547688 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36a941-1175-4362-af01-533bf581208a None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:00.547829 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36a941-1175-4362-af01-533bf581208a None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:00.548134 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36a941-1175-4362-af01-533bf581208a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:00.563793 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-1d36a941-1175-4362-af01-533bf581208a None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:00.565018 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-1d36a941-1175-4362-af01-533bf581208a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:00.574662 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 43/79] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:47:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:47:00.575506 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f0105-9bf7-40fc-bf76-364294067ee8 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:00.631153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 37/80] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:00.632059 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36a941-1175-4362-af01-533bf581208a None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:00.683662 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:00.684629 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f0105-9bf7-40fc-bf76-364294067ee8 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:00.720192 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8bf2b-e4ed-489f-83ae-26339cf8a036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:00.720929 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8bf2b-e4ed-489f-83ae-26339cf8a036 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:00.721221 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8bf2b-e4ed-489f-83ae-26339cf8a036 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:00.721506 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8bf2b-e4ed-489f-83ae-26339cf8a036 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:00.731451 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8bf2b-e4ed-489f-83ae-26339cf8a036 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:00.734091 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36a941-1175-4362-af01-533bf581208a None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:00.739144 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-feb8bf2b-e4ed-489f-83ae-26339cf8a036 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:47:00.739144 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:00.739144 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:00.739144 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:00.739144 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:00.739144 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:00.739144 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:00.739144 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:00.739144 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:00.739144 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:00.739144 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:00.739144 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:00.739144 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:00.739144 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:00.739144 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:00.739144 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:00.740053 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:00.740053 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:00.740053 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:00.740053 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:00.740053 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:00.740053 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:00.740053 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:00.740053 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:00.740053 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:00.740053 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:00.740053 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:00.740053 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:00.740053 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:00.740053 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:00.740053 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:00.740053 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:00.741099 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:00.741099 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:00.741099 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:00.741099 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:00.741099 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:00.741099 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:00.741099 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:00.741099 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:00.741099 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:00.741099 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:00.741099 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:47:00.741099 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:47:00.741099 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 44/81] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:47:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:00.742298 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8bf2b-e4ed-489f-83ae-26339cf8a036 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:00.769650 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf6972-c8ba-46cc-9c0e-e86faf58e970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:00.770530 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf6972-c8ba-46cc-9c0e-e86faf58e970 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:00.770817 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf6972-c8ba-46cc-9c0e-e86faf58e970 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:00.771099 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf6972-c8ba-46cc-9c0e-e86faf58e970 None admin] PATH_INFO: `/v3/users/20a887b4089a485d92fa68e64ce9538a` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:00.771384 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:00.772356 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf6972-c8ba-46cc-9c0e-e86faf58e970 None admin] RBAC: Authorizing `identity:get_user(user_id=20a887b4089a485d92fa68e64ce9538a)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:00.773784 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf6972-c8ba-46cc-9c0e-e86faf58e970 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:00.775406 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 38/82] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:47:00 2022] GET /identity/v3/users/20a887b4089a485d92fa68e64ce9538a => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:00.776247 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf6972-c8ba-46cc-9c0e-e86faf58e970 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:00.843416 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8bf2b-e4ed-489f-83ae-26339cf8a036 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:00.873734 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf6972-c8ba-46cc-9c0e-e86faf58e970 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:00.877064 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8d247-b318-4d4b-89df-dc21179713c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:00.877724 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8d247-b318-4d4b-89df-dc21179713c2 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:00.878012 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8d247-b318-4d4b-89df-dc21179713c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:00.878293 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8d247-b318-4d4b-89df-dc21179713c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:00.891115 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:00.908238 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62630161-734c-4b72-b976-77a4acb1550e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:00.909100 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62630161-734c-4b72-b976-77a4acb1550e None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:00.909408 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62630161-734c-4b72-b976-77a4acb1550e None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:00.909685 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62630161-734c-4b72-b976-77a4acb1550e None admin] PATH_INFO: `/v3/projects/73bb6e1fa903475382715a00881f5cce` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:00.910979 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62630161-734c-4b72-b976-77a4acb1550e None admin] RBAC: Authorizing `identity:get_project(project_id=73bb6e1fa903475382715a00881f5cce)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:00.912466 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62630161-734c-4b72-b976-77a4acb1550e None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:00.914165 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 39/83] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:47:00 2022] GET /identity/v3/projects/73bb6e1fa903475382715a00881f5cce => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:00.914924 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62630161-734c-4b72-b976-77a4acb1550e None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:00.947453 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8d247-b318-4d4b-89df-dc21179713c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:00.949712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8d247-b318-4d4b-89df-dc21179713c2 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:00.978247 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:01.013688 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62630161-734c-4b72-b976-77a4acb1550e None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:01.047706 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932bb45-4d80-4b2a-a441-964e6fa3022f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:01.048529 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932bb45-4d80-4b2a-a441-964e6fa3022f None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:01.048718 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 45/84] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:47:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:47:01.048808 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932bb45-4d80-4b2a-a441-964e6fa3022f None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:01.049092 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932bb45-4d80-4b2a-a441-964e6fa3022f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:01.049553 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8d247-b318-4d4b-89df-dc21179713c2 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:01.054316 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0932bb45-4d80-4b2a-a441-964e6fa3022f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:01.055777 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0932bb45-4d80-4b2a-a441-964e6fa3022f None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:01.057677 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 40/85] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:47:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:01.058445 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932bb45-4d80-4b2a-a441-964e6fa3022f None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:01.112649 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:01.147789 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8d247-b318-4d4b-89df-dc21179713c2 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:01.157380 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932bb45-4d80-4b2a-a441-964e6fa3022f None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:01.176163 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:01.181420 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d80d1-8b93-4689-bf84-7ac9e5962c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:01.182452 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d80d1-8b93-4689-bf84-7ac9e5962c3e None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:01.182738 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d80d1-8b93-4689-bf84-7ac9e5962c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:01.183019 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d80d1-8b93-4689-bf84-7ac9e5962c3e None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:01.183772 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d80d1-8b93-4689-bf84-7ac9e5962c3e None admin] RBAC: Adding query filter params (name=member) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:01.184207 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d80d1-8b93-4689-bf84-7ac9e5962c3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:01.185585 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d80d1-8b93-4689-bf84-7ac9e5962c3e None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:01.190950 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda5f38-6ab8-4a4c-a257-4f46e121d7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:01.191592 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda5f38-6ab8-4a4c-a257-4f46e121d7ea None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:01.191880 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda5f38-6ab8-4a4c-a257-4f46e121d7ea None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:01.192200 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda5f38-6ab8-4a4c-a257-4f46e121d7ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:01.194510 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 46/86] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 11 20:47:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:01.195302 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d80d1-8b93-4689-bf84-7ac9e5962c3e None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:01.262817 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda5f38-6ab8-4a4c-a257-4f46e121d7ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:01.264246 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda5f38-6ab8-4a4c-a257-4f46e121d7ea None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:01.293575 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d80d1-8b93-4689-bf84-7ac9e5962c3e None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:01.317003 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:01.327174 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb73fa8-2078-4db2-9bf0-3018536554b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:01.327791 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb73fa8-2078-4db2-9bf0-3018536554b8 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:01.328122 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb73fa8-2078-4db2-9bf0-3018536554b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:01.328408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb73fa8-2078-4db2-9bf0-3018536554b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:01.329241 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb73fa8-2078-4db2-9bf0-3018536554b8 None admin] RBAC: Adding query filter params (role.id=cf0f875ea1ba45758bd4f52a845d807e, scope.project.id=73bb6e1fa903475382715a00881f5cce, user.id=20a887b4089a485d92fa68e64ce9538a) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:01.329563 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb73fa8-2078-4db2-9bf0-3018536554b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:01.331101 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb73fa8-2078-4db2-9bf0-3018536554b8 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:01.337855 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 47/87] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:47:01 2022] GET /identity/v3/role_assignments?user.id=20a887b4089a485d92fa68e64ce9538a&scope.project.id=73bb6e1fa903475382715a00881f5cce&role.id=cf0f875ea1ba45758bd4f52a845d807e => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:01.338689 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb73fa8-2078-4db2-9bf0-3018536554b8 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:01.380764 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 41/88] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:47:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:47:01.380764 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda5f38-6ab8-4a4c-a257-4f46e121d7ea None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:01.410285 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:01.469671 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb73fa8-2078-4db2-9bf0-3018536554b8 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:01.492954 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda5f38-6ab8-4a4c-a257-4f46e121d7ea None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:01.509656 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf145841-ace1-47a4-80ec-12177f5abbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:01.511126 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf145841-ace1-47a4-80ec-12177f5abbbe None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:01.511517 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf145841-ace1-47a4-80ec-12177f5abbbe None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:01.511807 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf145841-ace1-47a4-80ec-12177f5abbbe None admin] PATH_INFO: `/v3/projects/73bb6e1fa903475382715a00881f5cce` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:01.513140 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf145841-ace1-47a4-80ec-12177f5abbbe None admin] RBAC: Authorizing `identity:get_project(project_id=73bb6e1fa903475382715a00881f5cce)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:01.514561 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf145841-ace1-47a4-80ec-12177f5abbbe None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:01.516480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 48/89] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:47:01 2022] GET /identity/v3/projects/73bb6e1fa903475382715a00881f5cce => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:01.517072 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf145841-ace1-47a4-80ec-12177f5abbbe None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:01.534435 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765d756-0e01-4a44-bdeb-893f16cef690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:01.535372 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765d756-0e01-4a44-bdeb-893f16cef690 None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:01.535823 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765d756-0e01-4a44-bdeb-893f16cef690 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:01.536290 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765d756-0e01-4a44-bdeb-893f16cef690 None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:01.537174 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765d756-0e01-4a44-bdeb-893f16cef690 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:01.538619 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765d756-0e01-4a44-bdeb-893f16cef690 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:01.632012 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 42/90] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jul 11 20:47:01 2022] POST /identity/v3/users => generated 289 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:47:01.632220 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf145841-ace1-47a4-80ec-12177f5abbbe None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:01.632337 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765d756-0e01-4a44-bdeb-893f16cef690 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:01.646983 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:01.668565 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:01.684086 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5adc4b-56d4-42b3-82a1-db9dcae79b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:01.685159 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5adc4b-56d4-42b3-82a1-db9dcae79b87 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:01.685501 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5adc4b-56d4-42b3-82a1-db9dcae79b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:01.685849 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5adc4b-56d4-42b3-82a1-db9dcae79b87 None admin] PATH_INFO: `/v3/users/20a887b4089a485d92fa68e64ce9538a` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:01.687298 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5adc4b-56d4-42b3-82a1-db9dcae79b87 None admin] RBAC: Authorizing `identity:get_user(user_id=20a887b4089a485d92fa68e64ce9538a)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:01.689597 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5adc4b-56d4-42b3-82a1-db9dcae79b87 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:01.696523 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 49/91] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:47:01 2022] GET /identity/v3/users/20a887b4089a485d92fa68e64ce9538a => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:01.696523 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5adc4b-56d4-42b3-82a1-db9dcae79b87 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:01.773829 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765d756-0e01-4a44-bdeb-893f16cef690 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:01.819031 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8bb2fa-a9bc-48b5-98c3-3537c4be7ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:01.820757 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bb2fa-a9bc-48b5-98c3-3537c4be7ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:01.820757 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bb2fa-a9bc-48b5-98c3-3537c4be7ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:01.820757 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bb2fa-a9bc-48b5-98c3-3537c4be7ef8 None admin] PATH_INFO: `/v3/projects/73bb6e1fa903475382715a00881f5cce` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:01.822046 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8bb2fa-a9bc-48b5-98c3-3537c4be7ef8 None admin] RBAC: Authorizing `identity:get_project(project_id=73bb6e1fa903475382715a00881f5cce)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:01.823786 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8bb2fa-a9bc-48b5-98c3-3537c4be7ef8 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:01.826704 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 43/92] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:47:01 2022] GET /identity/v3/projects/73bb6e1fa903475382715a00881f5cce => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:01.827251 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5adc4b-56d4-42b3-82a1-db9dcae79b87 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:01.827501 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8bb2fa-a9bc-48b5-98c3-3537c4be7ef8 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:01.864858 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe801906-f5ad-49ee-8e43-0507d58f7290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:01.865200 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe801906-f5ad-49ee-8e43-0507d58f7290 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:01.865496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe801906-f5ad-49ee-8e43-0507d58f7290 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:01.865781 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe801906-f5ad-49ee-8e43-0507d58f7290 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:01.866624 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe801906-f5ad-49ee-8e43-0507d58f7290 None admin] RBAC: Adding query filter params (role.id=86273ff072f3438d822e870272491768, scope.project.id=73bb6e1fa903475382715a00881f5cce, user.id=69c8f3089c874dc3bc848ee6f85bc4e4) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:01.866946 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe801906-f5ad-49ee-8e43-0507d58f7290 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:01.868462 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe801906-f5ad-49ee-8e43-0507d58f7290 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:01.879254 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 50/93] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:47:01 2022] GET /identity/v3/role_assignments?user.id=69c8f3089c874dc3bc848ee6f85bc4e4&scope.project.id=73bb6e1fa903475382715a00881f5cce&role.id=86273ff072f3438d822e870272491768 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:01.880464 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe801906-f5ad-49ee-8e43-0507d58f7290 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:01.936602 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:01.971305 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:01.980093 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8bb2fa-a9bc-48b5-98c3-3537c4be7ef8 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:02.028718 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198dd1f-1ae7-4f82-8db6-8e3092cc7b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:02.029723 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe801906-f5ad-49ee-8e43-0507d58f7290 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:02.029837 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198dd1f-1ae7-4f82-8db6-8e3092cc7b28 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:02.030310 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198dd1f-1ae7-4f82-8db6-8e3092cc7b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:02.030772 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198dd1f-1ae7-4f82-8db6-8e3092cc7b28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:02.069676 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7cb24d-57fe-4739-9e9c-4e88345d569d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:02.070522 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7cb24d-57fe-4739-9e9c-4e88345d569d None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:02.070812 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7cb24d-57fe-4739-9e9c-4e88345d569d None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:02.071162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7cb24d-57fe-4739-9e9c-4e88345d569d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:02.072148 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7cb24d-57fe-4739-9e9c-4e88345d569d None admin] RBAC: Adding query filter params (role.id=c2117c810f7b4e6aaf684c3d37b0ea3e, scope.project.id=73bb6e1fa903475382715a00881f5cce, user.id=20a887b4089a485d92fa68e64ce9538a) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:02.073053 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7cb24d-57fe-4739-9e9c-4e88345d569d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:02.074607 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7cb24d-57fe-4739-9e9c-4e88345d569d None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:02.081941 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 51/94] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:47:01 2022] GET /identity/v3/role_assignments?user.id=20a887b4089a485d92fa68e64ce9538a&scope.project.id=73bb6e1fa903475382715a00881f5cce&role.id=c2117c810f7b4e6aaf684c3d37b0ea3e => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:02.123699 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198dd1f-1ae7-4f82-8db6-8e3092cc7b28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:02.125506 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198dd1f-1ae7-4f82-8db6-8e3092cc7b28 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:02.221197 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:02.246628 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 44/95] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:47:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:47:02.252694 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7cb24d-57fe-4739-9e9c-4e88345d569d None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:02.428471 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7cb24d-57fe-4739-9e9c-4e88345d569d None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:02.450654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:02.465349 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b62f5-2f17-442e-97df-7a2199716e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:02.466224 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b62f5-2f17-442e-97df-7a2199716e0d None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:02.466802 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b62f5-2f17-442e-97df-7a2199716e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:02.466897 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b62f5-2f17-442e-97df-7a2199716e0d None admin] PATH_INFO: `/v3/projects/6a75fe80381f4697831fbbff914c3bac` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:02.468080 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b62f5-2f17-442e-97df-7a2199716e0d None admin] RBAC: Authorizing `identity:get_project(project_id=6a75fe80381f4697831fbbff914c3bac)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:02.469578 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b62f5-2f17-442e-97df-7a2199716e0d None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:02.471720 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 52/96] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:47:02 2022] GET /identity/v3/projects/6a75fe80381f4697831fbbff914c3bac => generated 312 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:02.477277 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198dd1f-1ae7-4f82-8db6-8e3092cc7b28 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:02.642206 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198dd1f-1ae7-4f82-8db6-8e3092cc7b28 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:02.698652 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93361734-f74d-4aa0-8802-8a5b9cf885f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:02.699341 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93361734-f74d-4aa0-8802-8a5b9cf885f3 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:02.699634 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93361734-f74d-4aa0-8802-8a5b9cf885f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:02.699918 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93361734-f74d-4aa0-8802-8a5b9cf885f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:02.700798 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93361734-f74d-4aa0-8802-8a5b9cf885f3 None admin] RBAC: Adding query filter params (role.id=cf0f875ea1ba45758bd4f52a845d807e, scope.project.id=6a75fe80381f4697831fbbff914c3bac, user.id=20a887b4089a485d92fa68e64ce9538a) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:02.701122 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93361734-f74d-4aa0-8802-8a5b9cf885f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:02.702565 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93361734-f74d-4aa0-8802-8a5b9cf885f3 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:02.712059 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 45/97] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:47:02 2022] GET /identity/v3/role_assignments?user.id=20a887b4089a485d92fa68e64ce9538a&scope.project.id=6a75fe80381f4697831fbbff914c3bac&role.id=cf0f875ea1ba45758bd4f52a845d807e => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:03.577290 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6521f2-69da-4af8-ab8b-2f9e7d47e5c6 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:03.577795 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6521f2-69da-4af8-ab8b-2f9e7d47e5c6 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:03.577866 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6521f2-69da-4af8-ab8b-2f9e7d47e5c6 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:03.579238 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 53/98] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:03.584636 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a143b6-54e9-410c-ae6c-a76283f98d6c None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:03.585040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a143b6-54e9-410c-ae6c-a76283f98d6c None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:03.585207 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a143b6-54e9-410c-ae6c-a76283f98d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:03.608784 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-83a143b6-54e9-410c-ae6c-a76283f98d6c None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:03.609985 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-83a143b6-54e9-410c-ae6c-a76283f98d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:03.662840 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:03.709349 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 46/99] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:03.744105 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6521f2-69da-4af8-ab8b-2f9e7d47e5c6 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:03.888325 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6521f2-69da-4af8-ab8b-2f9e7d47e5c6 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:03.938722 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94661a0-af1e-4f31-9bda-e53b7aca16c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:03.939537 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94661a0-af1e-4f31-9bda-e53b7aca16c3 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:03.939827 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94661a0-af1e-4f31-9bda-e53b7aca16c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:03.940138 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94661a0-af1e-4f31-9bda-e53b7aca16c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:03.956853 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94661a0-af1e-4f31-9bda-e53b7aca16c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:03.965629 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-e94661a0-af1e-4f31-9bda-e53b7aca16c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:47:03.965629 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:03.965629 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:03.965629 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:03.965629 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:03.965629 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:03.965629 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:03.965629 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:03.965629 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:03.965629 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:03.965629 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:03.965629 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:03.965629 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:03.965629 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:03.965629 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:03.965629 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:03.966480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:03.966480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:03.966480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:03.966480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:03.966480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:03.966480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:03.966480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:03.966480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:03.966480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:03.966480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:03.966480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:03.966480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:03.966480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:03.966480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:03.966480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:03.966480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:03.967238 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:03.967238 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:03.967238 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:03.967238 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:03.967238 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:03.967238 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:03.967238 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:03.967238 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:03.967238 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:03.967238 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:03.967238 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:47:03.967238 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:47:03.969632 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 54/100] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:47:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:03.975491 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a143b6-54e9-410c-ae6c-a76283f98d6c None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:04.128498 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a143b6-54e9-410c-ae6c-a76283f98d6c None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:04.179065 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456eda0-06d6-4911-a9e6-600a78e5e50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:04.179679 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456eda0-06d6-4911-a9e6-600a78e5e50d None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:04.179988 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456eda0-06d6-4911-a9e6-600a78e5e50d None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:04.180300 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456eda0-06d6-4911-a9e6-600a78e5e50d None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:04.181058 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456eda0-06d6-4911-a9e6-600a78e5e50d None admin] RBAC: Adding query filter params (name=member) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:04.181381 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456eda0-06d6-4911-a9e6-600a78e5e50d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:04.182951 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456eda0-06d6-4911-a9e6-600a78e5e50d None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:04.191414 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 47/101] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 11 20:47:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:04.197049 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94661a0-af1e-4f31-9bda-e53b7aca16c3 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:04.283605 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:04.355341 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94661a0-af1e-4f31-9bda-e53b7aca16c3 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:04.398925 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa59b88-6894-44cf-a91b-4653e5451529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:04.400179 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa59b88-6894-44cf-a91b-4653e5451529 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:04.400758 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa59b88-6894-44cf-a91b-4653e5451529 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:04.401431 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa59b88-6894-44cf-a91b-4653e5451529 None admin] PATH_INFO: `/v3/users/20a887b4089a485d92fa68e64ce9538a` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:04.408723 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa59b88-6894-44cf-a91b-4653e5451529 None admin] RBAC: Authorizing `identity:get_user(user_id=20a887b4089a485d92fa68e64ce9538a)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:04.410455 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa59b88-6894-44cf-a91b-4653e5451529 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:04.412676 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 55/102] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:47:04 2022] GET /identity/v3/users/20a887b4089a485d92fa68e64ce9538a => generated 275 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:04.418827 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456eda0-06d6-4911-a9e6-600a78e5e50d None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:04.464121 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:04.542936 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456eda0-06d6-4911-a9e6-600a78e5e50d None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:04.582013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87999aab-414c-4feb-9543-1bf26bb8c286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:04.582895 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87999aab-414c-4feb-9543-1bf26bb8c286 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:04.583185 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87999aab-414c-4feb-9543-1bf26bb8c286 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:04.583467 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87999aab-414c-4feb-9543-1bf26bb8c286 None admin] PATH_INFO: `/v3/projects/73bb6e1fa903475382715a00881f5cce` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:04.584687 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87999aab-414c-4feb-9543-1bf26bb8c286 None admin] RBAC: Authorizing `identity:get_project(project_id=73bb6e1fa903475382715a00881f5cce)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:04.586138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87999aab-414c-4feb-9543-1bf26bb8c286 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:04.587897 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 48/103] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:47:04 2022] GET /identity/v3/projects/73bb6e1fa903475382715a00881f5cce => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:04.594588 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa59b88-6894-44cf-a91b-4653e5451529 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:04.703458 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa59b88-6894-44cf-a91b-4653e5451529 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:04.721013 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:04.739661 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c2a97-b1b8-48de-bbc7-b052ba2560cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:04.740603 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c2a97-b1b8-48de-bbc7-b052ba2560cf None admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:04.740897 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c2a97-b1b8-48de-bbc7-b052ba2560cf None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:04.741179 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c2a97-b1b8-48de-bbc7-b052ba2560cf None admin] PATH_INFO: `/v3/projects/73bb6e1fa903475382715a00881f5cce/users/20a887b4089a485d92fa68e64ce9538a/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:04.743281 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632c2a97-b1b8-48de-bbc7-b052ba2560cf None admin] RBAC: Authorizing `identity:create_grant(project_id=73bb6e1fa903475382715a00881f5cce, user_id=20a887b4089a485d92fa68e64ce9538a, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:04.745343 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632c2a97-b1b8-48de-bbc7-b052ba2560cf None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:04.820821 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 56/104] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 11 20:47:04 2022] PUT /identity/v3/projects/73bb6e1fa903475382715a00881f5cce/users/20a887b4089a485d92fa68e64ce9538a/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:47:04.927188 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a179db-9141-4994-b3d8-ae3bf89df3d1 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:04.927827 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a179db-9141-4994-b3d8-ae3bf89df3d1 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:04.928366 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a179db-9141-4994-b3d8-ae3bf89df3d1 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:04.929940 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 49/105] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:04.935499 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c15479-8da9-45c8-876f-e6c2142102b1 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:04.936098 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c15479-8da9-45c8-876f-e6c2142102b1 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:04.936578 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c15479-8da9-45c8-876f-e6c2142102b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:04.965409 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-f7c15479-8da9-45c8-876f-e6c2142102b1 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:04.967575 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-f7c15479-8da9-45c8-876f-e6c2142102b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:05.053718 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 57/106] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:47:05.093519 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a179db-9141-4994-b3d8-ae3bf89df3d1 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:05.210733 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a179db-9141-4994-b3d8-ae3bf89df3d1 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:05.212691 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:05.226169 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e12a30-4d7e-4a2a-a732-4685a67716f2 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:05.226464 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e12a30-4d7e-4a2a-a732-4685a67716f2 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:05.226743 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e12a30-4d7e-4a2a-a732-4685a67716f2 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:05.228145 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 58/107] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:05.234209 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f49f3e-8791-47b0-bf9a-f964270e825e None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:05.234769 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f49f3e-8791-47b0-bf9a-f964270e825e None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:05.235246 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f49f3e-8791-47b0-bf9a-f964270e825e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:05.254872 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56a7fd-8eb8-47cb-8ab8-47d5e8144668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:05.254872 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56a7fd-8eb8-47cb-8ab8-47d5e8144668 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:05.255120 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56a7fd-8eb8-47cb-8ab8-47d5e8144668 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:05.255343 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56a7fd-8eb8-47cb-8ab8-47d5e8144668 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:05.256499 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-a5f49f3e-8791-47b0-bf9a-f964270e825e None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:05.258065 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a5f49f3e-8791-47b0-bf9a-f964270e825e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:05.267229 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56a7fd-8eb8-47cb-8ab8-47d5e8144668 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:05.275652 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-cd56a7fd-8eb8-47cb-8ab8-47d5e8144668 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:47:05.275652 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:05.275652 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:05.275652 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:05.275652 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:05.275652 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:05.275652 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:05.275652 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:05.275652 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:05.275652 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:05.275652 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:05.275652 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:05.275652 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:05.275652 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:05.275652 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:05.275652 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:05.276768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:05.276768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:05.276768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:05.276768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:05.276768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:05.276768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:05.276768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:05.276768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:05.276768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:05.276768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:05.276768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:05.276768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:05.276768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:05.276768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:05.276768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:05.276768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:05.277515 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:05.277515 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:05.277515 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:05.277515 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:05.277515 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:05.277515 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:05.277515 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:05.277515 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:05.277515 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:05.277515 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:05.277515 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:47:05.277515 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:47:05.277515 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 50/108] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 11 20:47:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:05.283173 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56a7fd-8eb8-47cb-8ab8-47d5e8144668 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:05.335515 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 59/109] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:47:05.341679 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb5c73-036d-4244-9fbb-b89c0b4db185 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:05.342200 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb5c73-036d-4244-9fbb-b89c0b4db185 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:05.342699 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb5c73-036d-4244-9fbb-b89c0b4db185 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:05.344517 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 60/110] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:05.349448 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de6ad8-55d0-4f37-980b-7a85d84c3dfd None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:05.349996 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de6ad8-55d0-4f37-980b-7a85d84c3dfd None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:05.350473 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de6ad8-55d0-4f37-980b-7a85d84c3dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:05.377387 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-89de6ad8-55d0-4f37-980b-7a85d84c3dfd None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:05.378915 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-89de6ad8-55d0-4f37-980b-7a85d84c3dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:05.391452 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56a7fd-8eb8-47cb-8ab8-47d5e8144668 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:05.426569 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441e87f-c892-41a4-b635-af7bd0fe3213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:05.427267 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441e87f-c892-41a4-b635-af7bd0fe3213 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:05.427397 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:05.427560 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441e87f-c892-41a4-b635-af7bd0fe3213 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:05.427851 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441e87f-c892-41a4-b635-af7bd0fe3213 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:05.428846 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441e87f-c892-41a4-b635-af7bd0fe3213 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:05.428949 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441e87f-c892-41a4-b635-af7bd0fe3213 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:05.430341 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441e87f-c892-41a4-b635-af7bd0fe3213 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:05.440338 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 51/111] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:47:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:47:05.441111 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441e87f-c892-41a4-b635-af7bd0fe3213 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:05.470027 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 61/112] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:05.477608 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e13de-640b-4646-9eea-9b9a86a7d617 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:05.478102 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e13de-640b-4646-9eea-9b9a86a7d617 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:05.478552 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e13de-640b-4646-9eea-9b9a86a7d617 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:05.480111 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 62/113] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:05.480958 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e13de-640b-4646-9eea-9b9a86a7d617 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:05.512362 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:05.556240 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441e87f-c892-41a4-b635-af7bd0fe3213 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:05.593307 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f24824-40ef-429b-9a71-2e70e3330760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:05.594053 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f24824-40ef-429b-9a71-2e70e3330760 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:05.594351 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f24824-40ef-429b-9a71-2e70e3330760 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:05.594637 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f24824-40ef-429b-9a71-2e70e3330760 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:05.595839 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f24824-40ef-429b-9a71-2e70e3330760 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:05.597345 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f24824-40ef-429b-9a71-2e70e3330760 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:05.599297 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 52/114] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:47:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:05.600581 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9663f-3d85-4949-878a-f9e9301f97d9 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:05.600879 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9663f-3d85-4949-878a-f9e9301f97d9 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:05.601170 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9663f-3d85-4949-878a-f9e9301f97d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:05.611661 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e13de-640b-4646-9eea-9b9a86a7d617 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:05.618879 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-dfb9663f-3d85-4949-878a-f9e9301f97d9 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:05.621056 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-dfb9663f-3d85-4949-878a-f9e9301f97d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:05.648387 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea7ecb-0f2e-4ba1-a7d8-076de94c4187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:05.649726 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea7ecb-0f2e-4ba1-a7d8-076de94c4187 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:05.650230 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea7ecb-0f2e-4ba1-a7d8-076de94c4187 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:05.656460 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea7ecb-0f2e-4ba1-a7d8-076de94c4187 None admin] PATH_INFO: `/v3/users/69c8f3089c874dc3bc848ee6f85bc4e4` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:05.658101 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea7ecb-0f2e-4ba1-a7d8-076de94c4187 None admin] RBAC: Authorizing `identity:get_user(user_id=69c8f3089c874dc3bc848ee6f85bc4e4)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:05.664889 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea7ecb-0f2e-4ba1-a7d8-076de94c4187 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:05.667056 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 63/115] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:47:05 2022] GET /identity/v3/users/69c8f3089c874dc3bc848ee6f85bc4e4 => generated 247 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:05.668135 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea7ecb-0f2e-4ba1-a7d8-076de94c4187 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:05.703990 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 53/116] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:05.703990 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9663f-3d85-4949-878a-f9e9301f97d9 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:05.724602 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:05.724779 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:05.805968 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9663f-3d85-4949-878a-f9e9301f97d9 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:05.806725 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea7ecb-0f2e-4ba1-a7d8-076de94c4187 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:05.842957 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156a560-f4c6-40e9-8cc4-840b8d084e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:05.844264 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f82e44-8281-4990-833e-42024d1266bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:05.844887 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f82e44-8281-4990-833e-42024d1266bb None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:05.845179 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f82e44-8281-4990-833e-42024d1266bb None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:05.845464 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f82e44-8281-4990-833e-42024d1266bb None admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:05.845671 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156a560-f4c6-40e9-8cc4-840b8d084e93 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:05.846136 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156a560-f4c6-40e9-8cc4-840b8d084e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:05.846237 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f82e44-8281-4990-833e-42024d1266bb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:05.846703 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156a560-f4c6-40e9-8cc4-840b8d084e93 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:05.847793 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f82e44-8281-4990-833e-42024d1266bb None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:05.858164 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b156a560-f4c6-40e9-8cc4-840b8d084e93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:05.866831 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-b156a560-f4c6-40e9-8cc4-840b8d084e93 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:47:05.866831 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:05.866831 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:05.866831 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:05.866831 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:05.866831 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:05.866831 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:05.866831 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:05.866831 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:05.866831 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:05.866831 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:05.866831 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:05.866831 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:05.866831 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:05.866831 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:05.866831 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:05.867758 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:05.867758 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:05.867758 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:05.867758 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:05.867758 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:05.867758 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:05.867758 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:05.867758 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:05.867758 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:05.867758 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:05.867758 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:05.867758 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:05.867758 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:05.867758 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:05.867758 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:05.867758 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:05.868562 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:05.868562 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:05.868562 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:05.868562 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:05.868562 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:05.868562 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:05.868562 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:05.868562 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:05.868562 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:05.868562 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:05.868562 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:47:05.868562 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:47:05.872122 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 64/117] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jul 11 20:47:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:05.873438 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156a560-f4c6-40e9-8cc4-840b8d084e93 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:05.936727 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 54/118] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Jul 11 20:47:05 2022] POST /identity/v3/projects => generated 302 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:47:05.937548 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f82e44-8281-4990-833e-42024d1266bb None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:05.991387 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:06.002854 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156a560-f4c6-40e9-8cc4-840b8d084e93 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:06.024670 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:06.047721 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3ed5b-d965-4104-8953-db3549af1c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:06.048439 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3ed5b-d965-4104-8953-db3549af1c07 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:06.048835 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3ed5b-d965-4104-8953-db3549af1c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:06.049258 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3ed5b-d965-4104-8953-db3549af1c07 None admin] PATH_INFO: `/v3/projects/73bb6e1fa903475382715a00881f5cce` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:06.050741 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3ed5b-d965-4104-8953-db3549af1c07 None admin] RBAC: Authorizing `identity:get_project(project_id=73bb6e1fa903475382715a00881f5cce)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:06.052472 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3ed5b-d965-4104-8953-db3549af1c07 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:06.056097 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 65/119] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:47:05 2022] GET /identity/v3/projects/73bb6e1fa903475382715a00881f5cce => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:06.056097 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3ed5b-d965-4104-8953-db3549af1c07 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:06.072447 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f82e44-8281-4990-833e-42024d1266bb None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:06.133328 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d9b34-e16f-4347-9762-6df9cbc5603e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:06.134614 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d9b34-e16f-4347-9762-6df9cbc5603e None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:06.135174 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d9b34-e16f-4347-9762-6df9cbc5603e None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:06.135657 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d9b34-e16f-4347-9762-6df9cbc5603e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:06.148097 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5d9b34-e16f-4347-9762-6df9cbc5603e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:06.156611 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-fc5d9b34-e16f-4347-9762-6df9cbc5603e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 20:47:06.156611 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:06.156611 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:06.156611 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:06.156611 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:06.156611 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:06.156611 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:06.156611 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:06.156611 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:06.156611 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:06.156611 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:06.156611 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:06.156611 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:06.156611 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:06.156611 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:06.156611 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:06.157547 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:06.157547 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:06.157547 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:06.157547 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:06.157547 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:06.157547 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:06.157547 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:06.157547 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:06.157547 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:06.157547 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:06.157547 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:06.157547 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:06.157547 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:06.157547 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:06.157547 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:06.157547 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:06.158329 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:06.158329 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:06.158329 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:06.158329 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:06.158329 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:06.158329 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:06.158329 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:06.158329 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:06.158329 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:06.158329 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:06.158329 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 20:47:06.158329 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:47:06.158329 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 55/120] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:47:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:06.158954 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d9b34-e16f-4347-9762-6df9cbc5603e None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:06.201704 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3ed5b-d965-4104-8953-db3549af1c07 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:06.249826 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9bc6e-531a-45f5-816c-cdc9f2ad05d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:06.250992 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9bc6e-531a-45f5-816c-cdc9f2ad05d1 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:06.251283 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9bc6e-531a-45f5-816c-cdc9f2ad05d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:06.251562 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9bc6e-531a-45f5-816c-cdc9f2ad05d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:06.252722 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c9bc6e-531a-45f5-816c-cdc9f2ad05d1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:06.253043 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c9bc6e-531a-45f5-816c-cdc9f2ad05d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:06.255034 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c9bc6e-531a-45f5-816c-cdc9f2ad05d1 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:06.266833 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 66/121] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:47:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:06.269794 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b5678-dd8c-4e2d-bc0a-bce0d22c441e None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:06.269794 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b5678-dd8c-4e2d-bc0a-bce0d22c441e None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:06.269794 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b5678-dd8c-4e2d-bc0a-bce0d22c441e None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:06.270032 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 67/122] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:06.270654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b5678-dd8c-4e2d-bc0a-bce0d22c441e None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:06.285197 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d9b34-e16f-4347-9762-6df9cbc5603e None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:06.323457 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:06.336905 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a18e8-9981-4119-8552-92527e70912a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:06.338572 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a18e8-9981-4119-8552-92527e70912a None admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:06.339001 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a18e8-9981-4119-8552-92527e70912a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:06.339417 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a18e8-9981-4119-8552-92527e70912a None admin] PATH_INFO: `/v3/projects/73bb6e1fa903475382715a00881f5cce/users/69c8f3089c874dc3bc848ee6f85bc4e4/roles/86273ff072f3438d822e870272491768` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:06.341804 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a18e8-9981-4119-8552-92527e70912a None admin] RBAC: Authorizing `identity:create_grant(project_id=73bb6e1fa903475382715a00881f5cce, user_id=69c8f3089c874dc3bc848ee6f85bc4e4, role_id=86273ff072f3438d822e870272491768)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:06.343432 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a18e8-9981-4119-8552-92527e70912a None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:06.348167 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:06.399996 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 56/123] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 11 20:47:06 2022] PUT /identity/v3/projects/73bb6e1fa903475382715a00881f5cce/users/69c8f3089c874dc3bc848ee6f85bc4e4/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:47:06.404275 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a18e8-9981-4119-8552-92527e70912a None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:06.426588 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b5678-dd8c-4e2d-bc0a-bce0d22c441e None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:06.504792 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42be5b-319d-49f7-9389-37eb08893fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:06.505835 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42be5b-319d-49f7-9389-37eb08893fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:06.506324 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42be5b-319d-49f7-9389-37eb08893fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:06.506793 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42be5b-319d-49f7-9389-37eb08893fc9 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:06.507713 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e42be5b-319d-49f7-9389-37eb08893fc9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:06.508218 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e42be5b-319d-49f7-9389-37eb08893fc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:06.510760 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e42be5b-319d-49f7-9389-37eb08893fc9 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:06.528970 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 68/124] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 11 20:47:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:06.530794 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25004b-46bd-4eab-8302-777469970c9f None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:06.531294 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25004b-46bd-4eab-8302-777469970c9f None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:06.531800 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25004b-46bd-4eab-8302-777469970c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:06.550968 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-8c25004b-46bd-4eab-8302-777469970c9f None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:06.552602 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-8c25004b-46bd-4eab-8302-777469970c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:06.630493 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a18e8-9981-4119-8552-92527e70912a None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:06.651306 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 69/125] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:06.651306 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c25004b-46bd-4eab-8302-777469970c9f None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:06.683331 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada56b7f-d7c8-4a5e-9002-7e3f5ce95d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:06.684222 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:06.684328 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada56b7f-d7c8-4a5e-9002-7e3f5ce95d7d None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:06.684547 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada56b7f-d7c8-4a5e-9002-7e3f5ce95d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:06.684832 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada56b7f-d7c8-4a5e-9002-7e3f5ce95d7d None admin] PATH_INFO: `/v3/users/20a887b4089a485d92fa68e64ce9538a` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:06.686736 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada56b7f-d7c8-4a5e-9002-7e3f5ce95d7d None admin] RBAC: Authorizing `identity:get_user(user_id=20a887b4089a485d92fa68e64ce9538a)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:06.688261 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada56b7f-d7c8-4a5e-9002-7e3f5ce95d7d None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:06.689911 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 57/126] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:47:06 2022] GET /identity/v3/users/20a887b4089a485d92fa68e64ce9538a => generated 275 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:06.690673 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada56b7f-d7c8-4a5e-9002-7e3f5ce95d7d None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:06.773784 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:06.819499 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada56b7f-d7c8-4a5e-9002-7e3f5ce95d7d None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:06.837911 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c25004b-46bd-4eab-8302-777469970c9f None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:06.860733 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851ca14-cc33-4e3c-9675-9d35a9771e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:06.862480 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851ca14-cc33-4e3c-9675-9d35a9771e1c None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:06.862975 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851ca14-cc33-4e3c-9675-9d35a9771e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:06.863461 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851ca14-cc33-4e3c-9675-9d35a9771e1c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:06.875303 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2851ca14-cc33-4e3c-9675-9d35a9771e1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:06.884242 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-2851ca14-cc33-4e3c-9675-9d35a9771e1c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:47:06.884242 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:06.884242 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:06.884242 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:06.884242 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:06.884242 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:06.884242 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:06.884242 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:06.884242 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:06.884242 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:06.884242 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:06.884242 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:06.884242 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:06.884242 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:06.884242 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:06.884242 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:06.885554 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:06.885554 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:06.885554 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:06.885554 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:06.885554 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:06.885554 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:06.885554 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:06.885554 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:06.885554 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:06.885554 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:06.885554 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:06.885554 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:06.885554 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:06.885554 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:06.885554 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:06.885554 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:06.886334 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:06.886334 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:06.886334 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:06.886334 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:06.886334 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:06.886334 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:06.886334 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:06.886334 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:06.886334 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:06.886334 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:06.886334 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:47:06.886334 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:47:06.889779 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 58/127] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:47:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:06.891563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851ca14-cc33-4e3c-9675-9d35a9771e1c None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:06.996719 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c8f55-8d09-4e5a-8a4a-25f3546765c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:06.997632 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c8f55-8d09-4e5a-8a4a-25f3546765c7 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:06.997924 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c8f55-8d09-4e5a-8a4a-25f3546765c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:06.998209 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c8f55-8d09-4e5a-8a4a-25f3546765c7 None admin] PATH_INFO: `/v3/users/7c2932f6d16c46d4bcfce7b578f18462` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:07.007844 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851ca14-cc33-4e3c-9675-9d35a9771e1c None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:07.034032 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:07.047175 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2df8b5-d711-4be3-bb9f-d0e9efb2bbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:07.048352 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2df8b5-d711-4be3-bb9f-d0e9efb2bbfd None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:07.048926 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2df8b5-d711-4be3-bb9f-d0e9efb2bbfd None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:07.049351 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2df8b5-d711-4be3-bb9f-d0e9efb2bbfd None admin] PATH_INFO: `/v3/projects/73bb6e1fa903475382715a00881f5cce` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:07.051465 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2df8b5-d711-4be3-bb9f-d0e9efb2bbfd None admin] RBAC: Authorizing `identity:get_project(project_id=73bb6e1fa903475382715a00881f5cce)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:07.052414 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2df8b5-d711-4be3-bb9f-d0e9efb2bbfd None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:07.052706 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c8f55-8d09-4e5a-8a4a-25f3546765c7 None admin] RBAC: Authorizing `identity:get_user(user_id=7c2932f6d16c46d4bcfce7b578f18462)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:07.054199 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c8f55-8d09-4e5a-8a4a-25f3546765c7 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:07.054599 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 59/128] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:47:06 2022] GET /identity/v3/projects/73bb6e1fa903475382715a00881f5cce => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:07.055713 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2df8b5-d711-4be3-bb9f-d0e9efb2bbfd None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:07.056205 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 70/129] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:47:06 2022] GET /identity/v3/users/7c2932f6d16c46d4bcfce7b578f18462 => generated 289 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:07.061361 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c8f55-8d09-4e5a-8a4a-25f3546765c7 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:07.169233 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2df8b5-d711-4be3-bb9f-d0e9efb2bbfd None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:07.207262 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc94dd9-3fc4-4016-86f5-47e86e6f2791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:07.208242 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc94dd9-3fc4-4016-86f5-47e86e6f2791 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:07.208678 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc94dd9-3fc4-4016-86f5-47e86e6f2791 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:07.209156 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc94dd9-3fc4-4016-86f5-47e86e6f2791 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:07.210359 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc94dd9-3fc4-4016-86f5-47e86e6f2791 None admin] RBAC: Adding query filter params (name=member) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:07.210815 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc94dd9-3fc4-4016-86f5-47e86e6f2791 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:07.212425 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc94dd9-3fc4-4016-86f5-47e86e6f2791 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:07.221986 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 60/130] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 11 20:47:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:07.223043 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc94dd9-3fc4-4016-86f5-47e86e6f2791 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:07.312054 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:07.324364 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:07.335661 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c8f55-8d09-4e5a-8a4a-25f3546765c7 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:07.368263 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc94dd9-3fc4-4016-86f5-47e86e6f2791 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:07.376929 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a066162c-66da-4719-a467-61eced47d8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:07.377842 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a066162c-66da-4719-a467-61eced47d8b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:07.378131 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a066162c-66da-4719-a467-61eced47d8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:07.378464 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a066162c-66da-4719-a467-61eced47d8b7 None admin] PATH_INFO: `/v3/projects/73bb6e1fa903475382715a00881f5cce/users/20a887b4089a485d92fa68e64ce9538a/roles/c2117c810f7b4e6aaf684c3d37b0ea3e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:07.381167 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a066162c-66da-4719-a467-61eced47d8b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=73bb6e1fa903475382715a00881f5cce, user_id=20a887b4089a485d92fa68e64ce9538a, role_id=c2117c810f7b4e6aaf684c3d37b0ea3e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:07.382626 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a066162c-66da-4719-a467-61eced47d8b7 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:07.410001 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5933a-6c39-4b2d-9fc7-86c6b2734032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:07.410763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5933a-6c39-4b2d-9fc7-86c6b2734032 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:07.411155 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5933a-6c39-4b2d-9fc7-86c6b2734032 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:07.411511 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5933a-6c39-4b2d-9fc7-86c6b2734032 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:07.455543 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 71/131] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 11 20:47:07 2022] PUT /identity/v3/projects/73bb6e1fa903475382715a00881f5cce/users/20a887b4089a485d92fa68e64ce9538a/roles/c2117c810f7b4e6aaf684c3d37b0ea3e => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:47:07.456722 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a066162c-66da-4719-a467-61eced47d8b7 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:07.491923 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad5933a-6c39-4b2d-9fc7-86c6b2734032 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:07.493648 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad5933a-6c39-4b2d-9fc7-86c6b2734032 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:07.556999 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:07.602924 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a066162c-66da-4719-a467-61eced47d8b7 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:07.622951 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 61/132] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:47:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:47:07.624964 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205a286-646d-4190-b200-b2c44eec6c30 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:07.625479 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205a286-646d-4190-b200-b2c44eec6c30 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:07.625980 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205a286-646d-4190-b200-b2c44eec6c30 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:07.627487 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 62/133] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:07.628401 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205a286-646d-4190-b200-b2c44eec6c30 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:07.649149 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacfac19-7bbe-4a7c-bb8a-2b7c8434e359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:07.650062 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacfac19-7bbe-4a7c-bb8a-2b7c8434e359 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:07.650353 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacfac19-7bbe-4a7c-bb8a-2b7c8434e359 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:07.651637 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacfac19-7bbe-4a7c-bb8a-2b7c8434e359 None admin] PATH_INFO: `/v3/users/20a887b4089a485d92fa68e64ce9538a` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:07.653051 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacfac19-7bbe-4a7c-bb8a-2b7c8434e359 None admin] RBAC: Authorizing `identity:get_user(user_id=20a887b4089a485d92fa68e64ce9538a)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:07.654565 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacfac19-7bbe-4a7c-bb8a-2b7c8434e359 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:07.656620 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 72/134] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:47:07 2022] GET /identity/v3/users/20a887b4089a485d92fa68e64ce9538a => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:07.657674 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7298e26-05bd-46ba-a567-54068acec4ab None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:07.657971 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7298e26-05bd-46ba-a567-54068acec4ab None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:07.658256 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7298e26-05bd-46ba-a567-54068acec4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:07.669588 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:07.682906 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-b7298e26-05bd-46ba-a567-54068acec4ab None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:07.684396 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-b7298e26-05bd-46ba-a567-54068acec4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:07.762402 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 73/135] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:07.763559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7298e26-05bd-46ba-a567-54068acec4ab None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:07.773630 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205a286-646d-4190-b200-b2c44eec6c30 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:07.820539 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054af100-94a7-4121-b189-c396f584d250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:07.821451 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054af100-94a7-4121-b189-c396f584d250 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:07.821739 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054af100-94a7-4121-b189-c396f584d250 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:07.822023 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054af100-94a7-4121-b189-c396f584d250 None admin] PATH_INFO: `/v3/projects/73bb6e1fa903475382715a00881f5cce` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:07.824241 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054af100-94a7-4121-b189-c396f584d250 None admin] RBAC: Authorizing `identity:get_project(project_id=73bb6e1fa903475382715a00881f5cce)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:07.825622 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054af100-94a7-4121-b189-c396f584d250 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:07.827348 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 63/136] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:47:07 2022] GET /identity/v3/projects/73bb6e1fa903475382715a00881f5cce => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:07.828165 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054af100-94a7-4121-b189-c396f584d250 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:07.851764 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:07.894584 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7298e26-05bd-46ba-a567-54068acec4ab None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:07.927696 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:07.933927 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d77c3-3a7e-459f-a16c-c1a2f6b02902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:07.934642 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d77c3-3a7e-459f-a16c-c1a2f6b02902 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:07.934925 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d77c3-3a7e-459f-a16c-c1a2f6b02902 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:07.935251 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d77c3-3a7e-459f-a16c-c1a2f6b02902 None admin] PATH_INFO: `/v3/projects/6a75fe80381f4697831fbbff914c3bac` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:07.936445 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2d77c3-3a7e-459f-a16c-c1a2f6b02902 None admin] RBAC: Authorizing `identity:get_project(project_id=6a75fe80381f4697831fbbff914c3bac)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:07.938583 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2d77c3-3a7e-459f-a16c-c1a2f6b02902 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:07.939910 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 74/137] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:47:07 2022] GET /identity/v3/projects/6a75fe80381f4697831fbbff914c3bac => generated 312 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:07.940725 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d77c3-3a7e-459f-a16c-c1a2f6b02902 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:07.960849 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054af100-94a7-4121-b189-c396f584d250 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:08.007506 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d7764-2542-42a6-9bab-82099b58c57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:08.008395 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d7764-2542-42a6-9bab-82099b58c57a None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:08.008736 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d7764-2542-42a6-9bab-82099b58c57a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:08.009077 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d7764-2542-42a6-9bab-82099b58c57a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:08.022105 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8d7764-2542-42a6-9bab-82099b58c57a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:08.031337 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-9f8d7764-2542-42a6-9bab-82099b58c57a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:47:08.031337 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:08.031337 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:08.031337 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:08.031337 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:08.031337 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:08.031337 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:08.031337 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:08.031337 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:08.031337 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:08.031337 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:08.031337 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:08.031337 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:08.031337 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:08.031337 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:08.031337 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:08.032255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:08.032255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:08.032255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:08.032255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:08.032255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:08.032255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:08.032255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:08.032255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:08.032255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:08.032255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:08.032255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:08.032255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:08.032255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:08.032255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:08.032255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:08.032255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:08.033017 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:08.033017 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:08.033017 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:08.033017 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:08.033017 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:08.033017 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:08.033017 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:08.033017 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:08.033017 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:08.033017 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:08.033017 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:47:08.033017 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:47:08.033017 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 64/138] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:47:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:08.033635 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d7764-2542-42a6-9bab-82099b58c57a None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:08.136708 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:08.155812 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d77c3-3a7e-459f-a16c-c1a2f6b02902 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:08.182826 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d7764-2542-42a6-9bab-82099b58c57a None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:08.192704 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c09d7d-f99d-4fd5-9cf1-413157b9dfdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:08.193439 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c09d7d-f99d-4fd5-9cf1-413157b9dfdc None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:08.193732 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c09d7d-f99d-4fd5-9cf1-413157b9dfdc None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:08.194020 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c09d7d-f99d-4fd5-9cf1-413157b9dfdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:08.197881 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c09d7d-f99d-4fd5-9cf1-413157b9dfdc None admin] RBAC: Adding query filter params (role.id=3a94b407c6914e15a379d3580c9c9ddf, scope.project.id=73bb6e1fa903475382715a00881f5cce, user.id=7c2932f6d16c46d4bcfce7b578f18462) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:08.197881 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c09d7d-f99d-4fd5-9cf1-413157b9dfdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:08.197881 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c09d7d-f99d-4fd5-9cf1-413157b9dfdc None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:08.204436 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 75/139] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:47:07 2022] GET /identity/v3/role_assignments?user.id=7c2932f6d16c46d4bcfce7b578f18462&scope.project.id=73bb6e1fa903475382715a00881f5cce&role.id=3a94b407c6914e15a379d3580c9c9ddf => generated 259 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:08.205255 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c09d7d-f99d-4fd5-9cf1-413157b9dfdc None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:08.269763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26715c9c-ae97-4495-8983-2990cf4775aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:08.270681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26715c9c-ae97-4495-8983-2990cf4775aa None admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:08.272053 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26715c9c-ae97-4495-8983-2990cf4775aa None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:08.272348 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26715c9c-ae97-4495-8983-2990cf4775aa None admin] PATH_INFO: `/v3/projects/6a75fe80381f4697831fbbff914c3bac/users/20a887b4089a485d92fa68e64ce9538a/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:08.277755 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26715c9c-ae97-4495-8983-2990cf4775aa None admin] RBAC: Authorizing `identity:create_grant(project_id=6a75fe80381f4697831fbbff914c3bac, user_id=20a887b4089a485d92fa68e64ce9538a, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:08.279239 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26715c9c-ae97-4495-8983-2990cf4775aa None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:08.297077 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:08.347352 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c09d7d-f99d-4fd5-9cf1-413157b9dfdc None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:08.387693 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6907906-26c8-439c-a1a3-e3a4b097307b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:08.388816 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6907906-26c8-439c-a1a3-e3a4b097307b None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:08.389342 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6907906-26c8-439c-a1a3-e3a4b097307b None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:08.389851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6907906-26c8-439c-a1a3-e3a4b097307b None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:08.390871 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6907906-26c8-439c-a1a3-e3a4b097307b None admin] RBAC: Adding query filter params (name=member) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:08.391440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6907906-26c8-439c-a1a3-e3a4b097307b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:08.393198 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6907906-26c8-439c-a1a3-e3a4b097307b None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:08.405602 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 76/140] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 11 20:47:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:08.407402 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c79899-da7f-4a53-aa48-c38adbcc281d None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:08.408000 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c79899-da7f-4a53-aa48-c38adbcc281d None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:08.408477 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c79899-da7f-4a53-aa48-c38adbcc281d None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:08.410605 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 77/141] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:08.411587 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c79899-da7f-4a53-aa48-c38adbcc281d None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:08.412354 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 65/142] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 11 20:47:08 2022] PUT /identity/v3/projects/6a75fe80381f4697831fbbff914c3bac/users/20a887b4089a485d92fa68e64ce9538a/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:47:08.419870 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e7226-c199-4ac5-b68d-7ed1ccf58bd3 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:08.420190 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e7226-c199-4ac5-b68d-7ed1ccf58bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:08.420484 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e7226-c199-4ac5-b68d-7ed1ccf58bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:08.464659 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-d68e7226-c199-4ac5-b68d-7ed1ccf58bd3 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:08.467307 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d68e7226-c199-4ac5-b68d-7ed1ccf58bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:08.552320 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 66/143] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:08.580492 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c79899-da7f-4a53-aa48-c38adbcc281d None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:08.622477 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:08.630239 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e7226-c199-4ac5-b68d-7ed1ccf58bd3 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:08.640142 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8218fd5-3f5d-4556-8ac0-59a8b10a88e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:08.640335 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8218fd5-3f5d-4556-8ac0-59a8b10a88e4 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:08.640627 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8218fd5-3f5d-4556-8ac0-59a8b10a88e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:08.640912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8218fd5-3f5d-4556-8ac0-59a8b10a88e4 None admin] PATH_INFO: `/v3/users/20a887b4089a485d92fa68e64ce9538a` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:08.642590 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8218fd5-3f5d-4556-8ac0-59a8b10a88e4 None admin] RBAC: Authorizing `identity:get_user(user_id=20a887b4089a485d92fa68e64ce9538a)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:08.644101 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8218fd5-3f5d-4556-8ac0-59a8b10a88e4 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:08.646160 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 78/144] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:47:08 2022] GET /identity/v3/users/20a887b4089a485d92fa68e64ce9538a => generated 275 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:08.652328 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8218fd5-3f5d-4556-8ac0-59a8b10a88e4 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:08.738469 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:08.771768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e7226-c199-4ac5-b68d-7ed1ccf58bd3 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:08.809074 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38cce2a-be4c-41ed-a769-83902878989f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:08.809942 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38cce2a-be4c-41ed-a769-83902878989f None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:08.810275 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38cce2a-be4c-41ed-a769-83902878989f None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:08.810562 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38cce2a-be4c-41ed-a769-83902878989f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:08.811806 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38cce2a-be4c-41ed-a769-83902878989f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:08.813516 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38cce2a-be4c-41ed-a769-83902878989f None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:08.815415 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 67/145] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:47:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:08.820451 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38cce2a-be4c-41ed-a769-83902878989f None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:08.933838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38cce2a-be4c-41ed-a769-83902878989f None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:08.934285 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8218fd5-3f5d-4556-8ac0-59a8b10a88e4 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:08.976789 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d75c0db-922f-44d4-93cf-d764610199bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:08.977489 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75c0db-922f-44d4-93cf-d764610199bf None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:08.977797 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75c0db-922f-44d4-93cf-d764610199bf None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:08.978090 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75c0db-922f-44d4-93cf-d764610199bf None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:08.979339 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d75c0db-922f-44d4-93cf-d764610199bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:08.981004 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d75c0db-922f-44d4-93cf-d764610199bf None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:08.991123 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:09.012070 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794db55-66e1-4570-aa47-aa1d8fe92fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:09.012813 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794db55-66e1-4570-aa47-aa1d8fe92fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:09.013107 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794db55-66e1-4570-aa47-aa1d8fe92fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:09.013393 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794db55-66e1-4570-aa47-aa1d8fe92fb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:09.079950 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:09.088576 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794db55-66e1-4570-aa47-aa1d8fe92fb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:09.090081 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794db55-66e1-4570-aa47-aa1d8fe92fb0 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:09.117128 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 68/146] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jul 11 20:47:08 2022] POST /identity/v3/users => generated 283 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:47:09.210392 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 79/147] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:47:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 20:47:09.216924 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d75c0db-922f-44d4-93cf-d764610199bf None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:09.364003 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d75c0db-922f-44d4-93cf-d764610199bf None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:09.406875 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ffaefc-dcda-4a90-897d-889ac22d2506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:09.407774 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ffaefc-dcda-4a90-897d-889ac22d2506 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:09.408089 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ffaefc-dcda-4a90-897d-889ac22d2506 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:09.408372 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ffaefc-dcda-4a90-897d-889ac22d2506 None admin] PATH_INFO: `/v3/projects/73bb6e1fa903475382715a00881f5cce` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:09.409598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ffaefc-dcda-4a90-897d-889ac22d2506 None admin] RBAC: Authorizing `identity:get_project(project_id=73bb6e1fa903475382715a00881f5cce)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:09.411061 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ffaefc-dcda-4a90-897d-889ac22d2506 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:09.412799 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 69/148] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:47:09 2022] GET /identity/v3/projects/73bb6e1fa903475382715a00881f5cce => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:09.419702 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794db55-66e1-4570-aa47-aa1d8fe92fb0 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:09.530253 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:09.537062 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794db55-66e1-4570-aa47-aa1d8fe92fb0 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:09.558820 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a5e86-a986-4382-a94f-b190c99388c1 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:09.559142 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a5e86-a986-4382-a94f-b190c99388c1 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:09.559423 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a5e86-a986-4382-a94f-b190c99388c1 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:09.561784 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 70/149] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:47:09.567790 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bc1d4-a576-447f-be38-9621cd822a1d None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:09.568373 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bc1d4-a576-447f-be38-9621cd822a1d None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:09.568848 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bc1d4-a576-447f-be38-9621cd822a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:09.581624 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef2645-4a5b-49a6-9f50-21243319efe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:09.582299 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef2645-4a5b-49a6-9f50-21243319efe9 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:09.582590 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef2645-4a5b-49a6-9f50-21243319efe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:09.582873 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef2645-4a5b-49a6-9f50-21243319efe9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:09.583708 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef2645-4a5b-49a6-9f50-21243319efe9 None admin] RBAC: Adding query filter params (role.id=cf0f875ea1ba45758bd4f52a845d807e, scope.project.id=73bb6e1fa903475382715a00881f5cce, user.id=20a887b4089a485d92fa68e64ce9538a) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:09.584896 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef2645-4a5b-49a6-9f50-21243319efe9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:09.585512 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef2645-4a5b-49a6-9f50-21243319efe9 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:09.592443 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-af8bc1d4-a576-447f-be38-9621cd822a1d None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:09.593110 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 80/150] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:47:09 2022] GET /identity/v3/role_assignments?user.id=20a887b4089a485d92fa68e64ce9538a&scope.project.id=73bb6e1fa903475382715a00881f5cce&role.id=cf0f875ea1ba45758bd4f52a845d807e => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:09.594138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-af8bc1d4-a576-447f-be38-9621cd822a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:09.662493 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:09.674858 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 71/151] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:47:09.702123 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef2645-4a5b-49a6-9f50-21243319efe9 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:09.821478 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef2645-4a5b-49a6-9f50-21243319efe9 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:09.859469 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0528e-92d2-4a3c-a391-75354bf2fce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:09.860630 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0528e-92d2-4a3c-a391-75354bf2fce1 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:09.861104 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0528e-92d2-4a3c-a391-75354bf2fce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:09.861557 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0528e-92d2-4a3c-a391-75354bf2fce1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:09.873424 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0528e-92d2-4a3c-a391-75354bf2fce1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:09.881750 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-d5d0528e-92d2-4a3c-a391-75354bf2fce1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:47:09.881750 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:09.881750 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:09.881750 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:09.881750 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:09.881750 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:09.881750 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:09.881750 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:09.881750 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:09.881750 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:09.881750 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:09.881750 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:09.881750 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:09.881750 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:09.881750 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:09.881750 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:09.882633 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:09.882633 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:09.882633 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:09.882633 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:09.882633 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:09.882633 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:09.882633 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:09.882633 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:09.882633 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:09.882633 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:09.882633 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:09.882633 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:09.882633 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:09.882633 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:09.882633 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:09.882633 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:09.883423 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:09.883423 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:09.883423 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:09.883423 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:09.883423 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:09.883423 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:09.883423 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:09.883423 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:09.883423 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:09.883423 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:09.883423 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:47:09.883423 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:47:09.885893 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 81/152] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 11 20:47:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:09.891659 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8bc1d4-a576-447f-be38-9621cd822a1d None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:09.999474 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8bc1d4-a576-447f-be38-9621cd822a1d None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:10.036916 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90bf4f-de91-4a6e-b795-0b155a3a95ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:10.037847 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90bf4f-de91-4a6e-b795-0b155a3a95ea None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:10.038287 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90bf4f-de91-4a6e-b795-0b155a3a95ea None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:10.038709 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90bf4f-de91-4a6e-b795-0b155a3a95ea None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:10.039665 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90bf4f-de91-4a6e-b795-0b155a3a95ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:10.040151 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90bf4f-de91-4a6e-b795-0b155a3a95ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:10.041882 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90bf4f-de91-4a6e-b795-0b155a3a95ea None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:10.051149 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 72/153] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:47:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:10.057426 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0528e-92d2-4a3c-a391-75354bf2fce1 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:10.079248 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:10.172296 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0528e-92d2-4a3c-a391-75354bf2fce1 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:10.210067 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a7c2f-59b1-41d1-94b8-2331ba102672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:10.210955 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a7c2f-59b1-41d1-94b8-2331ba102672 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:10.211460 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a7c2f-59b1-41d1-94b8-2331ba102672 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:10.211749 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a7c2f-59b1-41d1-94b8-2331ba102672 None admin] PATH_INFO: `/v3/users/69c8f3089c874dc3bc848ee6f85bc4e4` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:10.213225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a7c2f-59b1-41d1-94b8-2331ba102672 None admin] RBAC: Authorizing `identity:get_user(user_id=69c8f3089c874dc3bc848ee6f85bc4e4)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:10.214698 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a7c2f-59b1-41d1-94b8-2331ba102672 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:10.216501 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 82/154] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:47:10 2022] GET /identity/v3/users/69c8f3089c874dc3bc848ee6f85bc4e4 => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:10.222426 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90bf4f-de91-4a6e-b795-0b155a3a95ea None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:10.282487 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:10.330184 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90bf4f-de91-4a6e-b795-0b155a3a95ea None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:10.368334 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a41a83-ed3a-46f3-968f-c34ea3df4179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:10.369001 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a41a83-ed3a-46f3-968f-c34ea3df4179 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:10.369381 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a41a83-ed3a-46f3-968f-c34ea3df4179 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:10.369668 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a41a83-ed3a-46f3-968f-c34ea3df4179 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:10.387271 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd58c95-2106-495f-87ed-a09d2f46a5f0 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:10.387574 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd58c95-2106-495f-87ed-a09d2f46a5f0 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:10.387836 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd58c95-2106-495f-87ed-a09d2f46a5f0 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:10.389231 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 83/155] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:10.401583 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b6c53-96b0-4d99-96ec-06c32fbddbce None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:10.401863 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b6c53-96b0-4d99-96ec-06c32fbddbce None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:10.402144 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b6c53-96b0-4d99-96ec-06c32fbddbce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:10.429253 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-815b6c53-96b0-4d99-96ec-06c32fbddbce None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:10.430444 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-815b6c53-96b0-4d99-96ec-06c32fbddbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:10.498557 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a41a83-ed3a-46f3-968f-c34ea3df4179 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:10.501525 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a41a83-ed3a-46f3-968f-c34ea3df4179 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:10.578874 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:10.582291 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 84/156] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:10.627018 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b6c53-96b0-4d99-96ec-06c32fbddbce None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:10.631028 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 73/157] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:47:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:47:10.637270 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a41a83-ed3a-46f3-968f-c34ea3df4179 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:10.659894 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:10.752295 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a41a83-ed3a-46f3-968f-c34ea3df4179 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:10.795602 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90901e6b-04c1-4dbf-8c68-54142a698787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:10.797003 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90901e6b-04c1-4dbf-8c68-54142a698787 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:10.797291 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90901e6b-04c1-4dbf-8c68-54142a698787 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:10.797568 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90901e6b-04c1-4dbf-8c68-54142a698787 None admin] PATH_INFO: `/v3/projects/73bb6e1fa903475382715a00881f5cce` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:10.798931 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90901e6b-04c1-4dbf-8c68-54142a698787 None admin] RBAC: Authorizing `identity:get_project(project_id=73bb6e1fa903475382715a00881f5cce)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:10.800602 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90901e6b-04c1-4dbf-8c68-54142a698787 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:10.802600 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 74/158] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:47:10 2022] GET /identity/v3/projects/73bb6e1fa903475382715a00881f5cce => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:47:10.809384 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90901e6b-04c1-4dbf-8c68-54142a698787 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:10.832495 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b6c53-96b0-4d99-96ec-06c32fbddbce None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:10.840364 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:10.879793 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efef5ed-aa4d-4706-9142-3d6571a52e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:10.883366 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efef5ed-aa4d-4706-9142-3d6571a52e01 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:10.883774 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efef5ed-aa4d-4706-9142-3d6571a52e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:10.884090 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efef5ed-aa4d-4706-9142-3d6571a52e01 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:10.901186 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efef5ed-aa4d-4706-9142-3d6571a52e01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:10.920029 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-8efef5ed-aa4d-4706-9142-3d6571a52e01 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:47:10.920029 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:10.920029 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:10.920029 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:10.920029 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:10.920029 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:10.920029 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:10.920029 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:10.920029 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:10.920029 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:10.920029 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:10.920029 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:10.920029 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:10.920029 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:10.920029 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:10.920029 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:10.920950 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:10.920950 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:10.920950 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:10.920950 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:10.920950 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:10.920950 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:10.920950 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:10.920950 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:10.920950 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:10.920950 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:10.920950 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:10.920950 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:10.920950 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:10.920950 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:10.920950 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:10.920950 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:10.922650 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:10.922650 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:10.922650 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:10.922650 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:10.922650 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:10.922650 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:10.922650 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:10.922650 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:10.922650 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:10.922650 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:10.922650 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:47:10.922650 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:47:10.922650 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 85/159] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jul 11 20:47:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:10.927493 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efef5ed-aa4d-4706-9142-3d6571a52e01 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:10.943846 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90901e6b-04c1-4dbf-8c68-54142a698787 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:11.020269 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377ef7a-fccc-47e4-8254-3a4702dee478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:11.020956 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377ef7a-fccc-47e4-8254-3a4702dee478 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:11.021251 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377ef7a-fccc-47e4-8254-3a4702dee478 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:11.021537 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377ef7a-fccc-47e4-8254-3a4702dee478 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:11.022396 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b377ef7a-fccc-47e4-8254-3a4702dee478 None admin] RBAC: Adding query filter params (role.id=86273ff072f3438d822e870272491768, scope.project.id=73bb6e1fa903475382715a00881f5cce, user.id=69c8f3089c874dc3bc848ee6f85bc4e4) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:11.022719 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b377ef7a-fccc-47e4-8254-3a4702dee478 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:11.024827 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b377ef7a-fccc-47e4-8254-3a4702dee478 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:11.037850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 75/160] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:47:10 2022] GET /identity/v3/role_assignments?user.id=69c8f3089c874dc3bc848ee6f85bc4e4&scope.project.id=73bb6e1fa903475382715a00881f5cce&role.id=86273ff072f3438d822e870272491768 => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:47:11.080192 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:11.114271 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efef5ed-aa4d-4706-9142-3d6571a52e01 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:11.131408 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086dcea2-0675-427b-b583-8b0af92cd01e None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:11.131770 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086dcea2-0675-427b-b583-8b0af92cd01e None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:11.132085 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086dcea2-0675-427b-b583-8b0af92cd01e None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:11.133708 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 76/161] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:47:11.140005 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55f336-60f3-49dc-8d55-15f928cf3176 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:11.140317 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55f336-60f3-49dc-8d55-15f928cf3176 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:11.140584 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55f336-60f3-49dc-8d55-15f928cf3176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:11.167941 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-9a55f336-60f3-49dc-8d55-15f928cf3176 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:11.169191 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-9a55f336-60f3-49dc-8d55-15f928cf3176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:11.196545 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ddd65e-e9cf-41d5-b66c-10a650e54489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:11.197246 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ddd65e-e9cf-41d5-b66c-10a650e54489 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:11.198102 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ddd65e-e9cf-41d5-b66c-10a650e54489 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:11.199163 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ddd65e-e9cf-41d5-b66c-10a650e54489 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:11.200311 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ddd65e-e9cf-41d5-b66c-10a650e54489 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:11.200633 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ddd65e-e9cf-41d5-b66c-10a650e54489 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:11.202058 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ddd65e-e9cf-41d5-b66c-10a650e54489 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:11.227887 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 86/162] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:47:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:11.232762 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ddd65e-e9cf-41d5-b66c-10a650e54489 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:11.334311 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 77/163] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:47:11.370286 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55f336-60f3-49dc-8d55-15f928cf3176 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:11.409975 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:11.412044 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ddd65e-e9cf-41d5-b66c-10a650e54489 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:11.472896 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b388dc-e6e8-400d-8d3a-c0cd7d47aad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:11.474062 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b388dc-e6e8-400d-8d3a-c0cd7d47aad1 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:11.474499 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b388dc-e6e8-400d-8d3a-c0cd7d47aad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:11.474936 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b388dc-e6e8-400d-8d3a-c0cd7d47aad1 None admin] PATH_INFO: `/v3/users/20a887b4089a485d92fa68e64ce9538a` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:11.476848 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b388dc-e6e8-400d-8d3a-c0cd7d47aad1 None admin] RBAC: Authorizing `identity:get_user(user_id=20a887b4089a485d92fa68e64ce9538a)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:11.479502 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b388dc-e6e8-400d-8d3a-c0cd7d47aad1 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:11.481932 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 87/164] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:47:11 2022] GET /identity/v3/users/20a887b4089a485d92fa68e64ce9538a => generated 275 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:11.488410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b388dc-e6e8-400d-8d3a-c0cd7d47aad1 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:11.503919 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:11.633989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b388dc-e6e8-400d-8d3a-c0cd7d47aad1 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:11.638409 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55f336-60f3-49dc-8d55-15f928cf3176 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:11.680721 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b6ab7-5882-47f4-96af-0f4a8c1e3dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:11.682005 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b6ab7-5882-47f4-96af-0f4a8c1e3dce None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:11.682522 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b6ab7-5882-47f4-96af-0f4a8c1e3dce None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:11.683411 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b6ab7-5882-47f4-96af-0f4a8c1e3dce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:11.748710 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6bf2b4-077a-4db6-af95-0e4846615b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:11.749798 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bf2b4-077a-4db6-af95-0e4846615b33 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:11.750092 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bf2b4-077a-4db6-af95-0e4846615b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:11.750374 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bf2b4-077a-4db6-af95-0e4846615b33 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:11.771906 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6bf2b4-077a-4db6-af95-0e4846615b33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:11.781230 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-7e6bf2b4-077a-4db6-af95-0e4846615b33 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 20:47:11.781230 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:11.781230 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:11.781230 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:11.781230 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:11.781230 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:11.781230 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:11.781230 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:11.781230 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:11.781230 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:11.781230 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:11.781230 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:11.781230 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:11.781230 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:11.781230 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:11.781230 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:11.782090 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:11.782090 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:11.782090 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:11.782090 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:11.782090 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:11.782090 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:11.782090 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:11.782090 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:11.782090 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:11.782090 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:11.782090 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:11.782090 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:11.782090 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:11.782090 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:11.782090 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:11.782090 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:11.783030 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:11.783030 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:11.783030 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:11.783030 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:11.783030 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:11.783030 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:11.783030 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:11.783030 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:11.783030 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:11.783030 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:11.783030 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 20:47:11.783030 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:47:11.783030 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 78/165] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:47:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 413 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:47:11.784203 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4e361-0beb-46b1-b2fb-51d590e6b9f9 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:11.784203 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4e361-0beb-46b1-b2fb-51d590e6b9f9 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:11.784434 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4e361-0beb-46b1-b2fb-51d590e6b9f9 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:11.785878 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 79/166] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:11.789768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4e361-0beb-46b1-b2fb-51d590e6b9f9 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:11.819194 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b6ab7-5882-47f4-96af-0f4a8c1e3dce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:11.820926 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b6ab7-5882-47f4-96af-0f4a8c1e3dce None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:11.835599 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:11.959427 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:11.989640 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4e361-0beb-46b1-b2fb-51d590e6b9f9 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:12.016352 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 88/167] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:47:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:47:12.018697 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58c196-1be9-4b1f-9987-ca615b8a656d None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:12.019959 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58c196-1be9-4b1f-9987-ca615b8a656d None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:12.020609 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58c196-1be9-4b1f-9987-ca615b8a656d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:12.048803 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-1f58c196-1be9-4b1f-9987-ca615b8a656d None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:12.050808 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-1f58c196-1be9-4b1f-9987-ca615b8a656d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:12.056601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79fa2f9-7312-4258-899c-31a92e781c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:12.057753 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fa2f9-7312-4258-899c-31a92e781c4c None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:12.058241 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fa2f9-7312-4258-899c-31a92e781c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:12.058724 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fa2f9-7312-4258-899c-31a92e781c4c None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:12.059670 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79fa2f9-7312-4258-899c-31a92e781c4c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:12.060193 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79fa2f9-7312-4258-899c-31a92e781c4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:12.061898 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79fa2f9-7312-4258-899c-31a92e781c4c None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:12.077206 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 80/168] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 11 20:47:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:12.078513 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79fa2f9-7312-4258-899c-31a92e781c4c None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:12.154818 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 89/169] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:12.156070 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58c196-1be9-4b1f-9987-ca615b8a656d None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:12.210989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:12.290814 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79fa2f9-7312-4258-899c-31a92e781c4c None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:12.308944 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58c196-1be9-4b1f-9987-ca615b8a656d None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:12.360813 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a07dde-e15c-4c71-a339-2be6708dd249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:12.361702 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a07dde-e15c-4c71-a339-2be6708dd249 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:12.361989 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a07dde-e15c-4c71-a339-2be6708dd249 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:12.362267 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a07dde-e15c-4c71-a339-2be6708dd249 None admin] PATH_INFO: `/v3/projects/73bb6e1fa903475382715a00881f5cce` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:12.364630 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a07dde-e15c-4c71-a339-2be6708dd249 None admin] RBAC: Authorizing `identity:get_project(project_id=73bb6e1fa903475382715a00881f5cce)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:12.366091 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a07dde-e15c-4c71-a339-2be6708dd249 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:12.367802 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 81/170] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:47:12 2022] GET /identity/v3/projects/73bb6e1fa903475382715a00881f5cce => generated 298 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:12.368588 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a07dde-e15c-4c71-a339-2be6708dd249 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:12.385176 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:12.386045 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ae95a-a0db-4293-a37f-60eb1a27c4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:12.387138 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ae95a-a0db-4293-a37f-60eb1a27c4b6 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:12.388812 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ae95a-a0db-4293-a37f-60eb1a27c4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:12.389258 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ae95a-a0db-4293-a37f-60eb1a27c4b6 None admin] PATH_INFO: `/v3/users/7c2932f6d16c46d4bcfce7b578f18462` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:12.391417 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ae95a-a0db-4293-a37f-60eb1a27c4b6 None admin] RBAC: Authorizing `identity:get_user(user_id=7c2932f6d16c46d4bcfce7b578f18462)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:12.394379 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ae95a-a0db-4293-a37f-60eb1a27c4b6 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:12.400363 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 90/171] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:47:12 2022] GET /identity/v3/users/7c2932f6d16c46d4bcfce7b578f18462 => generated 289 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:12.400363 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ae95a-a0db-4293-a37f-60eb1a27c4b6 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:12.554584 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ae95a-a0db-4293-a37f-60eb1a27c4b6 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:12.555909 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a07dde-e15c-4c71-a339-2be6708dd249 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:12.570283 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:12.596468 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14566a8a-b3ea-47ba-a9cb-1cc9fb182250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:12.598980 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14566a8a-b3ea-47ba-a9cb-1cc9fb182250 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:12.599470 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14566a8a-b3ea-47ba-a9cb-1cc9fb182250 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:12.599895 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14566a8a-b3ea-47ba-a9cb-1cc9fb182250 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:12.601960 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14566a8a-b3ea-47ba-a9cb-1cc9fb182250 None admin] RBAC: Adding query filter params (role.id=c2117c810f7b4e6aaf684c3d37b0ea3e, scope.project.id=73bb6e1fa903475382715a00881f5cce, user.id=20a887b4089a485d92fa68e64ce9538a) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:12.602445 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14566a8a-b3ea-47ba-a9cb-1cc9fb182250 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:12.605489 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14566a8a-b3ea-47ba-a9cb-1cc9fb182250 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:12.614542 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 91/172] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:47:12 2022] GET /identity/v3/role_assignments?user.id=20a887b4089a485d92fa68e64ce9538a&scope.project.id=73bb6e1fa903475382715a00881f5cce&role.id=c2117c810f7b4e6aaf684c3d37b0ea3e => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:12.616682 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14566a8a-b3ea-47ba-a9cb-1cc9fb182250 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:12.634165 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86cd4f-edf4-479b-91c8-7c87f523306a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:12.635840 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86cd4f-edf4-479b-91c8-7c87f523306a None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:12.636291 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86cd4f-edf4-479b-91c8-7c87f523306a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:12.636724 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86cd4f-edf4-479b-91c8-7c87f523306a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:12.673692 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de86cd4f-edf4-479b-91c8-7c87f523306a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:12.687058 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-de86cd4f-edf4-479b-91c8-7c87f523306a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:47:12.687058 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:12.687058 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:12.687058 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:12.687058 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:12.687058 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:12.687058 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:12.687058 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:12.687058 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:12.687058 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:12.687058 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:12.687058 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:12.687058 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:12.687058 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:12.687058 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:12.687058 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:12.688322 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:12.688322 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:12.688322 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:12.688322 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:12.688322 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:12.688322 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:12.688322 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:12.688322 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:12.688322 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:12.688322 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:12.688322 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:12.688322 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:12.688322 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:12.688322 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:12.688322 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:12.688322 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:12.689107 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:12.689107 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:12.689107 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:12.689107 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:12.689107 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:12.689107 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:12.689107 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:12.689107 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:12.689107 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:12.689107 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:12.689107 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:47:12.689107 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:47:12.693476 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 82/173] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:47:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:12.701450 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86cd4f-edf4-479b-91c8-7c87f523306a None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:12.848444 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:12.856180 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14566a8a-b3ea-47ba-a9cb-1cc9fb182250 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:12.914626 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86cd4f-edf4-479b-91c8-7c87f523306a None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:12.955488 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e0f7c-8b9c-4091-833f-81a4c10ad249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:12.957938 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e0f7c-8b9c-4091-833f-81a4c10ad249 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:12.958429 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e0f7c-8b9c-4091-833f-81a4c10ad249 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:12.959936 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e0f7c-8b9c-4091-833f-81a4c10ad249 None admin] PATH_INFO: `/v3/projects/73bb6e1fa903475382715a00881f5cce` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:12.961725 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e0f7c-8b9c-4091-833f-81a4c10ad249 None admin] RBAC: Authorizing `identity:get_project(project_id=73bb6e1fa903475382715a00881f5cce)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:12.963706 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e0f7c-8b9c-4091-833f-81a4c10ad249 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:12.965477 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 92/174] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:47:12 2022] GET /identity/v3/projects/73bb6e1fa903475382715a00881f5cce => generated 298 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:12.968459 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37d652-064b-4747-8b61-e96b159e3459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:12.969727 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37d652-064b-4747-8b61-e96b159e3459 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:12.970211 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37d652-064b-4747-8b61-e96b159e3459 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:12.970748 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37d652-064b-4747-8b61-e96b159e3459 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:12.971295 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757b625-632f-459b-9d4f-5fd048e02033 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:12.971589 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757b625-632f-459b-9d4f-5fd048e02033 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:12.971869 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757b625-632f-459b-9d4f-5fd048e02033 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:12.972388 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37d652-064b-4747-8b61-e96b159e3459 None admin] RBAC: Adding query filter params (name=member) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:12.972896 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37d652-064b-4747-8b61-e96b159e3459 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:12.973582 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 93/175] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:12.974690 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37d652-064b-4747-8b61-e96b159e3459 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:12.976980 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757b625-632f-459b-9d4f-5fd048e02033 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:12.986947 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 83/176] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 11 20:47:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:47:12.988641 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5a649-fba7-4b36-acb1-f8e8e57a9e12 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:12.989645 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5a649-fba7-4b36-acb1-f8e8e57a9e12 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:12.990140 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5a649-fba7-4b36-acb1-f8e8e57a9e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:13.013302 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-1ea5a649-fba7-4b36-acb1-f8e8e57a9e12 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:13.015363 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-1ea5a649-fba7-4b36-acb1-f8e8e57a9e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:13.036362 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:13.106701 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757b625-632f-459b-9d4f-5fd048e02033 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:13.109174 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 84/177] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:13.110156 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5a649-fba7-4b36-acb1-f8e8e57a9e12 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:13.167124 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3efa95b-793c-486b-a683-c855b9bdda18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:13.168449 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efa95b-793c-486b-a683-c855b9bdda18 None admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:13.168935 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efa95b-793c-486b-a683-c855b9bdda18 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:13.169348 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efa95b-793c-486b-a683-c855b9bdda18 None admin] PATH_INFO: `/v3/projects/73bb6e1fa903475382715a00881f5cce/users/7c2932f6d16c46d4bcfce7b578f18462/roles/3a94b407c6914e15a379d3580c9c9ddf` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:13.171649 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3efa95b-793c-486b-a683-c855b9bdda18 None admin] RBAC: Authorizing `identity:create_grant(project_id=73bb6e1fa903475382715a00881f5cce, user_id=7c2932f6d16c46d4bcfce7b578f18462, role_id=3a94b407c6914e15a379d3580c9c9ddf)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:13.173509 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3efa95b-793c-486b-a683-c855b9bdda18 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:13.189349 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:13.230596 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5a649-fba7-4b36-acb1-f8e8e57a9e12 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:13.262103 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 94/178] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 11 20:47:12 2022] PUT /identity/v3/projects/73bb6e1fa903475382715a00881f5cce/users/7c2932f6d16c46d4bcfce7b578f18462/roles/3a94b407c6914e15a379d3580c9c9ddf => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 20:47:13.267514 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b5ec3-124b-44e3-a823-c9ef7deefc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:13.268898 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b5ec3-124b-44e3-a823-c9ef7deefc7e None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:13.269034 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3efa95b-793c-486b-a683-c855b9bdda18 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:13.269506 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b5ec3-124b-44e3-a823-c9ef7deefc7e None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:13.269962 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b5ec3-124b-44e3-a823-c9ef7deefc7e None admin] PATH_INFO: `/v3/users/20a887b4089a485d92fa68e64ce9538a` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:13.271596 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0b5ec3-124b-44e3-a823-c9ef7deefc7e None admin] RBAC: Authorizing `identity:get_user(user_id=20a887b4089a485d92fa68e64ce9538a)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:13.273366 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0b5ec3-124b-44e3-a823-c9ef7deefc7e None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:13.275284 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 85/179] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:47:13 2022] GET /identity/v3/users/20a887b4089a485d92fa68e64ce9538a => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:13.282712 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b5ec3-124b-44e3-a823-c9ef7deefc7e None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:13.408228 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b5ec3-124b-44e3-a823-c9ef7deefc7e None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:13.435448 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:13.443244 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3efa95b-793c-486b-a683-c855b9bdda18 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:13.443899 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:13.448927 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d06502-d533-42d4-8a76-e84a639681fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:13.456830 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d06502-d533-42d4-8a76-e84a639681fa None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:13.456830 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d06502-d533-42d4-8a76-e84a639681fa None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:13.456830 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d06502-d533-42d4-8a76-e84a639681fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:13.490472 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10736a1d-0010-4885-8fb7-1bc3bce40ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:13.491277 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10736a1d-0010-4885-8fb7-1bc3bce40ddc None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:13.491560 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10736a1d-0010-4885-8fb7-1bc3bce40ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:13.491836 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10736a1d-0010-4885-8fb7-1bc3bce40ddc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:13.503353 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10736a1d-0010-4885-8fb7-1bc3bce40ddc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:13.512284 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-10736a1d-0010-4885-8fb7-1bc3bce40ddc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:47:13.512284 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:13.512284 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:13.512284 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:13.512284 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:13.512284 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:13.512284 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:13.512284 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:13.512284 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:13.512284 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:13.512284 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:13.512284 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:13.512284 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:13.512284 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:13.512284 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:13.512284 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:13.514410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:13.514410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:13.514410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:13.514410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:13.514410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:13.514410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:13.514410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:13.514410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:13.514410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:13.514410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:13.514410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:13.514410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:13.514410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:13.514410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:13.514410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:13.514410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:13.515197 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:13.515197 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:13.515197 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:13.515197 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:13.515197 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:13.515197 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:13.515197 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:13.515197 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:13.515197 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:13.515197 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:13.515197 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:47:13.515197 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:47:13.518516 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 95/180] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 11 20:47:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:13.519849 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401b872-6a05-46bf-90c6-88d42f76f730 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:13.520165 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401b872-6a05-46bf-90c6-88d42f76f730 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:13.520446 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401b872-6a05-46bf-90c6-88d42f76f730 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:13.521946 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 96/181] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:13.522966 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401b872-6a05-46bf-90c6-88d42f76f730 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:13.538882 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d06502-d533-42d4-8a76-e84a639681fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:13.540620 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d06502-d533-42d4-8a76-e84a639681fa None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:13.641283 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401b872-6a05-46bf-90c6-88d42f76f730 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:13.646828 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 86/182] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:47:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:47:13.648332 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136da5e-6da8-472b-80b9-63cb971d1bc2 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:13.648534 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136da5e-6da8-472b-80b9-63cb971d1bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:13.648745 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136da5e-6da8-472b-80b9-63cb971d1bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:13.668002 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-7136da5e-6da8-472b-80b9-63cb971d1bc2 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:13.669216 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-7136da5e-6da8-472b-80b9-63cb971d1bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:13.686383 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23f84c-c77c-4f67-8d28-8997d00af543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:13.687123 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23f84c-c77c-4f67-8d28-8997d00af543 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:13.687388 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23f84c-c77c-4f67-8d28-8997d00af543 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:13.687672 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23f84c-c77c-4f67-8d28-8997d00af543 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:13.688469 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23f84c-c77c-4f67-8d28-8997d00af543 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:13.688786 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23f84c-c77c-4f67-8d28-8997d00af543 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:13.690220 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23f84c-c77c-4f67-8d28-8997d00af543 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:13.691702 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:13.699565 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 97/183] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:47:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:13.702330 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95064ed5-7680-48e8-8c18-88b0ea01fe4e None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:13.702330 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95064ed5-7680-48e8-8c18-88b0ea01fe4e None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:13.702330 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95064ed5-7680-48e8-8c18-88b0ea01fe4e None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:13.706946 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 98/184] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:13.706946 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95064ed5-7680-48e8-8c18-88b0ea01fe4e None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:13.726659 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:13.745982 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 87/185] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:13.746769 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136da5e-6da8-472b-80b9-63cb971d1bc2 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:13.826983 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95064ed5-7680-48e8-8c18-88b0ea01fe4e None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:13.854139 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136da5e-6da8-472b-80b9-63cb971d1bc2 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:13.861826 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab66def-2718-4351-848f-af4707c68b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:13.862698 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab66def-2718-4351-848f-af4707c68b1f None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:13.862982 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab66def-2718-4351-848f-af4707c68b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:13.863255 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab66def-2718-4351-848f-af4707c68b1f None admin] PATH_INFO: `/v3/projects/6a75fe80381f4697831fbbff914c3bac` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:13.864461 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab66def-2718-4351-848f-af4707c68b1f None admin] RBAC: Authorizing `identity:get_project(project_id=6a75fe80381f4697831fbbff914c3bac)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:13.865921 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab66def-2718-4351-848f-af4707c68b1f None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:13.867837 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 99/186] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:47:13 2022] GET /identity/v3/projects/6a75fe80381f4697831fbbff914c3bac => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:13.868775 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c0360-23de-49dd-ab39-93e365253bdd None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:13.869064 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c0360-23de-49dd-ab39-93e365253bdd None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:13.870030 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c0360-23de-49dd-ab39-93e365253bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:13.886615 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-106c0360-23de-49dd-ab39-93e365253bdd None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:13.887813 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-106c0360-23de-49dd-ab39-93e365253bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:13.895015 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f6fb4-070d-409d-a43c-33f3635496c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:13.895903 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f6fb4-070d-409d-a43c-33f3635496c2 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:13.896218 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f6fb4-070d-409d-a43c-33f3635496c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:13.896500 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f6fb4-070d-409d-a43c-33f3635496c2 None admin] PATH_INFO: `/v3/users/a29e449728d941f9b691808c1f6e1716` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:13.912563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f6fb4-070d-409d-a43c-33f3635496c2 None admin] RBAC: Authorizing `identity:get_user(user_id=a29e449728d941f9b691808c1f6e1716)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:13.914020 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f6fb4-070d-409d-a43c-33f3635496c2 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:13.915785 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 88/187] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:47:13 2022] GET /identity/v3/users/a29e449728d941f9b691808c1f6e1716 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:13.920830 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f6fb4-070d-409d-a43c-33f3635496c2 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:13.936899 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:13.965080 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 100/188] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:13.966201 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c0360-23de-49dd-ab39-93e365253bdd None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:13.991633 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:14.040799 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f6fb4-070d-409d-a43c-33f3635496c2 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:14.076223 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f52c845-3b75-4379-8c21-7f95c4bad5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:14.077038 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52c845-3b75-4379-8c21-7f95c4bad5e2 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:14.077332 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52c845-3b75-4379-8c21-7f95c4bad5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:14.077615 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52c845-3b75-4379-8c21-7f95c4bad5e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:14.078808 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f52c845-3b75-4379-8c21-7f95c4bad5e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:14.080313 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f52c845-3b75-4379-8c21-7f95c4bad5e2 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:14.080889 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c0360-23de-49dd-ab39-93e365253bdd None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:14.082107 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 89/189] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:47:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:14.082801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f52c845-3b75-4379-8c21-7f95c4bad5e2 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:14.121815 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6d383-f5a8-4707-a96e-612c766912b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:14.122475 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6d383-f5a8-4707-a96e-612c766912b9 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:14.122762 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6d383-f5a8-4707-a96e-612c766912b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:14.123039 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6d383-f5a8-4707-a96e-612c766912b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:14.123868 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e6d383-f5a8-4707-a96e-612c766912b9 None admin] RBAC: Adding query filter params (role.id=cf0f875ea1ba45758bd4f52a845d807e, scope.project.id=6a75fe80381f4697831fbbff914c3bac, user.id=20a887b4089a485d92fa68e64ce9538a) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:14.124471 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e6d383-f5a8-4707-a96e-612c766912b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:14.125907 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e6d383-f5a8-4707-a96e-612c766912b9 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:14.140012 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 101/190] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:47:13 2022] GET /identity/v3/role_assignments?user.id=20a887b4089a485d92fa68e64ce9538a&scope.project.id=6a75fe80381f4697831fbbff914c3bac&role.id=cf0f875ea1ba45758bd4f52a845d807e => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:14.140012 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6d383-f5a8-4707-a96e-612c766912b9 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:14.195931 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:14.221970 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f52c845-3b75-4379-8c21-7f95c4bad5e2 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:14.240356 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:14.263538 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6d383-f5a8-4707-a96e-612c766912b9 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:14.270970 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368fad4a-e63c-4975-9d6c-2d7add2f49e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:14.271644 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fad4a-e63c-4975-9d6c-2d7add2f49e3 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:14.272214 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fad4a-e63c-4975-9d6c-2d7add2f49e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:14.272528 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fad4a-e63c-4975-9d6c-2d7add2f49e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:14.305592 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2b3e5-5963-48e0-ac41-7b1aae7aa927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:14.306473 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2b3e5-5963-48e0-ac41-7b1aae7aa927 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:14.307397 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2b3e5-5963-48e0-ac41-7b1aae7aa927 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:14.307684 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2b3e5-5963-48e0-ac41-7b1aae7aa927 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:14.324579 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2b3e5-5963-48e0-ac41-7b1aae7aa927 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:14.333849 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-f0f2b3e5-5963-48e0-ac41-7b1aae7aa927 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:47:14.333849 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:14.333849 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:14.333849 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:14.333849 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:14.333849 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:14.333849 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:14.333849 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:14.333849 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:14.333849 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:14.333849 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:14.333849 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:14.333849 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:14.333849 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:14.333849 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:14.333849 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:14.334745 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:14.334745 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:14.334745 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:14.334745 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:14.334745 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:14.334745 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:14.334745 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:14.334745 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:14.334745 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:14.334745 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:14.334745 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:14.334745 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:14.334745 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:14.334745 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:14.334745 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:14.334745 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:14.335506 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:14.335506 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:14.335506 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:14.335506 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:14.335506 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:14.335506 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:14.335506 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:14.335506 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:14.335506 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:14.335506 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:14.335506 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:47:14.335506 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:47:14.337070 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 102/191] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jul 11 20:47:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:14.338673 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2b3e5-5963-48e0-ac41-7b1aae7aa927 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:14.381384 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368fad4a-e63c-4975-9d6c-2d7add2f49e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:14.383135 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368fad4a-e63c-4975-9d6c-2d7add2f49e3 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:14.451674 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2b3e5-5963-48e0-ac41-7b1aae7aa927 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:14.482863 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:14.492341 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393fcee-af6f-4483-9888-8d21b0b0fa79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:14.500387 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393fcee-af6f-4483-9888-8d21b0b0fa79 None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:14.500387 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393fcee-af6f-4483-9888-8d21b0b0fa79 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:14.500387 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393fcee-af6f-4483-9888-8d21b0b0fa79 None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:14.500387 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0393fcee-af6f-4483-9888-8d21b0b0fa79 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:14.500387 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0393fcee-af6f-4483-9888-8d21b0b0fa79 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:14.502738 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 90/192] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:47:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:47:14.507998 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368fad4a-e63c-4975-9d6c-2d7add2f49e3 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:14.508538 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:14.603018 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 103/193] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jul 11 20:47:14 2022] POST /identity/v3/users => generated 297 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:47:14.604967 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393fcee-af6f-4483-9888-8d21b0b0fa79 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:14.612265 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368fad4a-e63c-4975-9d6c-2d7add2f49e3 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:14.658543 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e20ee-15ca-4609-81e8-230cf853fa7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:14.659289 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e20ee-15ca-4609-81e8-230cf853fa7a None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:14.659584 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e20ee-15ca-4609-81e8-230cf853fa7a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:14.659920 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e20ee-15ca-4609-81e8-230cf853fa7a None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:14.660799 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e20ee-15ca-4609-81e8-230cf853fa7a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:14.661124 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e20ee-15ca-4609-81e8-230cf853fa7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:14.662623 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e20ee-15ca-4609-81e8-230cf853fa7a None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:14.678157 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 91/194] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:47:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:14.681137 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e20ee-15ca-4609-81e8-230cf853fa7a None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:14.737866 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:14.776420 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393fcee-af6f-4483-9888-8d21b0b0fa79 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:14.809234 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e20ee-15ca-4609-81e8-230cf853fa7a None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:14.815375 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49013303-200c-46bc-80cd-c835fc040867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:14.816451 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49013303-200c-46bc-80cd-c835fc040867 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:14.816746 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49013303-200c-46bc-80cd-c835fc040867 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:14.817032 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49013303-200c-46bc-80cd-c835fc040867 None admin] PATH_INFO: `/v3/projects/549948b5ac834c07b634e08f7b1ec58d` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:14.819170 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49013303-200c-46bc-80cd-c835fc040867 None admin] RBAC: Authorizing `identity:get_project(project_id=549948b5ac834c07b634e08f7b1ec58d)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:14.820704 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49013303-200c-46bc-80cd-c835fc040867 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:14.823381 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 104/195] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:47:14 2022] GET /identity/v3/projects/549948b5ac834c07b634e08f7b1ec58d => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:14.829891 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49013303-200c-46bc-80cd-c835fc040867 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:14.854993 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846d06c-26c0-4355-88d6-817cb3671150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:14.856103 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846d06c-26c0-4355-88d6-817cb3671150 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:14.856446 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846d06c-26c0-4355-88d6-817cb3671150 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:14.856785 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846d06c-26c0-4355-88d6-817cb3671150 None admin] PATH_INFO: `/v3/users/a29e449728d941f9b691808c1f6e1716` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:14.858320 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846d06c-26c0-4355-88d6-817cb3671150 None admin] RBAC: Authorizing `identity:get_user(user_id=a29e449728d941f9b691808c1f6e1716)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:14.859943 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846d06c-26c0-4355-88d6-817cb3671150 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:14.862193 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 92/196] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:47:14 2022] GET /identity/v3/users/a29e449728d941f9b691808c1f6e1716 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:14.867839 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846d06c-26c0-4355-88d6-817cb3671150 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:14.914646 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:14.968094 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49013303-200c-46bc-80cd-c835fc040867 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:15.001164 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846d06c-26c0-4355-88d6-817cb3671150 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:15.016611 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1136eab8-c38c-475d-9aa5-d102d19795bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:15.017355 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136eab8-c38c-475d-9aa5-d102d19795bd None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:15.017718 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136eab8-c38c-475d-9aa5-d102d19795bd None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:15.018203 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136eab8-c38c-475d-9aa5-d102d19795bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:15.019274 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1136eab8-c38c-475d-9aa5-d102d19795bd None admin] RBAC: Adding query filter params (role.id=86273ff072f3438d822e870272491768, scope.project.id=549948b5ac834c07b634e08f7b1ec58d, user.id=a29e449728d941f9b691808c1f6e1716) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:15.019684 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1136eab8-c38c-475d-9aa5-d102d19795bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:15.020716 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:15.022529 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1136eab8-c38c-475d-9aa5-d102d19795bd None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:15.030765 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 105/197] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:47:14 2022] GET /identity/v3/role_assignments?user.id=a29e449728d941f9b691808c1f6e1716&scope.project.id=549948b5ac834c07b634e08f7b1ec58d&role.id=86273ff072f3438d822e870272491768 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:15.055039 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de2384-4f41-4109-8178-3a656030cad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:15.056435 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de2384-4f41-4109-8178-3a656030cad6 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:15.057170 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de2384-4f41-4109-8178-3a656030cad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:15.057835 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de2384-4f41-4109-8178-3a656030cad6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:15.139615 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de2384-4f41-4109-8178-3a656030cad6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:15.141413 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de2384-4f41-4109-8178-3a656030cad6 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:15.265147 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 93/198] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:47:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 20:47:15.270380 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1136eab8-c38c-475d-9aa5-d102d19795bd None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:15.439258 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da46d9-334f-4cd3-9988-c507488fb6a7 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:15.439646 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da46d9-334f-4cd3-9988-c507488fb6a7 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:15.439837 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da46d9-334f-4cd3-9988-c507488fb6a7 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:15.441429 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 94/199] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:47:15.446543 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88167a8-5940-4537-9e49-fb45f3f54bc4 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:15.447063 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88167a8-5940-4537-9e49-fb45f3f54bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:15.448177 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88167a8-5940-4537-9e49-fb45f3f54bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:15.465412 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-c88167a8-5940-4537-9e49-fb45f3f54bc4 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:15.466917 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c88167a8-5940-4537-9e49-fb45f3f54bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:15.477623 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:15.488615 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1136eab8-c38c-475d-9aa5-d102d19795bd None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:15.536452 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:15.552354 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349b1b1-56d9-45f3-9534-ceacc8a8e584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:15.553573 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349b1b1-56d9-45f3-9534-ceacc8a8e584 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:15.554032 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349b1b1-56d9-45f3-9534-ceacc8a8e584 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:15.554480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349b1b1-56d9-45f3-9534-ceacc8a8e584 None admin] PATH_INFO: `/v3/projects/549948b5ac834c07b634e08f7b1ec58d` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:15.555887 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3349b1b1-56d9-45f3-9534-ceacc8a8e584 None admin] RBAC: Authorizing `identity:get_project(project_id=549948b5ac834c07b634e08f7b1ec58d)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:15.557863 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3349b1b1-56d9-45f3-9534-ceacc8a8e584 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:15.561453 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 106/200] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:47:15 2022] GET /identity/v3/projects/549948b5ac834c07b634e08f7b1ec58d => generated 302 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:15.573654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349b1b1-56d9-45f3-9534-ceacc8a8e584 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:15.584583 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 95/201] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:47:15.608161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88167a8-5940-4537-9e49-fb45f3f54bc4 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:15.746464 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88167a8-5940-4537-9e49-fb45f3f54bc4 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:15.759622 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349b1b1-56d9-45f3-9534-ceacc8a8e584 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:15.801976 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c90ebc-23dc-48a6-8dca-f8db1fe24a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:15.804068 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c90ebc-23dc-48a6-8dca-f8db1fe24a7b None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:15.805697 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c90ebc-23dc-48a6-8dca-f8db1fe24a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:15.806157 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c90ebc-23dc-48a6-8dca-f8db1fe24a7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:15.807287 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c90ebc-23dc-48a6-8dca-f8db1fe24a7b None admin] RBAC: Adding query filter params (role.id=c2117c810f7b4e6aaf684c3d37b0ea3e, scope.project.id=549948b5ac834c07b634e08f7b1ec58d, user.id=a29e449728d941f9b691808c1f6e1716) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:15.809078 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c90ebc-23dc-48a6-8dca-f8db1fe24a7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:15.811430 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c90ebc-23dc-48a6-8dca-f8db1fe24a7b None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:15.823444 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 107/202] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:47:15 2022] GET /identity/v3/role_assignments?user.id=a29e449728d941f9b691808c1f6e1716&scope.project.id=549948b5ac834c07b634e08f7b1ec58d&role.id=c2117c810f7b4e6aaf684c3d37b0ea3e => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:47:15.832913 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55aa22d-da73-45ae-bf6d-fdd91a5648c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:15.834078 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55aa22d-da73-45ae-bf6d-fdd91a5648c2 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:15.834540 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55aa22d-da73-45ae-bf6d-fdd91a5648c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:15.834990 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55aa22d-da73-45ae-bf6d-fdd91a5648c2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:15.854681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55aa22d-da73-45ae-bf6d-fdd91a5648c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:15.862897 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-b55aa22d-da73-45ae-bf6d-fdd91a5648c2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 20:47:15.862897 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:15.862897 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:15.862897 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:15.862897 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:15.862897 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:15.862897 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:15.862897 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:15.862897 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:15.862897 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:15.862897 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:15.862897 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:15.862897 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:15.862897 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:15.862897 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:15.862897 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:15.863918 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:15.863918 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:15.863918 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:15.863918 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:15.863918 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:15.863918 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:15.863918 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:15.863918 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:15.863918 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:15.863918 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:15.863918 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:15.863918 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:15.863918 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:15.863918 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:15.863918 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:15.863918 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:15.864713 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:15.864713 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:15.864713 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:15.864713 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:15.864713 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:15.864713 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:15.864713 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:15.864713 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:15.864713 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:15.864713 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:15.864713 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 20:47:15.864713 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:47:15.866838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 96/203] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:47:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:15.873421 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c90ebc-23dc-48a6-8dca-f8db1fe24a7b None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:15.940817 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:15.986540 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c90ebc-23dc-48a6-8dca-f8db1fe24a7b None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:16.039452 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c9369-1a9f-4726-bd73-0fb0070ebc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:16.040457 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c9369-1a9f-4726-bd73-0fb0070ebc0b None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:16.040885 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c9369-1a9f-4726-bd73-0fb0070ebc0b None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:16.041578 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c9369-1a9f-4726-bd73-0fb0070ebc0b None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:16.042485 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c9369-1a9f-4726-bd73-0fb0070ebc0b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:16.042940 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c9369-1a9f-4726-bd73-0fb0070ebc0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:16.044503 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c9369-1a9f-4726-bd73-0fb0070ebc0b None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:16.059884 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55aa22d-da73-45ae-bf6d-fdd91a5648c2 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:16.060840 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 108/204] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 11 20:47:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:16.063725 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:16.190353 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55aa22d-da73-45ae-bf6d-fdd91a5648c2 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:16.239033 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975dd4c-3a11-4939-b632-8a27ee61bd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:16.239921 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975dd4c-3a11-4939-b632-8a27ee61bd09 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:16.240237 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975dd4c-3a11-4939-b632-8a27ee61bd09 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:16.240518 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975dd4c-3a11-4939-b632-8a27ee61bd09 None admin] PATH_INFO: `/v3/users/7c2932f6d16c46d4bcfce7b578f18462` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:16.241753 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d975dd4c-3a11-4939-b632-8a27ee61bd09 None admin] RBAC: Authorizing `identity:get_user(user_id=7c2932f6d16c46d4bcfce7b578f18462)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:16.243211 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d975dd4c-3a11-4939-b632-8a27ee61bd09 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:16.245307 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 97/205] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:47:16 2022] GET /identity/v3/users/7c2932f6d16c46d4bcfce7b578f18462 => generated 289 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:16.250824 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c9369-1a9f-4726-bd73-0fb0070ebc0b None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:16.462047 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c9369-1a9f-4726-bd73-0fb0070ebc0b None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:16.488491 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:16.507474 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ff687-aaca-4cf4-9ab2-ed0761897e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:16.508166 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ff687-aaca-4cf4-9ab2-ed0761897e63 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:16.508458 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ff687-aaca-4cf4-9ab2-ed0761897e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:16.508736 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ff687-aaca-4cf4-9ab2-ed0761897e63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:16.584263 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ff687-aaca-4cf4-9ab2-ed0761897e63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:16.585731 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ff687-aaca-4cf4-9ab2-ed0761897e63 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:16.715037 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 109/206] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:47:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:47:16.725039 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975dd4c-3a11-4939-b632-8a27ee61bd09 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:16.820888 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:16.857566 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975dd4c-3a11-4939-b632-8a27ee61bd09 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:16.908842 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a4658-09f3-4a2c-b72f-6964010885e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:16.909718 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a4658-09f3-4a2c-b72f-6964010885e6 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:16.910005 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a4658-09f3-4a2c-b72f-6964010885e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:16.910282 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a4658-09f3-4a2c-b72f-6964010885e6 None admin] PATH_INFO: `/v3/projects/73bb6e1fa903475382715a00881f5cce` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:16.912506 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a4658-09f3-4a2c-b72f-6964010885e6 None admin] RBAC: Authorizing `identity:get_project(project_id=73bb6e1fa903475382715a00881f5cce)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:16.914009 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a4658-09f3-4a2c-b72f-6964010885e6 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:16.915884 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 98/207] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:47:16 2022] GET /identity/v3/projects/73bb6e1fa903475382715a00881f5cce => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:16.921773 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ff687-aaca-4cf4-9ab2-ed0761897e63 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:16.954028 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:17.049571 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ff687-aaca-4cf4-9ab2-ed0761897e63 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:17.091291 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4539094-e951-4d7f-aec3-8e5bf45a69e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:17.092002 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4539094-e951-4d7f-aec3-8e5bf45a69e8 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:17.092287 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4539094-e951-4d7f-aec3-8e5bf45a69e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:17.092571 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4539094-e951-4d7f-aec3-8e5bf45a69e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:17.093416 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4539094-e951-4d7f-aec3-8e5bf45a69e8 None admin] RBAC: Adding query filter params (role.id=3a94b407c6914e15a379d3580c9c9ddf, scope.project.id=73bb6e1fa903475382715a00881f5cce, user.id=7c2932f6d16c46d4bcfce7b578f18462) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:17.093739 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4539094-e951-4d7f-aec3-8e5bf45a69e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:17.095198 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4539094-e951-4d7f-aec3-8e5bf45a69e8 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:17.101681 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 110/208] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:47:16 2022] GET /identity/v3/role_assignments?user.id=7c2932f6d16c46d4bcfce7b578f18462&scope.project.id=73bb6e1fa903475382715a00881f5cce&role.id=3a94b407c6914e15a379d3580c9c9ddf => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:17.172623 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93817063-cd3e-4853-aef3-4f50c0a9f741 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:17.173166 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93817063-cd3e-4853-aef3-4f50c0a9f741 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:17.173242 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93817063-cd3e-4853-aef3-4f50c0a9f741 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:17.174806 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 99/209] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:17.192949 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b48b9-cf26-4470-a6d3-8cafb1f5b9a5 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:17.193298 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b48b9-cf26-4470-a6d3-8cafb1f5b9a5 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:17.193538 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b48b9-cf26-4470-a6d3-8cafb1f5b9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:17.221406 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-f57b48b9-cf26-4470-a6d3-8cafb1f5b9a5 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:17.222646 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-f57b48b9-cf26-4470-a6d3-8cafb1f5b9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:17.313776 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 111/210] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:17.337711 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93817063-cd3e-4853-aef3-4f50c0a9f741 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:17.469553 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93817063-cd3e-4853-aef3-4f50c0a9f741 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:17.511512 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564021d-a095-473a-bf1e-c2a0243a0f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:17.512613 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564021d-a095-473a-bf1e-c2a0243a0f26 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:17.513061 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564021d-a095-473a-bf1e-c2a0243a0f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:17.513494 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564021d-a095-473a-bf1e-c2a0243a0f26 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:17.522759 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:17.529838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6564021d-a095-473a-bf1e-c2a0243a0f26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:17.537850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-6564021d-a095-473a-bf1e-c2a0243a0f26 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:47:17.537850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:17.537850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:17.537850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:17.537850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:17.537850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:17.537850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:17.537850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:17.537850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:17.537850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:17.537850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:17.537850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:17.537850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:17.537850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:17.537850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:17.537850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:17.538956 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:17.538956 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:17.538956 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:17.538956 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:17.538956 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:17.538956 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:17.538956 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:17.538956 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:17.538956 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:17.538956 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:17.538956 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:17.538956 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:17.538956 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:17.538956 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:17.538956 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:17.538956 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:17.539938 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:17.539938 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:17.539938 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:17.539938 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:17.539938 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:17.539938 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:17.539938 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:17.539938 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:17.539938 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:17.539938 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:17.539938 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:47:17.539938 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:47:17.542429 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 100/211] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:47:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:17.548221 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b48b9-cf26-4470-a6d3-8cafb1f5b9a5 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:17.558122 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359021d9-855d-4174-807e-1060e4dd4b2a None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:17.558407 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359021d9-855d-4174-807e-1060e4dd4b2a None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:17.558682 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359021d9-855d-4174-807e-1060e4dd4b2a None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:17.560069 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 101/212] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:47:17.565015 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417a2e5-2fd0-4127-9fd3-cd071ae03fa9 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:17.565326 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417a2e5-2fd0-4127-9fd3-cd071ae03fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:17.565679 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417a2e5-2fd0-4127-9fd3-cd071ae03fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:17.568519 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:17.586718 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-b417a2e5-2fd0-4127-9fd3-cd071ae03fa9 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:17.588647 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b417a2e5-2fd0-4127-9fd3-cd071ae03fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:17.670326 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b48b9-cf26-4470-a6d3-8cafb1f5b9a5 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:17.683988 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 102/213] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:47:17.699564 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417a2e5-2fd0-4127-9fd3-cd071ae03fa9 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:17.716061 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8ebf4-75e7-4bda-8b60-0fefb8bf6105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:17.717089 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8ebf4-75e7-4bda-8b60-0fefb8bf6105 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:17.717609 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8ebf4-75e7-4bda-8b60-0fefb8bf6105 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:17.718175 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8ebf4-75e7-4bda-8b60-0fefb8bf6105 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:17.719223 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe8ebf4-75e7-4bda-8b60-0fefb8bf6105 None admin] RBAC: Adding query filter params (name=member) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:17.719752 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe8ebf4-75e7-4bda-8b60-0fefb8bf6105 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:17.721445 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe8ebf4-75e7-4bda-8b60-0fefb8bf6105 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:17.731995 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 112/214] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 11 20:47:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:17.738107 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8ebf4-75e7-4bda-8b60-0fefb8bf6105 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:17.816351 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417a2e5-2fd0-4127-9fd3-cd071ae03fa9 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:17.832125 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:17.842854 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:17.851603 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e334324-91ec-491e-a161-09050076c914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:17.852449 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e334324-91ec-491e-a161-09050076c914 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:17.852742 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e334324-91ec-491e-a161-09050076c914 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:17.853043 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e334324-91ec-491e-a161-09050076c914 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:17.856847 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8ebf4-75e7-4bda-8b60-0fefb8bf6105 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:17.865121 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e334324-91ec-491e-a161-09050076c914 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:17.874014 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-6e334324-91ec-491e-a161-09050076c914 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:47:17.874014 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:17.874014 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:17.874014 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:17.874014 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:17.874014 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:17.874014 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:17.874014 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:17.874014 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:17.874014 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:17.874014 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:17.874014 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:17.874014 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:17.874014 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:17.874014 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:17.874014 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:17.875114 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:17.875114 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:17.875114 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:17.875114 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:17.875114 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:17.875114 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:17.875114 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:17.875114 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:17.875114 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:17.875114 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:17.875114 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:17.875114 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:17.875114 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:17.875114 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:17.875114 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:17.875114 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:17.875912 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:17.875912 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:17.875912 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:17.875912 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:17.875912 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:17.875912 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:17.875912 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:17.875912 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:17.875912 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:17.875912 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:17.875912 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:47:17.875912 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:47:17.877963 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 103/215] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 11 20:47:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:47:17.879331 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a95a7-7a08-4bf0-9b7f-eb9e53cd8af5 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:17.879626 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a95a7-7a08-4bf0-9b7f-eb9e53cd8af5 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:17.879906 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a95a7-7a08-4bf0-9b7f-eb9e53cd8af5 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:17.881340 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 104/216] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:17.883622 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a95a7-7a08-4bf0-9b7f-eb9e53cd8af5 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:17.898255 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ea8be-e7ca-4588-af20-3b5a13ceeafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:17.899136 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ea8be-e7ca-4588-af20-3b5a13ceeafe None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:17.899417 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ea8be-e7ca-4588-af20-3b5a13ceeafe None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:17.899688 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ea8be-e7ca-4588-af20-3b5a13ceeafe None admin] PATH_INFO: `/v3/users/b17d93f0bffe4a4ca699714336341e9e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:17.913295 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ea8be-e7ca-4588-af20-3b5a13ceeafe None admin] RBAC: Authorizing `identity:get_user(user_id=b17d93f0bffe4a4ca699714336341e9e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:17.914676 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ea8be-e7ca-4588-af20-3b5a13ceeafe None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:17.921457 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 113/217] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:47:17 2022] GET /identity/v3/users/b17d93f0bffe4a4ca699714336341e9e => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:17.921457 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859aa48-055a-43b6-aeb5-67344cdbbb87 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:17.921457 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859aa48-055a-43b6-aeb5-67344cdbbb87 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:17.921457 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859aa48-055a-43b6-aeb5-67344cdbbb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:17.936937 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-3859aa48-055a-43b6-aeb5-67344cdbbb87 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:17.938452 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-3859aa48-055a-43b6-aeb5-67344cdbbb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:17.998568 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a95a7-7a08-4bf0-9b7f-eb9e53cd8af5 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:18.008624 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 114/218] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:18.009238 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859aa48-055a-43b6-aeb5-67344cdbbb87 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:18.051930 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717be111-b031-4e5a-aa34-3f1df079db04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:18.052662 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717be111-b031-4e5a-aa34-3f1df079db04 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:18.052947 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717be111-b031-4e5a-aa34-3f1df079db04 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:18.053225 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717be111-b031-4e5a-aa34-3f1df079db04 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:18.054361 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717be111-b031-4e5a-aa34-3f1df079db04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:18.054361 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717be111-b031-4e5a-aa34-3f1df079db04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:18.055663 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717be111-b031-4e5a-aa34-3f1df079db04 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:18.065035 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 105/219] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:47:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:47:18.065035 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717be111-b031-4e5a-aa34-3f1df079db04 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:18.086717 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:18.118414 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:18.125174 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859aa48-055a-43b6-aeb5-67344cdbbb87 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:18.159782 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a03e87-6ee5-40c3-b110-ff16d78d84fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:18.160895 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a03e87-6ee5-40c3-b110-ff16d78d84fd None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:18.161191 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a03e87-6ee5-40c3-b110-ff16d78d84fd None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:18.161480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a03e87-6ee5-40c3-b110-ff16d78d84fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:18.173378 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717be111-b031-4e5a-aa34-3f1df079db04 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:18.210664 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67aee8-acdf-486d-b351-a52d38d6242a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:18.211744 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67aee8-acdf-486d-b351-a52d38d6242a None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:18.212402 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67aee8-acdf-486d-b351-a52d38d6242a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:18.213404 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67aee8-acdf-486d-b351-a52d38d6242a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:18.214914 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67aee8-acdf-486d-b351-a52d38d6242a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:18.216896 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67aee8-acdf-486d-b351-a52d38d6242a None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:18.218807 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 106/220] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:47:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:18.224966 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67aee8-acdf-486d-b351-a52d38d6242a None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:18.234266 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a03e87-6ee5-40c3-b110-ff16d78d84fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:18.235729 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a03e87-6ee5-40c3-b110-ff16d78d84fd None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:18.302730 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:18.333132 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67aee8-acdf-486d-b351-a52d38d6242a None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:18.335280 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 115/221] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:47:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:47:18.336201 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a03e87-6ee5-40c3-b110-ff16d78d84fd None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:18.352358 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:18.370039 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88dd2c2-a9be-4007-bd83-ef42f64b68e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:18.370930 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88dd2c2-a9be-4007-bd83-ef42f64b68e0 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:18.371213 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88dd2c2-a9be-4007-bd83-ef42f64b68e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:18.371492 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88dd2c2-a9be-4007-bd83-ef42f64b68e0 None admin] PATH_INFO: `/v3/users/a29e449728d941f9b691808c1f6e1716` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:18.372721 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88dd2c2-a9be-4007-bd83-ef42f64b68e0 None admin] RBAC: Authorizing `identity:get_user(user_id=a29e449728d941f9b691808c1f6e1716)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:18.374536 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88dd2c2-a9be-4007-bd83-ef42f64b68e0 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:18.376225 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 107/222] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:47:18 2022] GET /identity/v3/users/a29e449728d941f9b691808c1f6e1716 => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:18.376225 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb274f-3a66-4cc2-94c4-e82f72594771 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:18.376225 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb274f-3a66-4cc2-94c4-e82f72594771 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:18.376225 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb274f-3a66-4cc2-94c4-e82f72594771 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:18.376225 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 108/223] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:18.376225 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb274f-3a66-4cc2-94c4-e82f72594771 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:18.438720 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a03e87-6ee5-40c3-b110-ff16d78d84fd None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:18.472697 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc1b93-021c-437d-9270-22841242e887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:18.473380 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc1b93-021c-437d-9270-22841242e887 None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:18.473671 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc1b93-021c-437d-9270-22841242e887 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:18.473956 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc1b93-021c-437d-9270-22841242e887 None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:18.474668 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc1b93-021c-437d-9270-22841242e887 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:18.476142 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc1b93-021c-437d-9270-22841242e887 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:18.480746 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb274f-3a66-4cc2-94c4-e82f72594771 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:18.516135 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b5d7d-e583-48df-9fa0-715fa8d5c16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:18.517134 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b5d7d-e583-48df-9fa0-715fa8d5c16d None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:18.517428 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b5d7d-e583-48df-9fa0-715fa8d5c16d None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:18.517712 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b5d7d-e583-48df-9fa0-715fa8d5c16d None admin] PATH_INFO: `/v3/projects/549948b5ac834c07b634e08f7b1ec58d` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:18.518937 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b5d7d-e583-48df-9fa0-715fa8d5c16d None admin] RBAC: Authorizing `identity:get_project(project_id=549948b5ac834c07b634e08f7b1ec58d)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:18.520376 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b5d7d-e583-48df-9fa0-715fa8d5c16d None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:18.522144 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 109/224] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:47:18 2022] GET /identity/v3/projects/549948b5ac834c07b634e08f7b1ec58d => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:18.522913 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b5d7d-e583-48df-9fa0-715fa8d5c16d None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:18.545851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 116/225] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jul 11 20:47:18 2022] POST /identity/v3/users => generated 297 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:47:18.547119 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350bc2f-e7e0-4e9e-9cbe-4cd76312e2a2 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:18.547417 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350bc2f-e7e0-4e9e-9cbe-4cd76312e2a2 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:18.547697 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350bc2f-e7e0-4e9e-9cbe-4cd76312e2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:18.573936 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-1350bc2f-e7e0-4e9e-9cbe-4cd76312e2a2 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:18.575635 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-1350bc2f-e7e0-4e9e-9cbe-4cd76312e2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:18.586906 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:18.597544 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:18.643382 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b5d7d-e583-48df-9fa0-715fa8d5c16d None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:18.654115 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 117/226] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:18.654918 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350bc2f-e7e0-4e9e-9cbe-4cd76312e2a2 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:18.701296 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda1a91-78e5-4630-9f0d-4b9ccf421152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:18.702981 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda1a91-78e5-4630-9f0d-4b9ccf421152 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:18.702981 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda1a91-78e5-4630-9f0d-4b9ccf421152 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:18.702981 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda1a91-78e5-4630-9f0d-4b9ccf421152 None admin] PATH_INFO: `/v3/projects/549948b5ac834c07b634e08f7b1ec58d` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:18.704615 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda1a91-78e5-4630-9f0d-4b9ccf421152 None admin] RBAC: Authorizing `identity:get_project(project_id=549948b5ac834c07b634e08f7b1ec58d)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:18.706330 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda1a91-78e5-4630-9f0d-4b9ccf421152 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:18.708291 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 110/227] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:47:18 2022] GET /identity/v3/projects/549948b5ac834c07b634e08f7b1ec58d => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:18.708911 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda1a91-78e5-4630-9f0d-4b9ccf421152 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:18.784286 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350bc2f-e7e0-4e9e-9cbe-4cd76312e2a2 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:18.828218 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda1a91-78e5-4630-9f0d-4b9ccf421152 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:18.841501 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a8a08-43f2-4c36-8115-3c9fe4de0b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:18.842549 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a8a08-43f2-4c36-8115-3c9fe4de0b81 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:18.842845 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a8a08-43f2-4c36-8115-3c9fe4de0b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:18.843134 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a8a08-43f2-4c36-8115-3c9fe4de0b81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:18.844014 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575a8a08-43f2-4c36-8115-3c9fe4de0b81 None admin] RBAC: Adding query filter params (role.id=cf0f875ea1ba45758bd4f52a845d807e, scope.project.id=549948b5ac834c07b634e08f7b1ec58d, user.id=b17d93f0bffe4a4ca699714336341e9e) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:18.844348 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575a8a08-43f2-4c36-8115-3c9fe4de0b81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:18.845827 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575a8a08-43f2-4c36-8115-3c9fe4de0b81 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:18.854480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 118/228] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:47:18 2022] GET /identity/v3/role_assignments?user.id=b17d93f0bffe4a4ca699714336341e9e&scope.project.id=549948b5ac834c07b634e08f7b1ec58d&role.id=cf0f875ea1ba45758bd4f52a845d807e => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:18.855647 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a8a08-43f2-4c36-8115-3c9fe4de0b81 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:18.868471 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:18.881321 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:18.885673 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f17694-a207-4451-8304-2497122fad4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:18.887012 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f17694-a207-4451-8304-2497122fad4d None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:18.887519 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f17694-a207-4451-8304-2497122fad4d None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:18.888275 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f17694-a207-4451-8304-2497122fad4d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:18.902500 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f17694-a207-4451-8304-2497122fad4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:18.911600 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-57f17694-a207-4451-8304-2497122fad4d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:47:18.911600 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:18.911600 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:18.911600 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:18.911600 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:18.911600 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:18.911600 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:18.911600 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:18.911600 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:18.911600 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:18.911600 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:18.911600 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:18.911600 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:18.911600 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:18.911600 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:18.911600 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:18.912636 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:18.912636 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:18.912636 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:18.912636 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:18.912636 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:18.912636 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:18.912636 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:18.912636 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:18.912636 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:18.912636 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:18.912636 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:18.912636 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:18.912636 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:18.912636 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:18.912636 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:18.912636 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:18.913435 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:18.913435 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:18.913435 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:18.913435 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:18.913435 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:18.913435 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:18.913435 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:18.913435 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:18.913435 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:18.913435 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:18.913435 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:47:18.913435 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:47:18.916203 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 111/229] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jul 11 20:47:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:18.923208 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f17694-a207-4451-8304-2497122fad4d None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:18.992404 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a8a08-43f2-4c36-8115-3c9fe4de0b81 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:19.068160 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe0457-0ee5-4a36-937d-562f7a949f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:19.069822 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe0457-0ee5-4a36-937d-562f7a949f0a None admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:19.070303 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe0457-0ee5-4a36-937d-562f7a949f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:19.070824 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe0457-0ee5-4a36-937d-562f7a949f0a None admin] PATH_INFO: `/v3/projects/549948b5ac834c07b634e08f7b1ec58d/users/a29e449728d941f9b691808c1f6e1716/roles/86273ff072f3438d822e870272491768` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:19.074082 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe0457-0ee5-4a36-937d-562f7a949f0a None admin] RBAC: Authorizing `identity:create_grant(project_id=549948b5ac834c07b634e08f7b1ec58d, user_id=a29e449728d941f9b691808c1f6e1716, role_id=86273ff072f3438d822e870272491768)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:19.075877 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe0457-0ee5-4a36-937d-562f7a949f0a None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:19.084939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f17694-a207-4451-8304-2497122fad4d None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:19.120039 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eafda5-47b8-4392-b98b-ff86b1a51091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:19.120743 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eafda5-47b8-4392-b98b-ff86b1a51091 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:19.121035 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eafda5-47b8-4392-b98b-ff86b1a51091 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:19.121316 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eafda5-47b8-4392-b98b-ff86b1a51091 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:19.122445 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eafda5-47b8-4392-b98b-ff86b1a51091 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:19.122767 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eafda5-47b8-4392-b98b-ff86b1a51091 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:19.124428 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eafda5-47b8-4392-b98b-ff86b1a51091 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:19.134024 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 119/230] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 11 20:47:18 2022] PUT /identity/v3/projects/549948b5ac834c07b634e08f7b1ec58d/users/a29e449728d941f9b691808c1f6e1716/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:47:19.135255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 112/231] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:47:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:47:19.145670 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe0457-0ee5-4a36-937d-562f7a949f0a None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:19.252857 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:19.279872 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe0457-0ee5-4a36-937d-562f7a949f0a None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:19.319090 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa65a9b-fb42-4dc1-a823-19d4c1b1dc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:19.320232 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa65a9b-fb42-4dc1-a823-19d4c1b1dc9e None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:19.320639 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa65a9b-fb42-4dc1-a823-19d4c1b1dc9e None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:19.321021 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa65a9b-fb42-4dc1-a823-19d4c1b1dc9e None admin] PATH_INFO: `/v3/users/a29e449728d941f9b691808c1f6e1716` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:19.322977 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa65a9b-fb42-4dc1-a823-19d4c1b1dc9e None admin] RBAC: Authorizing `identity:get_user(user_id=a29e449728d941f9b691808c1f6e1716)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:19.324688 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa65a9b-fb42-4dc1-a823-19d4c1b1dc9e None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:19.326783 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 120/232] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:47:19 2022] GET /identity/v3/users/a29e449728d941f9b691808c1f6e1716 => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:19.332462 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eafda5-47b8-4392-b98b-ff86b1a51091 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:19.390393 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:19.456370 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eafda5-47b8-4392-b98b-ff86b1a51091 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:19.504800 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f82378-ae2d-419a-ae65-7c53853b7313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:19.505606 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f82378-ae2d-419a-ae65-7c53853b7313 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:19.505890 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f82378-ae2d-419a-ae65-7c53853b7313 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:19.506170 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f82378-ae2d-419a-ae65-7c53853b7313 None admin] PATH_INFO: `/v3/projects/549948b5ac834c07b634e08f7b1ec58d` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:19.507412 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f82378-ae2d-419a-ae65-7c53853b7313 None admin] RBAC: Authorizing `identity:get_project(project_id=549948b5ac834c07b634e08f7b1ec58d)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:19.508893 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f82378-ae2d-419a-ae65-7c53853b7313 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:19.511649 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 113/233] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:47:19 2022] GET /identity/v3/projects/549948b5ac834c07b634e08f7b1ec58d => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:19.517368 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa65a9b-fb42-4dc1-a823-19d4c1b1dc9e None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:19.634984 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa65a9b-fb42-4dc1-a823-19d4c1b1dc9e None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:19.670238 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31531a3a-765d-4612-b3aa-e0b6a15e259c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:19.671205 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31531a3a-765d-4612-b3aa-e0b6a15e259c None admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:19.671591 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31531a3a-765d-4612-b3aa-e0b6a15e259c None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:19.671986 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31531a3a-765d-4612-b3aa-e0b6a15e259c None admin] PATH_INFO: `/v3/projects/549948b5ac834c07b634e08f7b1ec58d/users/a29e449728d941f9b691808c1f6e1716/roles/c2117c810f7b4e6aaf684c3d37b0ea3e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:19.674354 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31531a3a-765d-4612-b3aa-e0b6a15e259c None admin] RBAC: Authorizing `identity:create_grant(project_id=549948b5ac834c07b634e08f7b1ec58d, user_id=a29e449728d941f9b691808c1f6e1716, role_id=c2117c810f7b4e6aaf684c3d37b0ea3e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:19.675916 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31531a3a-765d-4612-b3aa-e0b6a15e259c None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:19.786376 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 121/234] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 11 20:47:19 2022] PUT /identity/v3/projects/549948b5ac834c07b634e08f7b1ec58d/users/a29e449728d941f9b691808c1f6e1716/roles/c2117c810f7b4e6aaf684c3d37b0ea3e => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:47:21.177411 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f945e-2bd4-44ad-8b54-1870b08b53d1 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:21.177925 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f945e-2bd4-44ad-8b54-1870b08b53d1 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:21.177999 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f945e-2bd4-44ad-8b54-1870b08b53d1 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:21.179351 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 114/235] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:21.184979 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c49057-b858-4ade-99fe-fe716a926271 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:21.185409 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c49057-b858-4ade-99fe-fe716a926271 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:21.185582 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c49057-b858-4ade-99fe-fe716a926271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:21.191629 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:21.208754 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-20c49057-b858-4ade-99fe-fe716a926271 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:21.209993 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-20c49057-b858-4ade-99fe-fe716a926271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:21.248916 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a961a8f-6f36-4e66-9f7f-128db0d756f9 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:21.249463 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a961a8f-6f36-4e66-9f7f-128db0d756f9 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:21.249749 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a961a8f-6f36-4e66-9f7f-128db0d756f9 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:21.251361 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 115/236] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:21.256756 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808dbd96-9756-4f0c-85b8-9f02d5e65ae8 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:21.257043 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808dbd96-9756-4f0c-85b8-9f02d5e65ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:21.257323 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808dbd96-9756-4f0c-85b8-9f02d5e65ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:21.293789 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-808dbd96-9756-4f0c-85b8-9f02d5e65ae8 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:21.294987 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-808dbd96-9756-4f0c-85b8-9f02d5e65ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:21.300069 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 122/237] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:21.310830 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1aa96-538d-4be2-a94f-f1d396f6af5a None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:21.311114 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1aa96-538d-4be2-a94f-f1d396f6af5a None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:21.311397 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1aa96-538d-4be2-a94f-f1d396f6af5a None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:21.312747 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 123/238] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:21.318809 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df60e7c-2469-43be-aa3f-ff3c1ebbfeeb None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:21.319100 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df60e7c-2469-43be-aa3f-ff3c1ebbfeeb None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:21.319378 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df60e7c-2469-43be-aa3f-ff3c1ebbfeeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:21.342077 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-5df60e7c-2469-43be-aa3f-ff3c1ebbfeeb None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:21.343761 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-5df60e7c-2469-43be-aa3f-ff3c1ebbfeeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:21.381934 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 116/239] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:21.382597 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808dbd96-9756-4f0c-85b8-9f02d5e65ae8 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:21.426662 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:21.443232 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 124/240] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:21.443232 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df60e7c-2469-43be-aa3f-ff3c1ebbfeeb None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:21.516516 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:21.519398 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808dbd96-9756-4f0c-85b8-9f02d5e65ae8 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:21.559874 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df60e7c-2469-43be-aa3f-ff3c1ebbfeeb None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:21.560114 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9176bbf-9aac-4ad9-a10f-a3edf88fb235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:21.560836 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9176bbf-9aac-4ad9-a10f-a3edf88fb235 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:21.561275 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9176bbf-9aac-4ad9-a10f-a3edf88fb235 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:21.561633 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9176bbf-9aac-4ad9-a10f-a3edf88fb235 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:21.573817 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9176bbf-9aac-4ad9-a10f-a3edf88fb235 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:21.582377 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-e9176bbf-9aac-4ad9-a10f-a3edf88fb235 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 20:47:21.582377 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:21.582377 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:21.582377 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:21.582377 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:21.582377 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:21.582377 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:21.582377 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:21.582377 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:21.582377 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:21.582377 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:21.582377 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:21.582377 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:21.582377 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:21.582377 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:21.582377 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:21.583317 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:21.583317 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:21.583317 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:21.583317 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:21.583317 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:21.583317 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:21.583317 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:21.583317 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:21.583317 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:21.583317 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:21.583317 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:21.583317 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:21.583317 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:21.583317 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:21.583317 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:21.583317 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:21.584161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:21.584161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:21.584161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:21.584161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:21.584161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:21.584161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:21.584161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:21.584161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:21.584161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:21.584161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:21.584161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 20:47:21.584161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:47:21.584161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 117/241] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:47:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:21.585556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9176bbf-9aac-4ad9-a10f-a3edf88fb235 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:21.599031 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c8063-041b-41d2-bb9c-268d718e2126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:21.599842 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c8063-041b-41d2-bb9c-268d718e2126 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:21.600160 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c8063-041b-41d2-bb9c-268d718e2126 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:21.600440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c8063-041b-41d2-bb9c-268d718e2126 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:21.601628 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c8063-041b-41d2-bb9c-268d718e2126 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:21.603087 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c8063-041b-41d2-bb9c-268d718e2126 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:21.604943 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 125/242] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:47:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:21.608014 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cbc1d-2e55-42a2-9e3a-7c2772524a78 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:21.608014 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cbc1d-2e55-42a2-9e3a-7c2772524a78 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:21.608014 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cbc1d-2e55-42a2-9e3a-7c2772524a78 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:21.608014 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 126/243] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:21.608645 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cbc1d-2e55-42a2-9e3a-7c2772524a78 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:21.703743 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9176bbf-9aac-4ad9-a10f-a3edf88fb235 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:21.705312 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:21.731198 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cbc1d-2e55-42a2-9e3a-7c2772524a78 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:21.739577 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3019c6c-8cbb-44a2-8713-533570705116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:21.740787 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3019c6c-8cbb-44a2-8713-533570705116 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:21.741080 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3019c6c-8cbb-44a2-8713-533570705116 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:21.741360 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3019c6c-8cbb-44a2-8713-533570705116 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:21.752858 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3019c6c-8cbb-44a2-8713-533570705116 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:21.760869 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-b3019c6c-8cbb-44a2-8713-533570705116 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:47:21.760869 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:21.760869 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:21.760869 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:21.760869 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:21.760869 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:21.760869 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:21.760869 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:21.760869 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:21.760869 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:21.760869 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:21.760869 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:21.760869 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:21.760869 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:21.760869 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:21.760869 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:21.761926 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:21.761926 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:21.761926 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:21.761926 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:21.761926 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:21.761926 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:21.761926 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:21.761926 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:21.761926 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:21.761926 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:21.761926 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:21.761926 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:21.761926 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:21.761926 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:21.761926 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:21.761926 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:21.767784 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:21.767784 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:21.767784 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:21.767784 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:21.767784 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:21.767784 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:21.767784 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:21.767784 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:21.767784 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:21.767784 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:21.767784 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:47:21.767784 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:47:21.767784 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 118/244] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:47:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:21.767784 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3019c6c-8cbb-44a2-8713-533570705116 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:21.771583 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:21.777440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881635e-6540-4bd3-a0b6-2a8d7a58383f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:21.778150 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881635e-6540-4bd3-a0b6-2a8d7a58383f None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:21.778546 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881635e-6540-4bd3-a0b6-2a8d7a58383f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:21.778827 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881635e-6540-4bd3-a0b6-2a8d7a58383f None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:21.779579 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881635e-6540-4bd3-a0b6-2a8d7a58383f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:21.779892 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881635e-6540-4bd3-a0b6-2a8d7a58383f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:21.783378 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881635e-6540-4bd3-a0b6-2a8d7a58383f None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:21.795141 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 127/245] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 11 20:47:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:21.795141 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a5306-905f-4d44-861b-84516328f01f None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:21.795141 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a5306-905f-4d44-861b-84516328f01f None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:21.795141 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a5306-905f-4d44-861b-84516328f01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:21.810026 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-692a5306-905f-4d44-861b-84516328f01f None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:21.811266 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-692a5306-905f-4d44-861b-84516328f01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:21.872992 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3019c6c-8cbb-44a2-8713-533570705116 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:21.892233 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 128/246] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:21.892964 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a5306-905f-4d44-861b-84516328f01f None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:21.909627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d14e2-a2db-41b6-9e4f-4b95355117d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:21.910301 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d14e2-a2db-41b6-9e4f-4b95355117d2 None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:21.910587 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d14e2-a2db-41b6-9e4f-4b95355117d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:21.910863 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d14e2-a2db-41b6-9e4f-4b95355117d2 None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:21.911571 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d14e2-a2db-41b6-9e4f-4b95355117d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:21.913058 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d14e2-a2db-41b6-9e4f-4b95355117d2 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:22.003752 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a5306-905f-4d44-861b-84516328f01f None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:22.014325 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 119/247] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jul 11 20:47:21 2022] POST /identity/v3/users => generated 293 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:47:22.015425 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d14e2-a2db-41b6-9e4f-4b95355117d2 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:22.037170 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:22.054547 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:22.058277 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06951a45-7d07-4842-badc-83e8d5d5b9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:22.060150 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06951a45-7d07-4842-badc-83e8d5d5b9d9 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:22.060826 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06951a45-7d07-4842-badc-83e8d5d5b9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:22.061361 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06951a45-7d07-4842-badc-83e8d5d5b9d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:22.062431 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06951a45-7d07-4842-badc-83e8d5d5b9d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:22.062928 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06951a45-7d07-4842-badc-83e8d5d5b9d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:22.065867 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06951a45-7d07-4842-badc-83e8d5d5b9d9 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:22.086692 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 129/248] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 11 20:47:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:22.087585 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06951a45-7d07-4842-badc-83e8d5d5b9d9 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:22.172417 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d14e2-a2db-41b6-9e4f-4b95355117d2 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:22.216952 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06951a45-7d07-4842-badc-83e8d5d5b9d9 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:22.225696 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be589663-3821-4eb7-93b1-2707dd0984de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:22.227070 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be589663-3821-4eb7-93b1-2707dd0984de None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:22.227500 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be589663-3821-4eb7-93b1-2707dd0984de None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:22.227931 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be589663-3821-4eb7-93b1-2707dd0984de None admin] PATH_INFO: `/v3/users/b8d0037c1d8e4253995c84c6aeee7738` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:22.247943 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be589663-3821-4eb7-93b1-2707dd0984de None admin] RBAC: Authorizing `identity:get_user(user_id=b8d0037c1d8e4253995c84c6aeee7738)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:22.249696 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be589663-3821-4eb7-93b1-2707dd0984de None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:22.251582 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 120/249] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:47:22 2022] GET /identity/v3/users/b8d0037c1d8e4253995c84c6aeee7738 => generated 297 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:22.252213 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be589663-3821-4eb7-93b1-2707dd0984de None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:22.262900 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa756f62-6676-410a-9988-eed4b969b983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:22.263771 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa756f62-6676-410a-9988-eed4b969b983 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:22.264098 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa756f62-6676-410a-9988-eed4b969b983 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:22.264631 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa756f62-6676-410a-9988-eed4b969b983 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:22.279420 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa756f62-6676-410a-9988-eed4b969b983 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:22.287402 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-aa756f62-6676-410a-9988-eed4b969b983 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:47:22.287402 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:22.287402 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:22.287402 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:22.287402 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:22.287402 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:22.287402 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:22.287402 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:22.287402 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:22.287402 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:22.287402 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:22.287402 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:22.287402 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:22.287402 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:22.287402 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:22.287402 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:22.288508 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:22.288508 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:22.288508 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:22.288508 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:22.288508 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:22.288508 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:22.288508 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:22.288508 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:22.288508 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:22.288508 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:22.288508 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:22.288508 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:22.288508 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:22.288508 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:22.288508 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:22.288508 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:22.289520 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:22.289520 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:22.289520 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:22.289520 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:22.289520 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:22.289520 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:22.289520 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:22.289520 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:22.289520 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:22.289520 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:22.289520 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:47:22.289520 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:47:22.289520 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 130/250] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 11 20:47:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:22.290331 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa756f62-6676-410a-9988-eed4b969b983 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:22.354891 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:22.362317 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:22.396491 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be589663-3821-4eb7-93b1-2707dd0984de None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:22.426784 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa756f62-6676-410a-9988-eed4b969b983 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:22.442358 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efda57c-6fd3-46c5-908b-3c1e5a808f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:22.444282 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efda57c-6fd3-46c5-908b-3c1e5a808f63 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:22.444815 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efda57c-6fd3-46c5-908b-3c1e5a808f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:22.445236 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efda57c-6fd3-46c5-908b-3c1e5a808f63 None admin] PATH_INFO: `/v3/users/b17d93f0bffe4a4ca699714336341e9e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:22.446882 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efda57c-6fd3-46c5-908b-3c1e5a808f63 None admin] RBAC: Authorizing `identity:get_user(user_id=b17d93f0bffe4a4ca699714336341e9e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:22.449330 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efda57c-6fd3-46c5-908b-3c1e5a808f63 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:22.452254 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 121/251] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:47:22 2022] GET /identity/v3/users/b17d93f0bffe4a4ca699714336341e9e => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:22.454640 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efda57c-6fd3-46c5-908b-3c1e5a808f63 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:22.477820 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472968c9-35b2-4b99-a5c4-01a6fe294b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:22.478844 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472968c9-35b2-4b99-a5c4-01a6fe294b98 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:22.479335 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472968c9-35b2-4b99-a5c4-01a6fe294b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:22.479880 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472968c9-35b2-4b99-a5c4-01a6fe294b98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:22.554715 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472968c9-35b2-4b99-a5c4-01a6fe294b98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:22.557150 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472968c9-35b2-4b99-a5c4-01a6fe294b98 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:22.565633 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efda57c-6fd3-46c5-908b-3c1e5a808f63 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:22.608161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd40a1-e1ca-4625-9e0b-794fece0fc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:22.609241 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd40a1-e1ca-4625-9e0b-794fece0fc52 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:22.609758 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd40a1-e1ca-4625-9e0b-794fece0fc52 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:22.610255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd40a1-e1ca-4625-9e0b-794fece0fc52 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:22.611209 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd40a1-e1ca-4625-9e0b-794fece0fc52 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:22.611727 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd40a1-e1ca-4625-9e0b-794fece0fc52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:22.613340 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd40a1-e1ca-4625-9e0b-794fece0fc52 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:22.622877 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 122/252] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:47:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:22.623337 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:22.624644 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd40a1-e1ca-4625-9e0b-794fece0fc52 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:22.634457 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:22.703112 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 131/253] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:47:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:47:22.704695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412cfce-9ee3-42f1-9707-d2b8b369fddb None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:22.705445 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412cfce-9ee3-42f1-9707-d2b8b369fddb None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:22.705955 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412cfce-9ee3-42f1-9707-d2b8b369fddb None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:22.707453 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 132/254] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:22.712021 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412cfce-9ee3-42f1-9707-d2b8b369fddb None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:22.757523 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd40a1-e1ca-4625-9e0b-794fece0fc52 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:22.794920 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd2547-8d51-439e-8001-c697d6232ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:22.796249 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd2547-8d51-439e-8001-c697d6232ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:22.796739 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd2547-8d51-439e-8001-c697d6232ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:22.797218 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd2547-8d51-439e-8001-c697d6232ab1 None admin] PATH_INFO: `/v3/projects/549948b5ac834c07b634e08f7b1ec58d` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:22.799146 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabd2547-8d51-439e-8001-c697d6232ab1 None admin] RBAC: Authorizing `identity:get_project(project_id=549948b5ac834c07b634e08f7b1ec58d)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:22.801341 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabd2547-8d51-439e-8001-c697d6232ab1 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:22.809547 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 123/255] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:47:22 2022] GET /identity/v3/projects/549948b5ac834c07b634e08f7b1ec58d => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:22.809547 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd2547-8d51-439e-8001-c697d6232ab1 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:22.837135 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412cfce-9ee3-42f1-9707-d2b8b369fddb None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:22.882501 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e9dbd-b783-4519-9513-2e8fd13521f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:22.884652 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e9dbd-b783-4519-9513-2e8fd13521f0 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:22.885283 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e9dbd-b783-4519-9513-2e8fd13521f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:22.885909 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e9dbd-b783-4519-9513-2e8fd13521f0 None admin] PATH_INFO: `/v3/users/a29e449728d941f9b691808c1f6e1716` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:22.888319 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e9dbd-b783-4519-9513-2e8fd13521f0 None admin] RBAC: Authorizing `identity:get_user(user_id=a29e449728d941f9b691808c1f6e1716)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:22.889974 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e9dbd-b783-4519-9513-2e8fd13521f0 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:22.892111 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 133/256] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:47:22 2022] GET /identity/v3/users/a29e449728d941f9b691808c1f6e1716 => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:22.892863 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:22.894101 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91766e-16eb-4265-ac0d-4c4ec50560eb None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:22.894560 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91766e-16eb-4265-ac0d-4c4ec50560eb None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:22.894938 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91766e-16eb-4265-ac0d-4c4ec50560eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:22.917521 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-de91766e-16eb-4265-ac0d-4c4ec50560eb None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:22.919290 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-de91766e-16eb-4265-ac0d-4c4ec50560eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:22.920494 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd2547-8d51-439e-8001-c697d6232ab1 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:22.930838 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:22.968045 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38170d63-6d91-426e-8633-e6f1d4306b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:22.969075 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38170d63-6d91-426e-8633-e6f1d4306b4a None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:22.969463 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38170d63-6d91-426e-8633-e6f1d4306b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:22.969860 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38170d63-6d91-426e-8633-e6f1d4306b4a None admin] PATH_INFO: `/v3/projects/549948b5ac834c07b634e08f7b1ec58d` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:22.971190 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38170d63-6d91-426e-8633-e6f1d4306b4a None admin] RBAC: Authorizing `identity:get_project(project_id=549948b5ac834c07b634e08f7b1ec58d)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:22.973261 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38170d63-6d91-426e-8633-e6f1d4306b4a None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:22.975465 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 124/257] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:47:22 2022] GET /identity/v3/projects/549948b5ac834c07b634e08f7b1ec58d => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:22.976766 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38170d63-6d91-426e-8633-e6f1d4306b4a None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:23.005110 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 134/258] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:23.006019 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91766e-16eb-4265-ac0d-4c4ec50560eb None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:23.101067 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38170d63-6d91-426e-8633-e6f1d4306b4a None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:23.129284 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91766e-16eb-4265-ac0d-4c4ec50560eb None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:23.136383 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af1d59-f3de-4f44-afcc-2ac7eabb8424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:23.137345 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af1d59-f3de-4f44-afcc-2ac7eabb8424 None admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:23.137631 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af1d59-f3de-4f44-afcc-2ac7eabb8424 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:23.137909 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af1d59-f3de-4f44-afcc-2ac7eabb8424 None admin] PATH_INFO: `/v3/projects/549948b5ac834c07b634e08f7b1ec58d/users/b17d93f0bffe4a4ca699714336341e9e/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:23.139892 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35af1d59-f3de-4f44-afcc-2ac7eabb8424 None admin] RBAC: Authorizing `identity:create_grant(project_id=549948b5ac834c07b634e08f7b1ec58d, user_id=b17d93f0bffe4a4ca699714336341e9e, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:23.141380 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35af1d59-f3de-4f44-afcc-2ac7eabb8424 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:23.166955 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c6bd06-734b-42c8-a8b8-e2226df3e1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:23.167610 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6bd06-734b-42c8-a8b8-e2226df3e1c6 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:23.167894 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6bd06-734b-42c8-a8b8-e2226df3e1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:23.168202 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6bd06-734b-42c8-a8b8-e2226df3e1c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:23.183679 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:23.212053 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 125/259] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 11 20:47:22 2022] PUT /identity/v3/projects/549948b5ac834c07b634e08f7b1ec58d/users/b17d93f0bffe4a4ca699714336341e9e/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:47:23.213232 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af1d59-f3de-4f44-afcc-2ac7eabb8424 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:23.223151 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:23.270189 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c6bd06-734b-42c8-a8b8-e2226df3e1c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:23.271774 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c6bd06-734b-42c8-a8b8-e2226df3e1c6 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:23.402299 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af1d59-f3de-4f44-afcc-2ac7eabb8424 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:23.461329 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ac094-6774-423d-bbab-a73f98aaf9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:23.462333 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ac094-6774-423d-bbab-a73f98aaf9fa None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:23.462635 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ac094-6774-423d-bbab-a73f98aaf9fa None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:23.463458 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ac094-6774-423d-bbab-a73f98aaf9fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:23.464888 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ac094-6774-423d-bbab-a73f98aaf9fa None admin] RBAC: Adding query filter params (role.id=3a94b407c6914e15a379d3580c9c9ddf, scope.project.id=549948b5ac834c07b634e08f7b1ec58d, user.id=b8d0037c1d8e4253995c84c6aeee7738) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:23.465221 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ac094-6774-423d-bbab-a73f98aaf9fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:23.466978 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ac094-6774-423d-bbab-a73f98aaf9fa None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:23.468607 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 135/260] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:47:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:47:23.469577 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c6bd06-734b-42c8-a8b8-e2226df3e1c6 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:23.473547 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 126/261] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:47:23 2022] GET /identity/v3/role_assignments?user.id=b8d0037c1d8e4253995c84c6aeee7738&scope.project.id=549948b5ac834c07b634e08f7b1ec58d&role.id=3a94b407c6914e15a379d3580c9c9ddf => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:23.477863 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ac094-6774-423d-bbab-a73f98aaf9fa None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:23.537424 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:23.569054 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:23.602130 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c6bd06-734b-42c8-a8b8-e2226df3e1c6 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:23.624503 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ac094-6774-423d-bbab-a73f98aaf9fa None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:23.640496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d24af6-e25d-4e0f-9755-64d801f409d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:23.641338 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d24af6-e25d-4e0f-9755-64d801f409d7 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:23.641623 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d24af6-e25d-4e0f-9755-64d801f409d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:23.641898 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d24af6-e25d-4e0f-9755-64d801f409d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:23.656925 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d24af6-e25d-4e0f-9755-64d801f409d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:23.670686 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f69de9-05c5-4fbf-ba3f-87043dd79f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:23.671861 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f69de9-05c5-4fbf-ba3f-87043dd79f1b None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:23.672192 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f69de9-05c5-4fbf-ba3f-87043dd79f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:23.672481 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f69de9-05c5-4fbf-ba3f-87043dd79f1b None admin] PATH_INFO: `/v3/projects/549948b5ac834c07b634e08f7b1ec58d` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:23.673532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-d8d24af6-e25d-4e0f-9755-64d801f409d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:47:23.673532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:23.673532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:23.673532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:23.673532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:23.673532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:23.673532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:23.673532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:23.673532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:23.673532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:23.673532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:23.673532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:23.673532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:23.673532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:23.673532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:23.673532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:23.674595 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:23.674595 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:23.674595 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:23.674595 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:23.674595 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:23.674595 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:23.674595 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:23.674595 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:23.674595 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:23.674595 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:23.674595 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:23.674595 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:23.674595 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:23.674595 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:23.674595 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:23.674595 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:23.675489 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:23.675489 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:23.675489 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:23.675489 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:23.675489 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:23.675489 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:23.675489 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:23.675489 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:23.675489 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:23.675489 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:23.675489 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:47:23.675489 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:47:23.676118 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f69de9-05c5-4fbf-ba3f-87043dd79f1b None admin] RBAC: Authorizing `identity:get_project(project_id=549948b5ac834c07b634e08f7b1ec58d)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:23.676118 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f69de9-05c5-4fbf-ba3f-87043dd79f1b None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:23.677327 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 127/262] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:47:23 2022] GET /identity/v3/projects/549948b5ac834c07b634e08f7b1ec58d => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:23.677801 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 136/263] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jul 11 20:47:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:23.685074 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f69de9-05c5-4fbf-ba3f-87043dd79f1b None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:23.685267 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d24af6-e25d-4e0f-9755-64d801f409d7 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:23.825375 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f69de9-05c5-4fbf-ba3f-87043dd79f1b None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:23.835894 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d24af6-e25d-4e0f-9755-64d801f409d7 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:23.841021 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:23.863067 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57914c76-4468-4532-a6ef-4aea60fe9378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:23.864001 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57914c76-4468-4532-a6ef-4aea60fe9378 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:23.864439 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57914c76-4468-4532-a6ef-4aea60fe9378 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:23.864867 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57914c76-4468-4532-a6ef-4aea60fe9378 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:23.865887 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57914c76-4468-4532-a6ef-4aea60fe9378 None admin] RBAC: Adding query filter params (role.id=86273ff072f3438d822e870272491768, scope.project.id=549948b5ac834c07b634e08f7b1ec58d, user.id=a29e449728d941f9b691808c1f6e1716) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:23.866368 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57914c76-4468-4532-a6ef-4aea60fe9378 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:23.867982 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57914c76-4468-4532-a6ef-4aea60fe9378 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:23.871346 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:23.880610 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 128/264] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:47:23 2022] GET /identity/v3/role_assignments?user.id=a29e449728d941f9b691808c1f6e1716&scope.project.id=549948b5ac834c07b634e08f7b1ec58d&role.id=86273ff072f3438d822e870272491768 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:23.905722 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc3c62-8b9c-42d0-a5de-826d3a544461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:23.906430 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc3c62-8b9c-42d0-a5de-826d3a544461 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:23.906769 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc3c62-8b9c-42d0-a5de-826d3a544461 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:23.907151 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc3c62-8b9c-42d0-a5de-826d3a544461 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:23.907859 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc3c62-8b9c-42d0-a5de-826d3a544461 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:23.908197 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc3c62-8b9c-42d0-a5de-826d3a544461 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:23.909585 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc3c62-8b9c-42d0-a5de-826d3a544461 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:23.923499 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 137/265] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:47:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:23.929400 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57914c76-4468-4532-a6ef-4aea60fe9378 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:24.071558 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57914c76-4468-4532-a6ef-4aea60fe9378 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:24.109553 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66276d02-3a5e-49a8-ad70-e95893b2307d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:24.110463 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66276d02-3a5e-49a8-ad70-e95893b2307d None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:24.110753 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66276d02-3a5e-49a8-ad70-e95893b2307d None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:24.111036 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66276d02-3a5e-49a8-ad70-e95893b2307d None admin] PATH_INFO: `/v3/users/a29e449728d941f9b691808c1f6e1716` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:24.112323 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66276d02-3a5e-49a8-ad70-e95893b2307d None admin] RBAC: Authorizing `identity:get_user(user_id=a29e449728d941f9b691808c1f6e1716)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:24.113801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66276d02-3a5e-49a8-ad70-e95893b2307d None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:24.115473 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 129/266] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:47:23 2022] GET /identity/v3/users/a29e449728d941f9b691808c1f6e1716 => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:24.121139 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc3c62-8b9c-42d0-a5de-826d3a544461 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:24.280371 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc3c62-8b9c-42d0-a5de-826d3a544461 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:24.333984 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e1023-7b65-4d8f-801f-a7a2adb1ab35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:24.334646 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e1023-7b65-4d8f-801f-a7a2adb1ab35 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:24.334929 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e1023-7b65-4d8f-801f-a7a2adb1ab35 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:24.335206 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e1023-7b65-4d8f-801f-a7a2adb1ab35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:24.372752 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:24.413354 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e1023-7b65-4d8f-801f-a7a2adb1ab35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:24.414842 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e1023-7b65-4d8f-801f-a7a2adb1ab35 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:24.535028 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 138/267] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:47:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:47:24.540661 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66276d02-3a5e-49a8-ad70-e95893b2307d None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:24.623202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:24.663910 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66276d02-3a5e-49a8-ad70-e95893b2307d None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:24.698881 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da01e9-8f08-4c9a-acaf-0ee15cc84f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:24.699772 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da01e9-8f08-4c9a-acaf-0ee15cc84f35 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:24.700082 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da01e9-8f08-4c9a-acaf-0ee15cc84f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:24.700365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da01e9-8f08-4c9a-acaf-0ee15cc84f35 None admin] PATH_INFO: `/v3/projects/549948b5ac834c07b634e08f7b1ec58d` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:24.701582 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da01e9-8f08-4c9a-acaf-0ee15cc84f35 None admin] RBAC: Authorizing `identity:get_project(project_id=549948b5ac834c07b634e08f7b1ec58d)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:24.703051 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da01e9-8f08-4c9a-acaf-0ee15cc84f35 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:24.704803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 130/268] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:47:24 2022] GET /identity/v3/projects/549948b5ac834c07b634e08f7b1ec58d => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:24.710839 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e1023-7b65-4d8f-801f-a7a2adb1ab35 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:24.828062 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:24.844460 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c7597-12c9-4f10-ab4c-5aa1d810f158 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:24.845083 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c7597-12c9-4f10-ab4c-5aa1d810f158 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:24.845559 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c7597-12c9-4f10-ab4c-5aa1d810f158 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:24.847134 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 131/269] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:47:24.852128 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661bcf7-bd3b-47a7-a40a-d88a48a5f356 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:24.852638 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661bcf7-bd3b-47a7-a40a-d88a48a5f356 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:24.853139 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661bcf7-bd3b-47a7-a40a-d88a48a5f356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:24.870754 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-d661bcf7-bd3b-47a7-a40a-d88a48a5f356 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:24.872300 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d661bcf7-bd3b-47a7-a40a-d88a48a5f356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:24.877561 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e1023-7b65-4d8f-801f-a7a2adb1ab35 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:24.926735 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62d495-7fcb-4189-a595-9bf7a655f4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:24.927911 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62d495-7fcb-4189-a595-9bf7a655f4d4 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:24.928371 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62d495-7fcb-4189-a595-9bf7a655f4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:24.928954 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62d495-7fcb-4189-a595-9bf7a655f4d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:24.930222 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62d495-7fcb-4189-a595-9bf7a655f4d4 None admin] RBAC: Adding query filter params (role.id=c2117c810f7b4e6aaf684c3d37b0ea3e, scope.project.id=549948b5ac834c07b634e08f7b1ec58d, user.id=a29e449728d941f9b691808c1f6e1716) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:24.930689 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62d495-7fcb-4189-a595-9bf7a655f4d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:24.935094 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62d495-7fcb-4189-a595-9bf7a655f4d4 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:24.941885 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 139/270] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:47:24 2022] GET /identity/v3/role_assignments?user.id=a29e449728d941f9b691808c1f6e1716&scope.project.id=549948b5ac834c07b634e08f7b1ec58d&role.id=c2117c810f7b4e6aaf684c3d37b0ea3e => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:24.943577 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecb5fe-4e16-4250-b2c9-7112c7f24be8 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:24.944075 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecb5fe-4e16-4250-b2c9-7112c7f24be8 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:24.944502 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecb5fe-4e16-4250-b2c9-7112c7f24be8 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:24.946235 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 140/271] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:24.950713 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 132/272] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:47:24.952324 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149df552-d1ce-4134-9f10-e352783382b9 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:24.952762 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149df552-d1ce-4134-9f10-e352783382b9 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:24.953173 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149df552-d1ce-4134-9f10-e352783382b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:24.974935 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661bcf7-bd3b-47a7-a40a-d88a48a5f356 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:24.981266 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-149df552-d1ce-4134-9f10-e352783382b9 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:24.982513 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-149df552-d1ce-4134-9f10-e352783382b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:25.048744 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:25.089755 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 141/273] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:47:25.106908 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661bcf7-bd3b-47a7-a40a-d88a48a5f356 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:25.116666 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149df552-d1ce-4134-9f10-e352783382b9 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:25.173122 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48a28f-a5f1-4156-b988-2e6b43dce28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:25.174891 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48a28f-a5f1-4156-b988-2e6b43dce28e None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:25.175190 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48a28f-a5f1-4156-b988-2e6b43dce28e None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:25.175476 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48a28f-a5f1-4156-b988-2e6b43dce28e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:25.177401 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e48a28f-a5f1-4156-b988-2e6b43dce28e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:25.179954 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e48a28f-a5f1-4156-b988-2e6b43dce28e None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:25.182977 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 133/274] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:47:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:47:25.188868 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48a28f-a5f1-4156-b988-2e6b43dce28e None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:25.209450 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:25.264330 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149df552-d1ce-4134-9f10-e352783382b9 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:25.310116 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa948a2-d7d5-47fb-b0f8-7a0879afe3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:25.311056 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa948a2-d7d5-47fb-b0f8-7a0879afe3fb None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:25.311419 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa948a2-d7d5-47fb-b0f8-7a0879afe3fb None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:25.311775 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa948a2-d7d5-47fb-b0f8-7a0879afe3fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:25.321354 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48a28f-a5f1-4156-b988-2e6b43dce28e None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:25.324395 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa948a2-d7d5-47fb-b0f8-7a0879afe3fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:25.332494 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-6fa948a2-d7d5-47fb-b0f8-7a0879afe3fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:47:25.332494 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:25.332494 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:25.332494 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:25.332494 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:25.332494 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:25.332494 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:25.332494 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:25.332494 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:25.332494 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:25.332494 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:25.332494 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:25.332494 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:25.332494 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:25.332494 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:25.332494 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:25.333372 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:25.333372 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:25.333372 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:25.333372 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:25.333372 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:25.333372 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:25.333372 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:25.333372 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:25.333372 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:25.333372 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:25.333372 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:25.333372 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:25.333372 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:25.333372 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:25.333372 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:25.333372 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:25.334142 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:25.334142 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:25.334142 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:25.334142 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:25.334142 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:25.334142 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:25.334142 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:25.334142 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:25.334142 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:25.334142 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:25.334142 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:47:25.334142 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:47:25.334142 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 142/275] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:47:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:47:25.340343 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa948a2-d7d5-47fb-b0f8-7a0879afe3fb None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:25.356893 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:25.364171 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7009b-8f36-42dd-8214-dfe9ab4d9e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:25.365393 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7009b-8f36-42dd-8214-dfe9ab4d9e23 None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:25.365686 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7009b-8f36-42dd-8214-dfe9ab4d9e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:25.365965 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7009b-8f36-42dd-8214-dfe9ab4d9e23 None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:25.366840 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e7009b-8f36-42dd-8214-dfe9ab4d9e23 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:25.368824 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e7009b-8f36-42dd-8214-dfe9ab4d9e23 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:25.450133 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 134/276] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jul 11 20:47:25 2022] POST /identity/v3/users => generated 293 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 20:47:25.463432 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa948a2-d7d5-47fb-b0f8-7a0879afe3fb None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:25.491711 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:25.511478 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd479d0-3022-4658-b681-d02034268441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:25.512343 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd479d0-3022-4658-b681-d02034268441 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:25.512634 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd479d0-3022-4658-b681-d02034268441 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:25.512914 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd479d0-3022-4658-b681-d02034268441 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:25.513681 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd479d0-3022-4658-b681-d02034268441 None admin] RBAC: Adding query filter params (name=member) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:25.517473 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd479d0-3022-4658-b681-d02034268441 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:25.517473 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd479d0-3022-4658-b681-d02034268441 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:25.527599 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 143/277] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 11 20:47:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:47:25.533456 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7009b-8f36-42dd-8214-dfe9ab4d9e23 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:25.649225 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7009b-8f36-42dd-8214-dfe9ab4d9e23 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:25.694711 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2659e7-900d-481c-90aa-cba5e0be0ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:25.695986 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2659e7-900d-481c-90aa-cba5e0be0ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:25.696458 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2659e7-900d-481c-90aa-cba5e0be0ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:25.696747 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2659e7-900d-481c-90aa-cba5e0be0ad0 None admin] PATH_INFO: `/v3/users/c4362404c012426b913f20b32a2c234e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:25.712875 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2659e7-900d-481c-90aa-cba5e0be0ad0 None admin] RBAC: Authorizing `identity:get_user(user_id=c4362404c012426b913f20b32a2c234e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:25.715077 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2659e7-900d-481c-90aa-cba5e0be0ad0 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:25.716861 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 135/278] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:47:25 2022] GET /identity/v3/users/c4362404c012426b913f20b32a2c234e => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:25.722614 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd479d0-3022-4658-b681-d02034268441 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:25.839698 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd479d0-3022-4658-b681-d02034268441 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:25.878280 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93746ed8-af8e-48a3-aa52-fdc35fe74791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:25.879318 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93746ed8-af8e-48a3-aa52-fdc35fe74791 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:25.879848 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93746ed8-af8e-48a3-aa52-fdc35fe74791 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:25.880353 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93746ed8-af8e-48a3-aa52-fdc35fe74791 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:25.881433 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93746ed8-af8e-48a3-aa52-fdc35fe74791 None admin] RBAC: Adding query filter params (role.id=cf0f875ea1ba45758bd4f52a845d807e, user.id=c4362404c012426b913f20b32a2c234e, scope.system=all) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:25.881968 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93746ed8-af8e-48a3-aa52-fdc35fe74791 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:25.883601 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93746ed8-af8e-48a3-aa52-fdc35fe74791 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:25.890366 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 144/279] 10.222.0.40 () {56 vars in 1308 bytes} [Mon Jul 11 20:47:25 2022] GET /identity/v3/role_assignments?user.id=c4362404c012426b913f20b32a2c234e&scope.system=all&role.id=cf0f875ea1ba45758bd4f52a845d807e => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:26.147479 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cc91a-69ce-4038-b7a2-13aa8605afcf None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:26.147839 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cc91a-69ce-4038-b7a2-13aa8605afcf None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:26.148079 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cc91a-69ce-4038-b7a2-13aa8605afcf None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:26.149459 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 136/280] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:26.155170 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135f713-c648-41e8-a0b4-101b0c8a6008 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:26.155468 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135f713-c648-41e8-a0b4-101b0c8a6008 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:26.155750 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135f713-c648-41e8-a0b4-101b0c8a6008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:26.173314 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-0135f713-c648-41e8-a0b4-101b0c8a6008 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:26.174494 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-0135f713-c648-41e8-a0b4-101b0c8a6008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:26.191166 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2256f-2a24-446f-b16f-257d708073e9 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:26.191455 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2256f-2a24-446f-b16f-257d708073e9 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:26.191737 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2256f-2a24-446f-b16f-257d708073e9 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:26.193428 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 137/281] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:26.199527 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f63e3-917e-4cbc-b3c6-8982948441dd None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:26.199823 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f63e3-917e-4cbc-b3c6-8982948441dd None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:26.200147 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f63e3-917e-4cbc-b3c6-8982948441dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:26.230789 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-d62f63e3-917e-4cbc-b3c6-8982948441dd None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:26.241227 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d62f63e3-917e-4cbc-b3c6-8982948441dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:26.241367 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:26.281353 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 145/282] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:26.308357 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:26.329191 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135f713-c648-41e8-a0b4-101b0c8a6008 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:26.364109 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 138/283] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:26.397246 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f63e3-917e-4cbc-b3c6-8982948441dd None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:26.455496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135f713-c648-41e8-a0b4-101b0c8a6008 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:26.491621 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686bbd29-9a3d-45b3-ac60-96c10063787c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:26.492807 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686bbd29-9a3d-45b3-ac60-96c10063787c None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:26.493297 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686bbd29-9a3d-45b3-ac60-96c10063787c None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:26.493782 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686bbd29-9a3d-45b3-ac60-96c10063787c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:26.505398 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686bbd29-9a3d-45b3-ac60-96c10063787c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:26.513766 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-686bbd29-9a3d-45b3-ac60-96c10063787c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 20:47:26.513766 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:26.513766 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:26.513766 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:26.513766 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:26.513766 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:26.513766 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:26.513766 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:26.513766 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:26.513766 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:26.513766 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:26.513766 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:26.513766 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:26.513766 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:26.513766 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:26.513766 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:26.514684 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:26.514684 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:26.514684 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:26.514684 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:26.514684 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:26.514684 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:26.514684 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:26.514684 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:26.514684 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:26.514684 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:26.514684 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:26.514684 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:26.514684 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:26.514684 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:26.514684 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:26.514684 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:26.515468 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:26.515468 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:26.515468 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:26.515468 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:26.515468 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:26.515468 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:26.515468 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:26.515468 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:26.515468 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:26.515468 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:26.515468 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 20:47:26.515468 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:47:26.517999 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 146/284] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:47:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:47:26.523805 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686bbd29-9a3d-45b3-ac60-96c10063787c None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:26.573452 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:26.585933 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f63e3-917e-4cbc-b3c6-8982948441dd None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:26.633465 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686bbd29-9a3d-45b3-ac60-96c10063787c None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:26.671599 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acbae91-d91b-4cfc-bd91-4f808da97a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:26.672394 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbae91-d91b-4cfc-bd91-4f808da97a1a None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:26.672776 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbae91-d91b-4cfc-bd91-4f808da97a1a None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:26.673123 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbae91-d91b-4cfc-bd91-4f808da97a1a None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:26.674181 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acbae91-d91b-4cfc-bd91-4f808da97a1a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:26.674561 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acbae91-d91b-4cfc-bd91-4f808da97a1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:26.676042 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acbae91-d91b-4cfc-bd91-4f808da97a1a None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:26.686094 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 147/285] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 11 20:47:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:47:26.691368 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acbae91-d91b-4cfc-bd91-4f808da97a1a None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:26.752756 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a4297-21ba-44da-86df-9465c03322c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:26.753554 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a4297-21ba-44da-86df-9465c03322c4 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:26.753844 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a4297-21ba-44da-86df-9465c03322c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:26.754122 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a4297-21ba-44da-86df-9465c03322c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:26.795709 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:26.802230 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acbae91-d91b-4cfc-bd91-4f808da97a1a None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:26.804572 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a4297-21ba-44da-86df-9465c03322c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:26.812785 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-953a4297-21ba-44da-86df-9465c03322c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:47:26.812785 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:26.812785 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:26.812785 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:26.812785 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:26.812785 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:26.812785 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:26.812785 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:26.812785 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:26.812785 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:26.812785 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:26.812785 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:26.812785 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:26.812785 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:26.812785 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:26.812785 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:26.813771 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:26.813771 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:26.813771 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:26.813771 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:26.813771 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:26.813771 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:26.813771 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:26.813771 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:26.813771 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:26.813771 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:26.813771 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:26.813771 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:26.813771 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:26.813771 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:26.813771 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:26.813771 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:26.814571 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:26.814571 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:26.814571 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:26.814571 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:26.814571 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:26.814571 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:26.814571 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:26.814571 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:26.814571 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:26.814571 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:26.814571 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:47:26.814571 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:47:26.825761 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 139/286] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:47:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 429 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:26.830554 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a4297-21ba-44da-86df-9465c03322c4 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:26.871879 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b483b6a-a699-4627-851d-7ba122dcbb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:26.873946 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b483b6a-a699-4627-851d-7ba122dcbb66 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:26.874491 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b483b6a-a699-4627-851d-7ba122dcbb66 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:26.874771 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b483b6a-a699-4627-851d-7ba122dcbb66 None admin] PATH_INFO: `/v3/users/b8d0037c1d8e4253995c84c6aeee7738` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:26.877946 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b483b6a-a699-4627-851d-7ba122dcbb66 None admin] RBAC: Authorizing `identity:get_user(user_id=b8d0037c1d8e4253995c84c6aeee7738)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:26.879402 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b483b6a-a699-4627-851d-7ba122dcbb66 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:26.881240 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 148/287] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:47:26 2022] GET /identity/v3/users/b8d0037c1d8e4253995c84c6aeee7738 => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:26.887358 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b483b6a-a699-4627-851d-7ba122dcbb66 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:26.902360 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:26.992687 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a4297-21ba-44da-86df-9465c03322c4 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:27.065712 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a95bf-1d31-42ab-8e94-48944d7b6903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:27.066362 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a95bf-1d31-42ab-8e94-48944d7b6903 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:27.066657 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a95bf-1d31-42ab-8e94-48944d7b6903 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:27.066937 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a95bf-1d31-42ab-8e94-48944d7b6903 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:27.069630 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a95bf-1d31-42ab-8e94-48944d7b6903 None admin] RBAC: Adding query filter params (name=member) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:27.069953 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a95bf-1d31-42ab-8e94-48944d7b6903 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:27.073035 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a95bf-1d31-42ab-8e94-48944d7b6903 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:27.090841 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 140/288] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 11 20:47:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:27.096601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a95bf-1d31-42ab-8e94-48944d7b6903 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:27.102220 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b483b6a-a699-4627-851d-7ba122dcbb66 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:27.171245 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018634ef-2a07-47f8-b244-bae4b4de9771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:27.172152 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018634ef-2a07-47f8-b244-bae4b4de9771 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:27.172438 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018634ef-2a07-47f8-b244-bae4b4de9771 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:27.172718 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018634ef-2a07-47f8-b244-bae4b4de9771 None admin] PATH_INFO: `/v3/projects/549948b5ac834c07b634e08f7b1ec58d` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:27.175563 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018634ef-2a07-47f8-b244-bae4b4de9771 None admin] RBAC: Authorizing `identity:get_project(project_id=549948b5ac834c07b634e08f7b1ec58d)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:27.177042 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018634ef-2a07-47f8-b244-bae4b4de9771 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:27.178918 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 149/289] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:47:26 2022] GET /identity/v3/projects/549948b5ac834c07b634e08f7b1ec58d => generated 302 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:27.188814 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018634ef-2a07-47f8-b244-bae4b4de9771 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:27.251578 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:27.271260 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:27.276000 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a95bf-1d31-42ab-8e94-48944d7b6903 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:27.320428 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e32480-3777-44e8-9d13-4d3e516aa71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:27.321725 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e32480-3777-44e8-9d13-4d3e516aa71b None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:27.322823 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e32480-3777-44e8-9d13-4d3e516aa71b None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:27.323305 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e32480-3777-44e8-9d13-4d3e516aa71b None admin] PATH_INFO: `/v3/users/b17d93f0bffe4a4ca699714336341e9e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:27.325063 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e32480-3777-44e8-9d13-4d3e516aa71b None admin] RBAC: Authorizing `identity:get_user(user_id=b17d93f0bffe4a4ca699714336341e9e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:27.326737 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e32480-3777-44e8-9d13-4d3e516aa71b None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:27.329234 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 141/290] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:47:27 2022] GET /identity/v3/users/b17d93f0bffe4a4ca699714336341e9e => generated 297 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:27.335587 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e32480-3777-44e8-9d13-4d3e516aa71b None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:27.411705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018634ef-2a07-47f8-b244-bae4b4de9771 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:27.456479 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e32480-3777-44e8-9d13-4d3e516aa71b None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:27.494622 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90045ee1-746d-46f8-b003-be8c376203b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:27.496077 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90045ee1-746d-46f8-b003-be8c376203b8 None admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:27.497131 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90045ee1-746d-46f8-b003-be8c376203b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:27.497776 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90045ee1-746d-46f8-b003-be8c376203b8 None admin] PATH_INFO: `/v3/projects/549948b5ac834c07b634e08f7b1ec58d/users/b8d0037c1d8e4253995c84c6aeee7738/roles/3a94b407c6914e15a379d3580c9c9ddf` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:27.502851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90045ee1-746d-46f8-b003-be8c376203b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=549948b5ac834c07b634e08f7b1ec58d, user_id=b8d0037c1d8e4253995c84c6aeee7738, role_id=3a94b407c6914e15a379d3580c9c9ddf)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:27.504226 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb980e0-c3ab-4b8a-bf79-a67b8d2e8ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:27.505945 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90045ee1-746d-46f8-b003-be8c376203b8 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:27.506807 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb980e0-c3ab-4b8a-bf79-a67b8d2e8ef9 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:27.507296 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb980e0-c3ab-4b8a-bf79-a67b8d2e8ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:27.507774 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb980e0-c3ab-4b8a-bf79-a67b8d2e8ef9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:27.549272 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:27.593168 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 150/291] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 11 20:47:27 2022] PUT /identity/v3/projects/549948b5ac834c07b634e08f7b1ec58d/users/b8d0037c1d8e4253995c84c6aeee7738/roles/3a94b407c6914e15a379d3580c9c9ddf => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:47:27.598454 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb980e0-c3ab-4b8a-bf79-a67b8d2e8ef9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:27.600649 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb980e0-c3ab-4b8a-bf79-a67b8d2e8ef9 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:27.738895 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 142/292] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:47:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:47:27.745293 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90045ee1-746d-46f8-b003-be8c376203b8 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:27.867271 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:27.875395 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90045ee1-746d-46f8-b003-be8c376203b8 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:27.913849 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2285dd-dc05-4eb7-b705-ad46ac85e4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:27.914739 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2285dd-dc05-4eb7-b705-ad46ac85e4cd None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:27.915032 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2285dd-dc05-4eb7-b705-ad46ac85e4cd None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:27.915315 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2285dd-dc05-4eb7-b705-ad46ac85e4cd None admin] PATH_INFO: `/v3/projects/549948b5ac834c07b634e08f7b1ec58d` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:27.917481 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2285dd-dc05-4eb7-b705-ad46ac85e4cd None admin] RBAC: Authorizing `identity:get_project(project_id=549948b5ac834c07b634e08f7b1ec58d)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:27.918944 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2285dd-dc05-4eb7-b705-ad46ac85e4cd None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:27.920699 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 151/293] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:47:27 2022] GET /identity/v3/projects/549948b5ac834c07b634e08f7b1ec58d => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:27.926726 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb980e0-c3ab-4b8a-bf79-a67b8d2e8ef9 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:28.011982 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:28.043012 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36716e-13b5-4be2-99a0-eed44b6a39d6 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:28.043314 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36716e-13b5-4be2-99a0-eed44b6a39d6 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:28.043584 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36716e-13b5-4be2-99a0-eed44b6a39d6 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:28.045139 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 152/294] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:28.051519 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7985c47-49ce-4fdb-9312-df223874f0e5 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:28.051805 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7985c47-49ce-4fdb-9312-df223874f0e5 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:28.052123 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7985c47-49ce-4fdb-9312-df223874f0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:28.056260 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb980e0-c3ab-4b8a-bf79-a67b8d2e8ef9 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:28.070658 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-d7985c47-49ce-4fdb-9312-df223874f0e5 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:28.071868 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-d7985c47-49ce-4fdb-9312-df223874f0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:28.098906 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04c921-af35-4039-a9da-343db74a95fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:28.099581 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04c921-af35-4039-a9da-343db74a95fc None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:28.099865 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04c921-af35-4039-a9da-343db74a95fc None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:28.100183 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04c921-af35-4039-a9da-343db74a95fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:28.101030 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e04c921-af35-4039-a9da-343db74a95fc None admin] RBAC: Adding query filter params (role.id=cf0f875ea1ba45758bd4f52a845d807e, scope.project.id=549948b5ac834c07b634e08f7b1ec58d, user.id=b17d93f0bffe4a4ca699714336341e9e) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:28.101346 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e04c921-af35-4039-a9da-343db74a95fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:28.102807 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e04c921-af35-4039-a9da-343db74a95fc None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:28.110268 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 143/295] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:47:27 2022] GET /identity/v3/role_assignments?user.id=b17d93f0bffe4a4ca699714336341e9e&scope.project.id=549948b5ac834c07b634e08f7b1ec58d&role.id=cf0f875ea1ba45758bd4f52a845d807e => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:28.116418 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ba760-0b13-486d-9a56-38e9566e5008 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:28.117040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ba760-0b13-486d-9a56-38e9566e5008 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:28.117572 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ba760-0b13-486d-9a56-38e9566e5008 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:28.121258 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 144/296] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:28.131104 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c3263-228c-4402-8b4e-a9c296e71248 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:28.131757 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c3263-228c-4402-8b4e-a9c296e71248 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:28.132264 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c3263-228c-4402-8b4e-a9c296e71248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:28.159600 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-044c3263-228c-4402-8b4e-a9c296e71248 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:28.162080 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-044c3263-228c-4402-8b4e-a9c296e71248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:28.194254 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 153/297] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:47:28.219300 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7985c47-49ce-4fdb-9312-df223874f0e5 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:28.277003 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 145/298] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:28.301989 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c3263-228c-4402-8b4e-a9c296e71248 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:28.322584 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:28.343022 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7985c47-49ce-4fdb-9312-df223874f0e5 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:28.380781 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:28.392165 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe96ce-99d6-497f-a4a2-810bb50f62ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:28.392978 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe96ce-99d6-497f-a4a2-810bb50f62ef None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:28.395711 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe96ce-99d6-497f-a4a2-810bb50f62ef None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:28.395711 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe96ce-99d6-497f-a4a2-810bb50f62ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:28.395711 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe96ce-99d6-497f-a4a2-810bb50f62ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:28.396328 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe96ce-99d6-497f-a4a2-810bb50f62ef None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:28.398169 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 154/299] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:47:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:47:28.399182 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5b74f-47d5-471b-acb1-9e636ab8959d None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:28.399462 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5b74f-47d5-471b-acb1-9e636ab8959d None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:28.399749 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5b74f-47d5-471b-acb1-9e636ab8959d None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:28.404195 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 155/300] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:28.405170 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b5b74f-47d5-471b-acb1-9e636ab8959d None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:28.445204 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c3263-228c-4402-8b4e-a9c296e71248 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:28.490301 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b96a0-cfc9-4aab-8f96-366e3193ed1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:28.491143 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b96a0-cfc9-4aab-8f96-366e3193ed1d None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:28.491504 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b96a0-cfc9-4aab-8f96-366e3193ed1d None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:28.491782 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b96a0-cfc9-4aab-8f96-366e3193ed1d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:28.504891 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b96a0-cfc9-4aab-8f96-366e3193ed1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:28.512693 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-f07b96a0-cfc9-4aab-8f96-366e3193ed1d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 20:47:28.512693 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:28.512693 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:28.512693 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:28.512693 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:28.512693 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:28.512693 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:28.512693 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:28.512693 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:28.512693 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:28.512693 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:28.512693 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:28.512693 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:28.512693 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:28.512693 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:28.512693 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:28.513563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:28.513563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:28.513563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:28.513563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:28.513563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:28.513563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:28.513563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:28.513563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:28.513563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:28.513563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:28.513563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:28.513563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:28.513563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:28.513563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:28.513563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:28.513563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:28.514371 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:28.514371 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:28.514371 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:28.514371 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:28.514371 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:28.514371 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:28.514371 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:28.514371 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:28.514371 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:28.514371 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:28.514371 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 20:47:28.514371 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:47:28.514371 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 146/301] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:47:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:28.515063 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562736c2-84c3-4c1f-a35b-992dac79f82b None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:28.515641 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562736c2-84c3-4c1f-a35b-992dac79f82b None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:28.515641 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562736c2-84c3-4c1f-a35b-992dac79f82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:28.533353 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-562736c2-84c3-4c1f-a35b-992dac79f82b None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:28.534240 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b5b74f-47d5-471b-acb1-9e636ab8959d None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:28.534673 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-562736c2-84c3-4c1f-a35b-992dac79f82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:28.571232 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7fa963-3bd9-457f-9042-95f3226191a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:28.572040 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7fa963-3bd9-457f-9042-95f3226191a7 None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:28.572933 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7fa963-3bd9-457f-9042-95f3226191a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:28.573215 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7fa963-3bd9-457f-9042-95f3226191a7 None admin] PATH_INFO: `/v3/groups` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:28.574400 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7fa963-3bd9-457f-9042-95f3226191a7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:28.575344 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7fa963-3bd9-457f-9042-95f3226191a7 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:28.605216 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 147/302] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:28.606057 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562736c2-84c3-4c1f-a35b-992dac79f82b None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:28.659885 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 156/303] 10.222.0.40 () {60 vars in 1134 bytes} [Mon Jul 11 20:47:28 2022] POST /identity/v3/groups => generated 229 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:47:28.661182 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7fa963-3bd9-457f-9042-95f3226191a7 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:28.674595 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:28.697461 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:28.752798 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562736c2-84c3-4c1f-a35b-992dac79f82b None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:28.802807 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7fa963-3bd9-457f-9042-95f3226191a7 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:28.809966 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a56568-95c8-47b8-922f-2ee2d6059b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:28.810663 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a56568-95c8-47b8-922f-2ee2d6059b24 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:28.810996 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a56568-95c8-47b8-922f-2ee2d6059b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:28.811234 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a56568-95c8-47b8-922f-2ee2d6059b24 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:28.812229 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a56568-95c8-47b8-922f-2ee2d6059b24 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:28.812569 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a56568-95c8-47b8-922f-2ee2d6059b24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:28.815575 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a56568-95c8-47b8-922f-2ee2d6059b24 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:28.825648 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 148/304] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 11 20:47:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:28.831143 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a56568-95c8-47b8-922f-2ee2d6059b24 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:28.857394 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bc4f4-db81-4762-84a3-c90f8f4e680a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:28.858214 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bc4f4-db81-4762-84a3-c90f8f4e680a None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:28.858502 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bc4f4-db81-4762-84a3-c90f8f4e680a None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:28.858784 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bc4f4-db81-4762-84a3-c90f8f4e680a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:28.870185 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35bc4f4-db81-4762-84a3-c90f8f4e680a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:28.878089 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-b35bc4f4-db81-4762-84a3-c90f8f4e680a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:47:28.878089 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:28.878089 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:28.878089 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:28.878089 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:28.878089 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:28.878089 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:28.878089 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:28.878089 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:28.878089 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:28.878089 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:28.878089 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:28.878089 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:28.878089 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:28.878089 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:28.878089 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:28.878989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:28.878989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:28.878989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:28.878989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:28.878989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:28.878989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:28.878989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:28.878989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:28.878989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:28.878989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:28.878989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:28.878989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:28.878989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:28.878989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:28.878989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:28.878989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:28.879849 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:28.879849 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:28.879849 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:28.879849 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:28.879849 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:28.879849 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:28.879849 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:28.879849 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:28.879849 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:28.879849 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:28.879849 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:47:28.879849 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:47:28.879849 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 157/305] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:47:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:28.889645 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bc4f4-db81-4762-84a3-c90f8f4e680a None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:28.960442 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a56568-95c8-47b8-922f-2ee2d6059b24 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:28.979024 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:28.996127 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:29.003265 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0bb2a-3605-4cbb-b659-b5227bd99b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:29.008245 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0bb2a-3605-4cbb-b659-b5227bd99b5a None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:29.008245 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0bb2a-3605-4cbb-b659-b5227bd99b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:29.008245 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0bb2a-3605-4cbb-b659-b5227bd99b5a None admin] PATH_INFO: `/v3/users/40d222b7a3e6458285fd4d85c4d0345d` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:29.020168 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd0bb2a-3605-4cbb-b659-b5227bd99b5a None admin] RBAC: Authorizing `identity:get_user(user_id=40d222b7a3e6458285fd4d85c4d0345d)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:29.021683 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd0bb2a-3605-4cbb-b659-b5227bd99b5a None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:29.023108 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bc4f4-db81-4762-84a3-c90f8f4e680a None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:29.023726 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 149/306] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:47:28 2022] GET /identity/v3/users/40d222b7a3e6458285fd4d85c4d0345d => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:47:29.031041 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0bb2a-3605-4cbb-b659-b5227bd99b5a None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:29.065204 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e36f2e-0349-400a-9587-38e05cfa4aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:29.066001 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e36f2e-0349-400a-9587-38e05cfa4aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:29.066298 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e36f2e-0349-400a-9587-38e05cfa4aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:29.066895 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e36f2e-0349-400a-9587-38e05cfa4aa6 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:29.067945 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e36f2e-0349-400a-9587-38e05cfa4aa6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:29.068296 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e36f2e-0349-400a-9587-38e05cfa4aa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:29.069708 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e36f2e-0349-400a-9587-38e05cfa4aa6 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:29.080208 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 158/307] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 11 20:47:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:29.086123 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e36f2e-0349-400a-9587-38e05cfa4aa6 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:29.150704 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0bb2a-3605-4cbb-b659-b5227bd99b5a None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:29.189597 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f1dc2-ffc4-4b67-92e8-ab2868c47ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:29.190265 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f1dc2-ffc4-4b67-92e8-ab2868c47ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:29.190551 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f1dc2-ffc4-4b67-92e8-ab2868c47ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:29.190831 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f1dc2-ffc4-4b67-92e8-ab2868c47ee2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:29.191662 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f1dc2-ffc4-4b67-92e8-ab2868c47ee2 None admin] RBAC: Adding query filter params (role.id=3a94b407c6914e15a379d3580c9c9ddf, user.id=40d222b7a3e6458285fd4d85c4d0345d, scope.system=all) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:29.191769 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e36f2e-0349-400a-9587-38e05cfa4aa6 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:29.191989 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f1dc2-ffc4-4b67-92e8-ab2868c47ee2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:29.193532 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f1dc2-ffc4-4b67-92e8-ab2868c47ee2 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:29.200463 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 150/308] 10.222.0.40 () {56 vars in 1308 bytes} [Mon Jul 11 20:47:29 2022] GET /identity/v3/role_assignments?user.id=40d222b7a3e6458285fd4d85c4d0345d&scope.system=all&role.id=3a94b407c6914e15a379d3580c9c9ddf => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:47:29.231369 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956240a1-3b24-470e-9247-3a9ba841c9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:29.231369 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956240a1-3b24-470e-9247-3a9ba841c9d6 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:29.231369 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956240a1-3b24-470e-9247-3a9ba841c9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:29.231369 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956240a1-3b24-470e-9247-3a9ba841c9d6 None admin] PATH_INFO: `/v3/users/c4362404c012426b913f20b32a2c234e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:29.232167 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956240a1-3b24-470e-9247-3a9ba841c9d6 None admin] RBAC: Authorizing `identity:get_user(user_id=c4362404c012426b913f20b32a2c234e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:29.233873 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956240a1-3b24-470e-9247-3a9ba841c9d6 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:29.235630 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 159/309] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:47:29 2022] GET /identity/v3/users/c4362404c012426b913f20b32a2c234e => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:47:29.241782 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f1dc2-ffc4-4b67-92e8-ab2868c47ee2 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:29.282618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:29.359836 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f1dc2-ffc4-4b67-92e8-ab2868c47ee2 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:29.395133 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd12b7-912c-466a-877f-17f47c78bff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:29.396053 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd12b7-912c-466a-877f-17f47c78bff6 None admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:29.396309 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd12b7-912c-466a-877f-17f47c78bff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:29.396586 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd12b7-912c-466a-877f-17f47c78bff6 None admin] PATH_INFO: `/v3/system/users/c4362404c012426b913f20b32a2c234e/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:29.398074 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd12b7-912c-466a-877f-17f47c78bff6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c4362404c012426b913f20b32a2c234e, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:29.399442 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd12b7-912c-466a-877f-17f47c78bff6 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:29.495649 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 151/310] 10.222.0.40 () {58 vars in 1334 bytes} [Mon Jul 11 20:47:29 2022] PUT /identity/v3/system/users/c4362404c012426b913f20b32a2c234e/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:47:30.112538 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc958d03-6b9d-4378-94ab-f753324230f0 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:30.113045 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc958d03-6b9d-4378-94ab-f753324230f0 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:30.113119 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc958d03-6b9d-4378-94ab-f753324230f0 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:30.114620 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 160/311] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:30.120426 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac572d-f56c-432e-bc19-5b1a366c99d4 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:30.121250 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac572d-f56c-432e-bc19-5b1a366c99d4 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:30.121742 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac572d-f56c-432e-bc19-5b1a366c99d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:30.139644 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-dbac572d-f56c-432e-bc19-5b1a366c99d4 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:30.141154 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-dbac572d-f56c-432e-bc19-5b1a366c99d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:30.217655 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 152/312] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:47:30.517748 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc958d03-6b9d-4378-94ab-f753324230f0 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:30.517748 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:30.517748 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc958d03-6b9d-4378-94ab-f753324230f0 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:30.517748 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9cb78-54bc-4350-9c71-41526ea811fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:30.518117 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9cb78-54bc-4350-9c71-41526ea811fb None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:30.518117 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9cb78-54bc-4350-9c71-41526ea811fb None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:30.518117 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9cb78-54bc-4350-9c71-41526ea811fb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:30.518117 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9cb78-54bc-4350-9c71-41526ea811fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:30.518117 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-9ff9cb78-54bc-4350-9c71-41526ea811fb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 20:47:30.518117 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:30.518117 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:30.518117 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:30.518117 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:30.518654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:30.518654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:30.518654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:30.518654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:30.518654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:30.518654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:30.518654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:30.518654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:30.518654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:30.518654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:30.518654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:30.518654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:30.518654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:30.518654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:30.518654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:30.518654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:30.519480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:30.519480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:30.519480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:30.519480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:30.519480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:30.519480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:30.519480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:30.519480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:30.519480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:30.519480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:30.519480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:30.519480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:30.519480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:30.519480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:30.519480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:30.519480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:30.519480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:30.520409 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:30.520409 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:30.520409 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:30.520409 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:30.520409 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 20:47:30.520409 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:47:30.520409 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 161/313] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:47:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:30.520797 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac572d-f56c-432e-bc19-5b1a366c99d4 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:30.520797 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:30.528060 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac572d-f56c-432e-bc19-5b1a366c99d4 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:30.560003 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847d7bf-da90-46a0-8bd0-cbc1c02554cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:30.560748 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847d7bf-da90-46a0-8bd0-cbc1c02554cf None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:30.561033 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847d7bf-da90-46a0-8bd0-cbc1c02554cf None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:30.561309 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847d7bf-da90-46a0-8bd0-cbc1c02554cf None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:30.562116 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847d7bf-da90-46a0-8bd0-cbc1c02554cf None admin] RBAC: Adding query filter params (name=reader) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:30.562486 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847d7bf-da90-46a0-8bd0-cbc1c02554cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:30.563909 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847d7bf-da90-46a0-8bd0-cbc1c02554cf None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:30.573222 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 153/314] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 11 20:47:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:30.578258 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9cb78-54bc-4350-9c71-41526ea811fb None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:30.652086 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:30.684495 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9cb78-54bc-4350-9c71-41526ea811fb None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:30.720380 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956ef42-4afb-45c9-928b-354feb788932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:30.721253 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956ef42-4afb-45c9-928b-354feb788932 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:30.721537 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956ef42-4afb-45c9-928b-354feb788932 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:30.721816 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956ef42-4afb-45c9-928b-354feb788932 None admin] PATH_INFO: `/v3/users/b8d0037c1d8e4253995c84c6aeee7738` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:30.723013 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956ef42-4afb-45c9-928b-354feb788932 None admin] RBAC: Authorizing `identity:get_user(user_id=b8d0037c1d8e4253995c84c6aeee7738)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:30.724505 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956ef42-4afb-45c9-928b-354feb788932 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:30.726421 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 162/315] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:47:30 2022] GET /identity/v3/users/b8d0037c1d8e4253995c84c6aeee7738 => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:30.732064 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847d7bf-da90-46a0-8bd0-cbc1c02554cf None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:30.830010 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:30.839832 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847d7bf-da90-46a0-8bd0-cbc1c02554cf None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:30.876161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b980c-6a52-4727-980b-32c3c78301f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:30.877160 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b980c-6a52-4727-980b-32c3c78301f9 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:30.877628 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b980c-6a52-4727-980b-32c3c78301f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:30.878095 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b980c-6a52-4727-980b-32c3c78301f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:30.885915 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e7e9f-836f-478d-ae67-40271b0803eb None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:30.886204 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e7e9f-836f-478d-ae67-40271b0803eb None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:30.886482 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e7e9f-836f-478d-ae67-40271b0803eb None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:30.891603 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 163/316] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:47:30.892765 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c8c8e-6e30-4c55-ad25-bce3b18bb7e5 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:30.893057 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c8c8e-6e30-4c55-ad25-bce3b18bb7e5 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:30.893581 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c8c8e-6e30-4c55-ad25-bce3b18bb7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:30.909891 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-a61c8c8e-6e30-4c55-ad25-bce3b18bb7e5 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:30.911126 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a61c8c8e-6e30-4c55-ad25-bce3b18bb7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:30.958929 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b980c-6a52-4727-980b-32c3c78301f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:30.960843 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b980c-6a52-4727-980b-32c3c78301f9 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:30.984256 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 164/317] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:31.008074 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c8c8e-6e30-4c55-ad25-bce3b18bb7e5 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:31.054677 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:31.065752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 154/318] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:47:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:47:31.071139 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b980c-6a52-4727-980b-32c3c78301f9 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:31.085475 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:31.122845 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c8c8e-6e30-4c55-ad25-bce3b18bb7e5 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:31.161810 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740d3f9-d048-45dc-b74b-eef7a315d540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:31.163000 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740d3f9-d048-45dc-b74b-eef7a315d540 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:31.163498 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740d3f9-d048-45dc-b74b-eef7a315d540 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:31.164044 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740d3f9-d048-45dc-b74b-eef7a315d540 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:31.165705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740d3f9-d048-45dc-b74b-eef7a315d540 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:31.167493 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740d3f9-d048-45dc-b74b-eef7a315d540 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:31.174083 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 165/319] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:47:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:47:31.174403 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b980c-6a52-4727-980b-32c3c78301f9 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:31.175439 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740d3f9-d048-45dc-b74b-eef7a315d540 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:31.210942 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df49c33a-328b-4dec-83cd-a5b71d72b9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:31.212165 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49c33a-328b-4dec-83cd-a5b71d72b9e2 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:31.213126 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49c33a-328b-4dec-83cd-a5b71d72b9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:31.213553 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49c33a-328b-4dec-83cd-a5b71d72b9e2 None admin] PATH_INFO: `/v3/projects/549948b5ac834c07b634e08f7b1ec58d` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:31.214918 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df49c33a-328b-4dec-83cd-a5b71d72b9e2 None admin] RBAC: Authorizing `identity:get_project(project_id=549948b5ac834c07b634e08f7b1ec58d)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:31.216600 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df49c33a-328b-4dec-83cd-a5b71d72b9e2 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:31.219057 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 155/320] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:47:31 2022] GET /identity/v3/projects/549948b5ac834c07b634e08f7b1ec58d => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:31.224452 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df49c33a-328b-4dec-83cd-a5b71d72b9e2 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:31.286025 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:31.293804 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740d3f9-d048-45dc-b74b-eef7a315d540 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:31.328835 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e400d05-223f-4707-980a-d0bec1a5efa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:31.329461 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e400d05-223f-4707-980a-d0bec1a5efa1 None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:31.329832 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e400d05-223f-4707-980a-d0bec1a5efa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:31.330083 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e400d05-223f-4707-980a-d0bec1a5efa1 None admin] PATH_INFO: `/v3/groups` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:31.330700 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e400d05-223f-4707-980a-d0bec1a5efa1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:31.331867 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df49c33a-328b-4dec-83cd-a5b71d72b9e2 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:31.332163 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e400d05-223f-4707-980a-d0bec1a5efa1 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:31.335731 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:31.367406 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e05f93-1821-4ead-b589-d88f1534cf2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:31.368105 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e05f93-1821-4ead-b589-d88f1534cf2f None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:31.368391 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e05f93-1821-4ead-b589-d88f1534cf2f None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:31.368670 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e05f93-1821-4ead-b589-d88f1534cf2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:31.369767 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e05f93-1821-4ead-b589-d88f1534cf2f None admin] RBAC: Adding query filter params (role.id=3a94b407c6914e15a379d3580c9c9ddf, scope.project.id=549948b5ac834c07b634e08f7b1ec58d, user.id=b8d0037c1d8e4253995c84c6aeee7738) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:31.370085 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e05f93-1821-4ead-b589-d88f1534cf2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:31.371507 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e05f93-1821-4ead-b589-d88f1534cf2f None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:31.377531 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 156/321] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:47:31 2022] GET /identity/v3/role_assignments?user.id=b8d0037c1d8e4253995c84c6aeee7738&scope.project.id=549948b5ac834c07b634e08f7b1ec58d&role.id=3a94b407c6914e15a379d3580c9c9ddf => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:47:31.378780 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4c67b-6f82-4c11-a996-2a92548764fe None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:31.379074 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4c67b-6f82-4c11-a996-2a92548764fe None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:31.379353 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4c67b-6f82-4c11-a996-2a92548764fe None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:31.380747 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 157/322] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:31.386955 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574c041-2e1a-45aa-9fcf-90024f2aa8f6 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:31.387254 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574c041-2e1a-45aa-9fcf-90024f2aa8f6 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:31.387582 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574c041-2e1a-45aa-9fcf-90024f2aa8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:31.406055 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-d574c041-2e1a-45aa-9fcf-90024f2aa8f6 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:31.407282 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d574c041-2e1a-45aa-9fcf-90024f2aa8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:31.437337 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 166/323] 10.222.0.40 () {60 vars in 1134 bytes} [Mon Jul 11 20:47:31 2022] POST /identity/v3/groups => generated 226 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:47:31.497214 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 158/324] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:31.521492 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e400d05-223f-4707-980a-d0bec1a5efa1 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:31.611721 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbbec24-ca97-46fc-9899-51d7a20b01d5 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:31.612061 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbbec24-ca97-46fc-9899-51d7a20b01d5 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:31.612230 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbbec24-ca97-46fc-9899-51d7a20b01d5 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:31.613923 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 159/325] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:47:31.620878 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a7ab0-a665-4e8f-86b3-204ab8739b12 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:31.621299 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a7ab0-a665-4e8f-86b3-204ab8739b12 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:31.621685 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a7ab0-a665-4e8f-86b3-204ab8739b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:31.642993 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-a45a7ab0-a665-4e8f-86b3-204ab8739b12 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:31.644219 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-a45a7ab0-a665-4e8f-86b3-204ab8739b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:31.645521 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e400d05-223f-4707-980a-d0bec1a5efa1 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:31.689958 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5f35f-9224-41bf-8f84-b828ee69728c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:31.690779 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5f35f-9224-41bf-8f84-b828ee69728c None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:31.691068 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5f35f-9224-41bf-8f84-b828ee69728c None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:31.691351 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5f35f-9224-41bf-8f84-b828ee69728c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:31.703650 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:31.703802 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5f35f-9224-41bf-8f84-b828ee69728c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:31.711705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-e6a5f35f-9224-41bf-8f84-b828ee69728c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 20:47:31.711705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:31.711705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:31.711705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:31.711705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:31.711705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:31.711705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:31.711705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:31.711705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:31.711705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:31.711705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:31.711705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:31.711705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:31.711705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:31.711705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:31.711705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:31.723557 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:31.723557 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:31.723557 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:31.723557 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:31.723557 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:31.723557 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:31.723557 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:31.723557 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:31.723557 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:31.723557 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:31.723557 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:31.723557 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:31.723557 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:31.723557 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:31.723557 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:31.723557 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:31.724531 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:31.724531 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:31.724531 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:31.724531 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:31.724531 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:31.724531 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:31.724531 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:31.724531 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:31.724531 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:31.724531 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:31.724531 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 20:47:31.724531 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:47:31.724531 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 167/326] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:47:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:31.724531 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5f35f-9224-41bf-8f84-b828ee69728c None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:31.730094 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 160/327] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:31.755301 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a7ab0-a665-4e8f-86b3-204ab8739b12 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:31.785112 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:31.841042 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5f35f-9224-41bf-8f84-b828ee69728c None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:31.879962 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a7ab0-a665-4e8f-86b3-204ab8739b12 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:31.890765 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35704e4f-7ca5-4a90-8cfa-f8471f4bcd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:31.891466 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35704e4f-7ca5-4a90-8cfa-f8471f4bcd74 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:31.891753 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35704e4f-7ca5-4a90-8cfa-f8471f4bcd74 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:31.892061 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35704e4f-7ca5-4a90-8cfa-f8471f4bcd74 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:31.892825 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35704e4f-7ca5-4a90-8cfa-f8471f4bcd74 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:31.893136 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35704e4f-7ca5-4a90-8cfa-f8471f4bcd74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:31.894546 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35704e4f-7ca5-4a90-8cfa-f8471f4bcd74 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:31.904633 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 168/328] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 11 20:47:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:47:31.909634 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35704e4f-7ca5-4a90-8cfa-f8471f4bcd74 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:31.921193 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a49f4-aa2e-4e67-b6dc-54b885eeaf7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:31.922276 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a49f4-aa2e-4e67-b6dc-54b885eeaf7a None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:31.922563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a49f4-aa2e-4e67-b6dc-54b885eeaf7a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:31.922841 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a49f4-aa2e-4e67-b6dc-54b885eeaf7a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:31.935212 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a49f4-aa2e-4e67-b6dc-54b885eeaf7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:31.942835 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-979a49f4-aa2e-4e67-b6dc-54b885eeaf7a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:47:31.942835 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:31.942835 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:31.942835 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:31.942835 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:31.942835 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:31.942835 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:31.942835 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:31.942835 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:31.942835 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:31.942835 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:31.942835 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:31.942835 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:31.942835 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:31.942835 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:31.942835 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:31.943721 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:31.943721 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:31.943721 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:31.943721 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:31.943721 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:31.943721 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:31.943721 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:31.943721 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:31.943721 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:31.943721 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:31.943721 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:31.943721 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:31.943721 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:31.943721 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:31.943721 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:31.943721 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:31.944948 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:31.944948 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:31.944948 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:31.944948 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:31.944948 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:31.944948 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:31.944948 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:31.944948 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:31.944948 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:31.944948 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:31.944948 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:47:31.944948 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:47:31.944948 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 161/329] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:47:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:47:31.950512 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a49f4-aa2e-4e67-b6dc-54b885eeaf7a None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:32.002701 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:32.043174 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35704e4f-7ca5-4a90-8cfa-f8471f4bcd74 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:32.069123 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:32.075055 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a49f4-aa2e-4e67-b6dc-54b885eeaf7a None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:32.089951 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a06de-f1c8-4140-9f1c-8692516fa10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:32.090960 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a06de-f1c8-4140-9f1c-8692516fa10d None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:32.091331 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a06de-f1c8-4140-9f1c-8692516fa10d None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:32.091683 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a06de-f1c8-4140-9f1c-8692516fa10d None admin] PATH_INFO: `/v3/users/40d222b7a3e6458285fd4d85c4d0345d` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:32.094164 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a06de-f1c8-4140-9f1c-8692516fa10d None admin] RBAC: Authorizing `identity:get_user(user_id=40d222b7a3e6458285fd4d85c4d0345d)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:32.096119 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a06de-f1c8-4140-9f1c-8692516fa10d None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:32.098461 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 169/330] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:47:31 2022] GET /identity/v3/users/40d222b7a3e6458285fd4d85c4d0345d => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:47:32.108957 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a06de-f1c8-4140-9f1c-8692516fa10d None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:32.117074 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab8619-5616-4e81-9238-be58c70a2aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:32.117755 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab8619-5616-4e81-9238-be58c70a2aea None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:32.118041 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab8619-5616-4e81-9238-be58c70a2aea None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:32.118324 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab8619-5616-4e81-9238-be58c70a2aea None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:32.119638 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab8619-5616-4e81-9238-be58c70a2aea None admin] RBAC: Adding query filter params (name=member) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:32.119953 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab8619-5616-4e81-9238-be58c70a2aea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:32.121365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab8619-5616-4e81-9238-be58c70a2aea None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:32.136162 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 162/331] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 11 20:47:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:47:32.141695 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab8619-5616-4e81-9238-be58c70a2aea None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:32.268092 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a06de-f1c8-4140-9f1c-8692516fa10d None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:32.287296 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab8619-5616-4e81-9238-be58c70a2aea None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:32.292710 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:32.307393 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b09a4c-beef-4942-a9dc-01c85a334503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:32.308319 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b09a4c-beef-4942-a9dc-01c85a334503 None admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:32.308660 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b09a4c-beef-4942-a9dc-01c85a334503 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:32.308941 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b09a4c-beef-4942-a9dc-01c85a334503 None admin] PATH_INFO: `/v3/system/users/40d222b7a3e6458285fd4d85c4d0345d/roles/3a94b407c6914e15a379d3580c9c9ddf` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:32.310487 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b09a4c-beef-4942-a9dc-01c85a334503 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=40d222b7a3e6458285fd4d85c4d0345d, role_id=3a94b407c6914e15a379d3580c9c9ddf)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:32.311874 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b09a4c-beef-4942-a9dc-01c85a334503 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:32.331546 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ba492-898c-4c38-bf66-5074a31d8aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:32.332655 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ba492-898c-4c38-bf66-5074a31d8aae None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:32.332945 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ba492-898c-4c38-bf66-5074a31d8aae None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:32.333228 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ba492-898c-4c38-bf66-5074a31d8aae None admin] PATH_INFO: `/v3/users/c4362404c012426b913f20b32a2c234e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:32.334509 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ba492-898c-4c38-bf66-5074a31d8aae None admin] RBAC: Authorizing `identity:get_user(user_id=c4362404c012426b913f20b32a2c234e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:32.335949 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ba492-898c-4c38-bf66-5074a31d8aae None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:32.337849 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 163/332] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:47:32 2022] GET /identity/v3/users/c4362404c012426b913f20b32a2c234e => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:32.344038 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ba492-898c-4c38-bf66-5074a31d8aae None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:32.426366 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 170/333] 10.222.0.40 () {58 vars in 1334 bytes} [Mon Jul 11 20:47:32 2022] PUT /identity/v3/system/users/40d222b7a3e6458285fd4d85c4d0345d/roles/3a94b407c6914e15a379d3580c9c9ddf => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:47:32.464950 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ba492-898c-4c38-bf66-5074a31d8aae None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:32.505379 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912f746-2281-4942-8ac9-2747d43fdf30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:32.506061 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912f746-2281-4942-8ac9-2747d43fdf30 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:32.506353 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912f746-2281-4942-8ac9-2747d43fdf30 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:32.506637 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912f746-2281-4942-8ac9-2747d43fdf30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:32.507483 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912f746-2281-4942-8ac9-2747d43fdf30 None admin] RBAC: Adding query filter params (role.id=cf0f875ea1ba45758bd4f52a845d807e, user.id=c4362404c012426b913f20b32a2c234e, scope.system=all) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:32.507850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912f746-2281-4942-8ac9-2747d43fdf30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:32.509935 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912f746-2281-4942-8ac9-2747d43fdf30 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:32.523453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 164/334] 10.222.0.40 () {56 vars in 1308 bytes} [Mon Jul 11 20:47:32 2022] GET /identity/v3/role_assignments?user.id=c4362404c012426b913f20b32a2c234e&scope.system=all&role.id=cf0f875ea1ba45758bd4f52a845d807e => generated 510 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:47:33.848353 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a9347-a510-44d7-8ae5-aee9a7c599b9 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:33.848879 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a9347-a510-44d7-8ae5-aee9a7c599b9 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:33.848955 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a9347-a510-44d7-8ae5-aee9a7c599b9 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:33.850537 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 171/335] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:33.860023 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b83af-31ae-422d-88fd-84e7f0204abb None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:33.860488 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b83af-31ae-422d-88fd-84e7f0204abb None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:33.860591 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b83af-31ae-422d-88fd-84e7f0204abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:33.889008 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-e79b83af-31ae-422d-88fd-84e7f0204abb None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:33.890206 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-e79b83af-31ae-422d-88fd-84e7f0204abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:33.919787 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:33.979884 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 165/336] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:47:34.023104 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a9347-a510-44d7-8ae5-aee9a7c599b9 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:34.091554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:34.156590 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a9347-a510-44d7-8ae5-aee9a7c599b9 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:34.194759 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b612e4-ce46-4684-9a98-7f032a15171a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:34.195568 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b612e4-ce46-4684-9a98-7f032a15171a None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:34.195854 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b612e4-ce46-4684-9a98-7f032a15171a None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:34.196158 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b612e4-ce46-4684-9a98-7f032a15171a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:34.210457 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b612e4-ce46-4684-9a98-7f032a15171a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:34.218802 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-88b612e4-ce46-4684-9a98-7f032a15171a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:47:34.218802 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:34.218802 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:34.218802 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:34.218802 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:34.218802 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:34.218802 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:34.218802 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:34.218802 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:34.218802 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:34.218802 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:34.218802 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:34.218802 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:34.218802 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:34.218802 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:34.218802 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:34.219705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:34.219705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:34.219705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:34.219705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:34.219705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:34.219705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:34.219705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:34.219705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:34.219705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:34.219705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:34.219705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:34.219705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:34.219705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:34.219705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:34.219705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:34.219705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:34.220532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:34.220532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:34.220532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:34.220532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:34.220532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:34.220532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:34.220532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:34.220532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:34.220532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:34.220532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:34.220532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:47:34.220532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:47:34.220532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 172/337] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:47:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:34.228216 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b83af-31ae-422d-88fd-84e7f0204abb None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:34.305737 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f149ce-2259-4f34-ac9a-5f49387dcf26 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:34.306055 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f149ce-2259-4f34-ac9a-5f49387dcf26 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:34.306914 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f149ce-2259-4f34-ac9a-5f49387dcf26 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:34.308340 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 173/338] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:34.313542 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8910f-24d7-4cf8-9db1-48a0b4e08f33 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:34.313836 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8910f-24d7-4cf8-9db1-48a0b4e08f33 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:34.314120 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8910f-24d7-4cf8-9db1-48a0b4e08f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:34.346950 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-1ee8910f-24d7-4cf8-9db1-48a0b4e08f33 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:34.348200 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-1ee8910f-24d7-4cf8-9db1-48a0b4e08f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:34.422029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b83af-31ae-422d-88fd-84e7f0204abb None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:34.487082 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 174/339] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:34.505279 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a215dea-302c-43d1-8391-279b8438c1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:34.505945 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a215dea-302c-43d1-8391-279b8438c1aa None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:34.506231 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a215dea-302c-43d1-8391-279b8438c1aa None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:34.506509 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a215dea-302c-43d1-8391-279b8438c1aa None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:34.507263 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a215dea-302c-43d1-8391-279b8438c1aa None admin] RBAC: Adding query filter params (name=member) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:34.507573 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a215dea-302c-43d1-8391-279b8438c1aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:34.508969 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a215dea-302c-43d1-8391-279b8438c1aa None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:34.523919 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 166/340] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 11 20:47:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:34.530442 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8910f-24d7-4cf8-9db1-48a0b4e08f33 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:34.532394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a215dea-302c-43d1-8391-279b8438c1aa None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:34.582996 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:34.609084 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:34.730125 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8910f-24d7-4cf8-9db1-48a0b4e08f33 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:34.738443 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a215dea-302c-43d1-8391-279b8438c1aa None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:34.801958 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26722864-bfae-4129-a784-9487b869414f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:34.802765 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26722864-bfae-4129-a784-9487b869414f None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:34.803055 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26722864-bfae-4129-a784-9487b869414f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:34.803496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26722864-bfae-4129-a784-9487b869414f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:34.832678 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f2a6f-9986-40d0-9898-f9f0348e0aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:34.833502 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f2a6f-9986-40d0-9898-f9f0348e0aaf None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:34.833786 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f2a6f-9986-40d0-9898-f9f0348e0aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:34.834057 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f2a6f-9986-40d0-9898-f9f0348e0aaf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:34.857217 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f2a6f-9986-40d0-9898-f9f0348e0aaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:34.865365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-db4f2a6f-9986-40d0-9898-f9f0348e0aaf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:47:34.865365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:34.865365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:34.865365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:34.865365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:34.865365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:34.865365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:34.865365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:34.865365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:34.865365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:34.865365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:34.865365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:34.865365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:34.865365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:34.865365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:34.865365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:34.866618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:34.866618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:34.866618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:34.866618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:34.866618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:34.866618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:34.866618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:34.866618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:34.866618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:34.866618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:34.866618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:34.866618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:34.866618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:34.866618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:34.866618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:34.866618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:34.867407 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:34.867407 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:34.867407 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:34.867407 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:34.867407 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:34.867407 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:34.867407 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:34.867407 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:34.867407 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:34.867407 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:34.867407 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:47:34.867407 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:47:34.876357 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 167/341] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jul 11 20:47:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:47:34.877309 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f2a6f-9986-40d0-9898-f9f0348e0aaf None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:34.948809 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26722864-bfae-4129-a784-9487b869414f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:34.950974 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26722864-bfae-4129-a784-9487b869414f None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:34.990719 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:35.014898 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f2a6f-9986-40d0-9898-f9f0348e0aaf None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:35.037850 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:35.089357 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286774e-8e9d-4d5b-93b1-e0e6c2466ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:35.090067 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286774e-8e9d-4d5b-93b1-e0e6c2466ccb None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:35.090340 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286774e-8e9d-4d5b-93b1-e0e6c2466ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:35.090619 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286774e-8e9d-4d5b-93b1-e0e6c2466ccb None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:35.091376 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2286774e-8e9d-4d5b-93b1-e0e6c2466ccb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:35.091687 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2286774e-8e9d-4d5b-93b1-e0e6c2466ccb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:35.093107 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2286774e-8e9d-4d5b-93b1-e0e6c2466ccb None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:35.110175 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 168/342] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:47:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:35.111576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290252e-d000-4d59-8073-1aece649fe77 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:35.111871 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290252e-d000-4d59-8073-1aece649fe77 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:35.112225 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290252e-d000-4d59-8073-1aece649fe77 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:35.113562 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 169/343] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:35.119450 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290252e-d000-4d59-8073-1aece649fe77 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:35.122519 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 175/344] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:47:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:47:35.125712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f656f5-704b-4341-9d45-66276b8f6ac1 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:35.126188 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f656f5-704b-4341-9d45-66276b8f6ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:35.126712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f656f5-704b-4341-9d45-66276b8f6ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:35.147752 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-56f656f5-704b-4341-9d45-66276b8f6ac1 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:35.148965 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-56f656f5-704b-4341-9d45-66276b8f6ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:35.296280 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290252e-d000-4d59-8073-1aece649fe77 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:35.310202 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 176/345] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:47:35.311106 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f656f5-704b-4341-9d45-66276b8f6ac1 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:35.355218 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a1fb0-2505-4944-a501-d58b2df466a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:35.356307 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a1fb0-2505-4944-a501-d58b2df466a5 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:35.356807 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a1fb0-2505-4944-a501-d58b2df466a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:35.357306 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a1fb0-2505-4944-a501-d58b2df466a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:35.386179 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:35.422705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:35.477105 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a1fb0-2505-4944-a501-d58b2df466a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:35.481210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a1fb0-2505-4944-a501-d58b2df466a5 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:35.490878 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f656f5-704b-4341-9d45-66276b8f6ac1 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:35.567181 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291426d-6f5b-4bac-973b-9bff62b2813d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:35.570065 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291426d-6f5b-4bac-973b-9bff62b2813d None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:35.570586 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291426d-6f5b-4bac-973b-9bff62b2813d None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:35.571162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291426d-6f5b-4bac-973b-9bff62b2813d None admin] PATH_INFO: `/v3/projects/73bb6e1fa903475382715a00881f5cce` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:35.575410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291426d-6f5b-4bac-973b-9bff62b2813d None admin] RBAC: Authorizing `identity:get_project(project_id=73bb6e1fa903475382715a00881f5cce)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:35.578030 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291426d-6f5b-4bac-973b-9bff62b2813d None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:35.583025 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 177/346] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:47:35 2022] GET /identity/v3/projects/73bb6e1fa903475382715a00881f5cce => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:35.584041 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291426d-6f5b-4bac-973b-9bff62b2813d None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:35.692761 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 170/347] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:47:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:47:35.693642 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a1fb0-2505-4944-a501-d58b2df466a5 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:35.741830 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291426d-6f5b-4bac-973b-9bff62b2813d None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:35.758611 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:35.789854 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b415fb4b-6ef9-4663-bc99-8f29efc95277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:35.790762 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415fb4b-6ef9-4663-bc99-8f29efc95277 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:35.791744 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415fb4b-6ef9-4663-bc99-8f29efc95277 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:35.792063 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415fb4b-6ef9-4663-bc99-8f29efc95277 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:35.805405 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:35.811408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b415fb4b-6ef9-4663-bc99-8f29efc95277 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:35.832409 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a1fb0-2505-4944-a501-d58b2df466a5 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:35.832579 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-b415fb4b-6ef9-4663-bc99-8f29efc95277 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:47:35.832579 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:35.832579 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:35.832579 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:35.832579 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:35.832579 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:35.832579 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:35.832579 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:35.832579 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:35.832579 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:35.832579 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:35.832579 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:35.832579 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:35.832579 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:35.832579 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:35.832579 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:35.833446 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:35.833446 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:35.833446 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:35.833446 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:35.833446 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:35.833446 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:35.833446 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:35.833446 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:35.833446 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:35.833446 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:35.833446 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:35.833446 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:35.833446 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:35.833446 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:35.833446 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:35.833446 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:35.834263 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:35.834263 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:35.834263 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:35.834263 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:35.834263 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:35.834263 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:35.834263 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:35.834263 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:35.834263 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:35.834263 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:35.834263 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:47:35.834263 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:47:35.834263 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 178/348] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:47:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:35.834263 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b415fb4b-6ef9-4663-bc99-8f29efc95277 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:35.877397 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee859a5-6c7e-4561-8add-b2703fbf0c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:35.878279 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee859a5-6c7e-4561-8add-b2703fbf0c65 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:35.878586 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee859a5-6c7e-4561-8add-b2703fbf0c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:35.879110 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee859a5-6c7e-4561-8add-b2703fbf0c65 None admin] PATH_INFO: `/v3/groups/1df601de797c453195fcdc94d24b5fd4` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:35.887742 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee859a5-6c7e-4561-8add-b2703fbf0c65 None admin] RBAC: Authorizing `identity:get_group(group_id=1df601de797c453195fcdc94d24b5fd4)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:35.889752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee859a5-6c7e-4561-8add-b2703fbf0c65 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:35.895115 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 171/349] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Jul 11 20:47:35 2022] GET /identity/v3/groups/1df601de797c453195fcdc94d24b5fd4 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:35.896748 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66dd00-cc68-4d97-a2d9-0dd122f8405d None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:35.897047 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66dd00-cc68-4d97-a2d9-0dd122f8405d None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:35.897329 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66dd00-cc68-4d97-a2d9-0dd122f8405d None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:35.898917 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 172/350] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:35.899615 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc66dd00-cc68-4d97-a2d9-0dd122f8405d None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:35.966172 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b415fb4b-6ef9-4663-bc99-8f29efc95277 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:36.007879 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d16144-248c-4dec-9c32-48fccecc05f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:36.008783 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d16144-248c-4dec-9c32-48fccecc05f2 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:36.009192 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d16144-248c-4dec-9c32-48fccecc05f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:36.009722 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d16144-248c-4dec-9c32-48fccecc05f2 None admin] PATH_INFO: `/v3/projects/73bb6e1fa903475382715a00881f5cce` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:36.011228 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d16144-248c-4dec-9c32-48fccecc05f2 None admin] RBAC: Authorizing `identity:get_project(project_id=73bb6e1fa903475382715a00881f5cce)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:36.012733 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d16144-248c-4dec-9c32-48fccecc05f2 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:36.014633 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 179/351] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:47:35 2022] GET /identity/v3/projects/73bb6e1fa903475382715a00881f5cce => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:36.015629 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc3254-051b-47b9-9a6a-fcf370eee69f None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:36.015922 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc3254-051b-47b9-9a6a-fcf370eee69f None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:36.017338 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc3254-051b-47b9-9a6a-fcf370eee69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:36.036940 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-38cc3254-051b-47b9-9a6a-fcf370eee69f None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:36.038192 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-38cc3254-051b-47b9-9a6a-fcf370eee69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:36.055205 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc66dd00-cc68-4d97-a2d9-0dd122f8405d None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:36.066969 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:36.106675 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a06a8-3145-4a8a-9592-ffd4d774858c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:36.107434 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a06a8-3145-4a8a-9592-ffd4d774858c None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:36.111140 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a06a8-3145-4a8a-9592-ffd4d774858c None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:36.111140 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a06a8-3145-4a8a-9592-ffd4d774858c None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:36.111140 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a06a8-3145-4a8a-9592-ffd4d774858c None admin] RBAC: Adding query filter params (name=member) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:36.111140 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a06a8-3145-4a8a-9592-ffd4d774858c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:36.111140 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a06a8-3145-4a8a-9592-ffd4d774858c None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:36.114892 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:36.123911 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 173/352] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 11 20:47:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:36.125514 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a06a8-3145-4a8a-9592-ffd4d774858c None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:36.125784 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 180/353] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:36.127113 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed65826-f427-489f-a874-030e0cdcc6c5 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:36.127467 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed65826-f427-489f-a874-030e0cdcc6c5 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:36.127759 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed65826-f427-489f-a874-030e0cdcc6c5 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:36.129248 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 181/354] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:36.129810 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed65826-f427-489f-a874-030e0cdcc6c5 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:36.257338 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a06a8-3145-4a8a-9592-ffd4d774858c None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:36.277147 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed65826-f427-489f-a874-030e0cdcc6c5 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:36.304538 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d11ec-b345-4d5c-b907-e6088f7d3106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:36.305216 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d11ec-b345-4d5c-b907-e6088f7d3106 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:36.305502 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d11ec-b345-4d5c-b907-e6088f7d3106 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:36.305779 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d11ec-b345-4d5c-b907-e6088f7d3106 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:36.306961 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3d11ec-b345-4d5c-b907-e6088f7d3106 None admin] RBAC: Adding query filter params (group.id=1df601de797c453195fcdc94d24b5fd4, role.id=cf0f875ea1ba45758bd4f52a845d807e, scope.project.id=73bb6e1fa903475382715a00881f5cce) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:36.307283 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3d11ec-b345-4d5c-b907-e6088f7d3106 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:36.308888 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3d11ec-b345-4d5c-b907-e6088f7d3106 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:36.316296 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 174/355] 10.222.0.40 () {56 vars in 1376 bytes} [Mon Jul 11 20:47:36 2022] GET /identity/v3/role_assignments?group.id=1df601de797c453195fcdc94d24b5fd4&scope.project.id=73bb6e1fa903475382715a00881f5cce&role.id=cf0f875ea1ba45758bd4f52a845d807e => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:36.317451 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d11ec-b345-4d5c-b907-e6088f7d3106 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:36.325123 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0ffb5-8536-4693-96b2-026478419337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:36.326015 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0ffb5-8536-4693-96b2-026478419337 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:36.326302 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0ffb5-8536-4693-96b2-026478419337 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:36.326582 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0ffb5-8536-4693-96b2-026478419337 None admin] PATH_INFO: `/v3/groups/1df601de797c453195fcdc94d24b5fd4` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:36.327857 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece0ffb5-8536-4693-96b2-026478419337 None admin] RBAC: Authorizing `identity:get_group(group_id=1df601de797c453195fcdc94d24b5fd4)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:36.330527 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece0ffb5-8536-4693-96b2-026478419337 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:36.332574 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 182/356] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Jul 11 20:47:36 2022] GET /identity/v3/groups/1df601de797c453195fcdc94d24b5fd4 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:36.336953 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404394c-b542-49d6-bcd5-5405b31e327d None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:36.336953 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404394c-b542-49d6-bcd5-5405b31e327d None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:36.336953 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404394c-b542-49d6-bcd5-5405b31e327d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:36.359829 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-9404394c-b542-49d6-bcd5-5405b31e327d None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:36.361263 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-9404394c-b542-49d6-bcd5-5405b31e327d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:36.372365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:36.460158 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:36.472306 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 183/357] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:36.473285 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404394c-b542-49d6-bcd5-5405b31e327d None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:36.482173 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d11ec-b345-4d5c-b907-e6088f7d3106 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:36.533479 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d76c1-518a-4123-a19b-a47921d0a4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:36.534554 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d76c1-518a-4123-a19b-a47921d0a4f9 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:36.534848 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d76c1-518a-4123-a19b-a47921d0a4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:36.535128 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d76c1-518a-4123-a19b-a47921d0a4f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:36.596384 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404394c-b542-49d6-bcd5-5405b31e327d None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:36.631957 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d76c1-518a-4123-a19b-a47921d0a4f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:36.633522 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d76c1-518a-4123-a19b-a47921d0a4f9 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:36.648212 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574ade1-832e-48de-9cc5-718e54d27bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:36.649511 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574ade1-832e-48de-9cc5-718e54d27bae None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:36.649511 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574ade1-832e-48de-9cc5-718e54d27bae None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:36.649687 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574ade1-832e-48de-9cc5-718e54d27bae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:36.662342 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a574ade1-832e-48de-9cc5-718e54d27bae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:36.670706 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-a574ade1-832e-48de-9cc5-718e54d27bae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:47:36.670706 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:36.670706 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:36.670706 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:36.670706 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:36.670706 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:36.670706 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:36.670706 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:36.670706 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:36.670706 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:36.670706 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:36.670706 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:36.670706 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:36.670706 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:36.670706 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:36.670706 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:36.671534 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:36.671534 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:36.671534 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:36.671534 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:36.671534 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:36.671534 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:36.671534 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:36.671534 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:36.671534 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:36.671534 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:36.671534 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:36.671534 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:36.671534 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:36.671534 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:36.671534 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:36.671534 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:36.672693 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:36.672693 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:36.672693 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:36.672693 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:36.672693 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:36.672693 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:36.672693 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:36.672693 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:36.672693 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:36.672693 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:36.672693 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:47:36.672693 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:47:36.672693 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 184/358] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jul 11 20:47:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:36.673638 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574ade1-832e-48de-9cc5-718e54d27bae None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:36.679655 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:36.747310 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:36.766428 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 175/359] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:47:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:47:36.768116 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e44c5f-e7e6-4edb-a10d-4437ce6a87e1 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:36.768410 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e44c5f-e7e6-4edb-a10d-4437ce6a87e1 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:36.770699 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e44c5f-e7e6-4edb-a10d-4437ce6a87e1 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:36.770699 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 176/360] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:36.770699 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e44c5f-e7e6-4edb-a10d-4437ce6a87e1 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:36.807873 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574ade1-832e-48de-9cc5-718e54d27bae None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:36.846820 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937b017-99bc-4a50-91b6-58d4a03d7bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:36.847767 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937b017-99bc-4a50-91b6-58d4a03d7bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:36.847767 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937b017-99bc-4a50-91b6-58d4a03d7bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:36.848086 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937b017-99bc-4a50-91b6-58d4a03d7bb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:36.849263 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937b017-99bc-4a50-91b6-58d4a03d7bb7 None admin] RBAC: Adding query filter params (group.id=1df601de797c453195fcdc94d24b5fd4, role.id=c2117c810f7b4e6aaf684c3d37b0ea3e, scope.project.id=73bb6e1fa903475382715a00881f5cce) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:36.849263 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937b017-99bc-4a50-91b6-58d4a03d7bb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:36.850657 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937b017-99bc-4a50-91b6-58d4a03d7bb7 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:36.861678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 185/361] 10.222.0.40 () {56 vars in 1376 bytes} [Mon Jul 11 20:47:36 2022] GET /identity/v3/role_assignments?group.id=1df601de797c453195fcdc94d24b5fd4&scope.project.id=73bb6e1fa903475382715a00881f5cce&role.id=c2117c810f7b4e6aaf684c3d37b0ea3e => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:36.862320 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937b017-99bc-4a50-91b6-58d4a03d7bb7 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:36.901928 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e44c5f-e7e6-4edb-a10d-4437ce6a87e1 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:36.949713 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649c3ea0-2fb3-473e-850e-27ef7a761671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:36.950865 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c3ea0-2fb3-473e-850e-27ef7a761671 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:36.951154 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c3ea0-2fb3-473e-850e-27ef7a761671 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:36.951435 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c3ea0-2fb3-473e-850e-27ef7a761671 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:36.955207 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:36.970307 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649c3ea0-2fb3-473e-850e-27ef7a761671 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:36.982013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-649c3ea0-2fb3-473e-850e-27ef7a761671 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 20:47:36.982013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:36.982013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:36.982013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:36.982013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:36.982013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:36.982013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:36.982013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:36.982013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:36.982013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:36.982013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:36.982013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:36.982013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:36.982013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:36.982013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:36.982013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:36.982906 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:36.982906 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:36.982906 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:36.982906 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:36.982906 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:36.982906 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:36.982906 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:36.982906 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:36.982906 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:36.982906 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:36.982906 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:36.982906 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:36.982906 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:36.982906 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:36.982906 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:36.982906 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:36.983693 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:36.983693 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:36.983693 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:36.983693 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:36.983693 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:36.983693 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:36.983693 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:36.983693 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:36.983693 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:36.983693 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:36.983693 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 20:47:36.983693 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:47:36.983693 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 177/362] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:47:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:36.985432 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649c3ea0-2fb3-473e-850e-27ef7a761671 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:36.997757 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937b017-99bc-4a50-91b6-58d4a03d7bb7 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:37.023025 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:37.044263 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20849e6e-0715-4d9e-b283-d66b59991e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:37.045127 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20849e6e-0715-4d9e-b283-d66b59991e26 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:37.045504 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20849e6e-0715-4d9e-b283-d66b59991e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:37.046005 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20849e6e-0715-4d9e-b283-d66b59991e26 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:37.046927 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20849e6e-0715-4d9e-b283-d66b59991e26 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:37.047253 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20849e6e-0715-4d9e-b283-d66b59991e26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:37.050062 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20849e6e-0715-4d9e-b283-d66b59991e26 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:37.061812 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 186/363] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:47:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:37.063160 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee02b8-64f2-45de-ba28-6965c0333501 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:37.063453 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee02b8-64f2-45de-ba28-6965c0333501 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:37.063864 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee02b8-64f2-45de-ba28-6965c0333501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:37.092729 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-a1ee02b8-64f2-45de-ba28-6965c0333501 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:37.093939 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a1ee02b8-64f2-45de-ba28-6965c0333501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:37.125903 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649c3ea0-2fb3-473e-850e-27ef7a761671 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:37.162243 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1396128-92a2-4574-871b-dc39522f13f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:37.163452 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1396128-92a2-4574-871b-dc39522f13f0 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:37.164003 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1396128-92a2-4574-871b-dc39522f13f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:37.164497 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1396128-92a2-4574-871b-dc39522f13f0 None admin] PATH_INFO: `/v3/projects/549948b5ac834c07b634e08f7b1ec58d` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:37.166676 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1396128-92a2-4574-871b-dc39522f13f0 None admin] RBAC: Authorizing `identity:get_project(project_id=549948b5ac834c07b634e08f7b1ec58d)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:37.168371 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1396128-92a2-4574-871b-dc39522f13f0 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:37.172115 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 178/364] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:47:36 2022] GET /identity/v3/projects/549948b5ac834c07b634e08f7b1ec58d => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:37.173808 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1396128-92a2-4574-871b-dc39522f13f0 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:37.189738 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 187/365] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:37.190596 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee02b8-64f2-45de-ba28-6965c0333501 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:37.254827 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:37.316174 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1396128-92a2-4574-871b-dc39522f13f0 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:37.344425 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee02b8-64f2-45de-ba28-6965c0333501 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:37.354119 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847689b-7301-44a7-9efd-0a486e8ad429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:37.355113 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847689b-7301-44a7-9efd-0a486e8ad429 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:37.355585 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847689b-7301-44a7-9efd-0a486e8ad429 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:37.356054 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847689b-7301-44a7-9efd-0a486e8ad429 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:37.357094 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:37.357808 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f847689b-7301-44a7-9efd-0a486e8ad429 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:37.358261 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f847689b-7301-44a7-9efd-0a486e8ad429 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:37.359761 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f847689b-7301-44a7-9efd-0a486e8ad429 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:37.369675 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 179/366] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 11 20:47:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:37.370942 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847689b-7301-44a7-9efd-0a486e8ad429 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:37.383145 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317f2a8-68b8-477f-940c-7a8fe9bd5f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:37.383957 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317f2a8-68b8-477f-940c-7a8fe9bd5f35 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:37.384464 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317f2a8-68b8-477f-940c-7a8fe9bd5f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:37.384843 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317f2a8-68b8-477f-940c-7a8fe9bd5f35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:37.456880 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317f2a8-68b8-477f-940c-7a8fe9bd5f35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:37.458512 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317f2a8-68b8-477f-940c-7a8fe9bd5f35 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:37.495659 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847689b-7301-44a7-9efd-0a486e8ad429 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:37.532317 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:37.546840 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e90c37-89fb-43e6-970f-52f8522e894b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:37.548053 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e90c37-89fb-43e6-970f-52f8522e894b None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:37.548400 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e90c37-89fb-43e6-970f-52f8522e894b None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:37.548757 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e90c37-89fb-43e6-970f-52f8522e894b None admin] PATH_INFO: `/v3/groups/1df601de797c453195fcdc94d24b5fd4` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:37.551040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e90c37-89fb-43e6-970f-52f8522e894b None admin] RBAC: Authorizing `identity:get_group(group_id=1df601de797c453195fcdc94d24b5fd4)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:37.553182 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e90c37-89fb-43e6-970f-52f8522e894b None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:37.556155 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 180/367] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Jul 11 20:47:37 2022] GET /identity/v3/groups/1df601de797c453195fcdc94d24b5fd4 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:37.557481 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e90c37-89fb-43e6-970f-52f8522e894b None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:37.579553 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 188/368] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:47:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:47:37.580437 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317f2a8-68b8-477f-940c-7a8fe9bd5f35 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:37.593126 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:37.694518 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317f2a8-68b8-477f-940c-7a8fe9bd5f35 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:37.696108 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e90c37-89fb-43e6-970f-52f8522e894b None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:37.732964 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408070f-4106-40f3-99fc-78dc6874f62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:37.733863 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408070f-4106-40f3-99fc-78dc6874f62b None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:37.734219 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408070f-4106-40f3-99fc-78dc6874f62b None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:37.734572 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408070f-4106-40f3-99fc-78dc6874f62b None admin] PATH_INFO: `/v3/users/40d222b7a3e6458285fd4d85c4d0345d` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:37.735943 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408070f-4106-40f3-99fc-78dc6874f62b None admin] RBAC: Authorizing `identity:get_user(user_id=40d222b7a3e6458285fd4d85c4d0345d)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:37.737700 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408070f-4106-40f3-99fc-78dc6874f62b None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:37.738314 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84102e6-6639-406b-af4c-82fd40d094d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:37.739186 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84102e6-6639-406b-af4c-82fd40d094d2 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:37.739578 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 189/369] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:47:37 2022] GET /identity/v3/users/40d222b7a3e6458285fd4d85c4d0345d => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:37.739830 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84102e6-6639-406b-af4c-82fd40d094d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:37.740149 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84102e6-6639-406b-af4c-82fd40d094d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:37.740691 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408070f-4106-40f3-99fc-78dc6874f62b None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:37.756153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84102e6-6639-406b-af4c-82fd40d094d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:37.766640 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-f84102e6-6639-406b-af4c-82fd40d094d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:47:37.766640 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:37.766640 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:37.766640 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:37.766640 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:37.766640 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:37.766640 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:37.766640 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:37.766640 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:37.766640 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:37.766640 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:37.766640 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:37.766640 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:37.766640 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:37.766640 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:37.766640 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:37.767517 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:37.767517 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:37.767517 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:37.767517 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:37.767517 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:37.767517 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:37.767517 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:37.767517 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:37.767517 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:37.767517 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:37.767517 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:37.767517 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:37.767517 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:37.767517 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:37.767517 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:37.767517 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:37.768389 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:37.768389 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:37.768389 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:37.768389 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:37.768389 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:37.768389 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:37.768389 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:37.768389 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:37.768389 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:37.768389 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:37.768389 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:47:37.768389 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:47:37.768996 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 181/370] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 11 20:47:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:37.769538 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84102e6-6639-406b-af4c-82fd40d094d2 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:37.837708 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:37.842640 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:37.860779 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408070f-4106-40f3-99fc-78dc6874f62b None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:37.906151 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84102e6-6639-406b-af4c-82fd40d094d2 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:37.912261 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f19bff-4a19-45ce-a1ce-d67940d72fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:37.912932 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f19bff-4a19-45ce-a1ce-d67940d72fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:37.913221 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f19bff-4a19-45ce-a1ce-d67940d72fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:37.913497 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f19bff-4a19-45ce-a1ce-d67940d72fc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:37.915343 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f19bff-4a19-45ce-a1ce-d67940d72fc7 None admin] RBAC: Adding query filter params (group.id=1df601de797c453195fcdc94d24b5fd4, role.id=cf0f875ea1ba45758bd4f52a845d807e, scope.project.id=549948b5ac834c07b634e08f7b1ec58d) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:37.916216 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f19bff-4a19-45ce-a1ce-d67940d72fc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:37.917664 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f19bff-4a19-45ce-a1ce-d67940d72fc7 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:37.925839 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 190/371] 10.222.0.40 () {56 vars in 1376 bytes} [Mon Jul 11 20:47:37 2022] GET /identity/v3/role_assignments?group.id=1df601de797c453195fcdc94d24b5fd4&scope.project.id=549948b5ac834c07b634e08f7b1ec58d&role.id=cf0f875ea1ba45758bd4f52a845d807e => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:37.927741 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f19bff-4a19-45ce-a1ce-d67940d72fc7 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:37.961838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f15b9-6e38-4a0a-8287-646c7e370606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:37.963264 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f15b9-6e38-4a0a-8287-646c7e370606 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:37.963745 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f15b9-6e38-4a0a-8287-646c7e370606 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:37.964041 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f15b9-6e38-4a0a-8287-646c7e370606 None admin] PATH_INFO: `/v3/projects/549948b5ac834c07b634e08f7b1ec58d` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:37.965302 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918f15b9-6e38-4a0a-8287-646c7e370606 None admin] RBAC: Authorizing `identity:get_project(project_id=549948b5ac834c07b634e08f7b1ec58d)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:37.966853 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918f15b9-6e38-4a0a-8287-646c7e370606 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:37.973053 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 182/372] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:47:37 2022] GET /identity/v3/projects/549948b5ac834c07b634e08f7b1ec58d => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:37.973754 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f15b9-6e38-4a0a-8287-646c7e370606 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:38.054139 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f19bff-4a19-45ce-a1ce-d67940d72fc7 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:38.097469 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6072b-58d0-48eb-ba91-0d5e47a00db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:38.098147 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6072b-58d0-48eb-ba91-0d5e47a00db1 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:38.098436 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6072b-58d0-48eb-ba91-0d5e47a00db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:38.098711 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6072b-58d0-48eb-ba91-0d5e47a00db1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:38.099554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f6072b-58d0-48eb-ba91-0d5e47a00db1 None admin] RBAC: Adding query filter params (role.id=3a94b407c6914e15a379d3580c9c9ddf, user.id=40d222b7a3e6458285fd4d85c4d0345d, scope.system=all) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:38.099872 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f6072b-58d0-48eb-ba91-0d5e47a00db1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:38.102035 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f6072b-58d0-48eb-ba91-0d5e47a00db1 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:38.112705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:38.119311 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 191/373] 10.222.0.40 () {56 vars in 1308 bytes} [Mon Jul 11 20:47:37 2022] GET /identity/v3/role_assignments?user.id=40d222b7a3e6458285fd4d85c4d0345d&scope.system=all&role.id=3a94b407c6914e15a379d3580c9c9ddf => generated 510 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:38.120581 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6072b-58d0-48eb-ba91-0d5e47a00db1 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:38.206798 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f15b9-6e38-4a0a-8287-646c7e370606 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:38.246735 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:38.254386 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6072b-58d0-48eb-ba91-0d5e47a00db1 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:38.267370 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85104442-13d4-49a5-bb86-3c0e71f1fe25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:38.268082 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85104442-13d4-49a5-bb86-3c0e71f1fe25 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:38.268371 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85104442-13d4-49a5-bb86-3c0e71f1fe25 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:38.268647 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85104442-13d4-49a5-bb86-3c0e71f1fe25 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:38.269466 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85104442-13d4-49a5-bb86-3c0e71f1fe25 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:38.269781 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85104442-13d4-49a5-bb86-3c0e71f1fe25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:38.271275 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85104442-13d4-49a5-bb86-3c0e71f1fe25 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:38.290811 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 183/374] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:47:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:38.300608 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85104442-13d4-49a5-bb86-3c0e71f1fe25 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:38.303046 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999970d-52e5-451e-a3da-4056217408f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:38.304298 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999970d-52e5-451e-a3da-4056217408f0 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:38.304732 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999970d-52e5-451e-a3da-4056217408f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:38.305249 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999970d-52e5-451e-a3da-4056217408f0 None admin] PATH_INFO: `/v3/groups/1df601de797c453195fcdc94d24b5fd4` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:38.307203 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999970d-52e5-451e-a3da-4056217408f0 None admin] RBAC: Authorizing `identity:get_group(group_id=1df601de797c453195fcdc94d24b5fd4)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:38.308962 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999970d-52e5-451e-a3da-4056217408f0 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:38.311255 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 192/375] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Jul 11 20:47:38 2022] GET /identity/v3/groups/1df601de797c453195fcdc94d24b5fd4 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:38.317325 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999970d-52e5-451e-a3da-4056217408f0 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:38.393438 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:38.432428 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999970d-52e5-451e-a3da-4056217408f0 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:38.473887 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04dc3c-4724-447b-a017-657c501ef6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:38.474911 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04dc3c-4724-447b-a017-657c501ef6a9 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:38.475339 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04dc3c-4724-447b-a017-657c501ef6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:38.475757 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04dc3c-4724-447b-a017-657c501ef6a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:38.476888 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04dc3c-4724-447b-a017-657c501ef6a9 None admin] RBAC: Adding query filter params (group.id=1df601de797c453195fcdc94d24b5fd4, role.id=c2117c810f7b4e6aaf684c3d37b0ea3e, scope.project.id=549948b5ac834c07b634e08f7b1ec58d) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:38.477345 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04dc3c-4724-447b-a017-657c501ef6a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:38.479060 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04dc3c-4724-447b-a017-657c501ef6a9 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:38.486118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 193/376] 10.222.0.40 () {56 vars in 1376 bytes} [Mon Jul 11 20:47:38 2022] GET /identity/v3/role_assignments?group.id=1df601de797c453195fcdc94d24b5fd4&scope.project.id=549948b5ac834c07b634e08f7b1ec58d&role.id=c2117c810f7b4e6aaf684c3d37b0ea3e => generated 260 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:38.505451 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85104442-13d4-49a5-bb86-3c0e71f1fe25 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:38.554270 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a80ca-0fb2-4fcd-9a89-8f78eedcbcc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:38.555009 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a80ca-0fb2-4fcd-9a89-8f78eedcbcc4 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:38.555249 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a80ca-0fb2-4fcd-9a89-8f78eedcbcc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:38.555526 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a80ca-0fb2-4fcd-9a89-8f78eedcbcc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:38.628761 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:38.649962 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a80ca-0fb2-4fcd-9a89-8f78eedcbcc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:38.651604 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a80ca-0fb2-4fcd-9a89-8f78eedcbcc4 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:38.783734 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 184/377] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:47:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 20:47:38.789586 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04dc3c-4724-447b-a017-657c501ef6a9 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:38.916204 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04dc3c-4724-447b-a017-657c501ef6a9 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:38.952685 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:38.957688 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a3ab4-bf37-4c97-b5e8-8baaf8b32c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:38.958578 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a3ab4-bf37-4c97-b5e8-8baaf8b32c65 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:38.958867 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a3ab4-bf37-4c97-b5e8-8baaf8b32c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:38.959152 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a3ab4-bf37-4c97-b5e8-8baaf8b32c65 None admin] PATH_INFO: `/v3/projects/ae8bc79b1b6b4f7088e951983d34a626` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:38.960407 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a3ab4-bf37-4c97-b5e8-8baaf8b32c65 None admin] RBAC: Authorizing `identity:get_project(project_id=ae8bc79b1b6b4f7088e951983d34a626)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:38.961857 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a3ab4-bf37-4c97-b5e8-8baaf8b32c65 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:38.964543 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 194/378] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:47:38 2022] GET /identity/v3/projects/ae8bc79b1b6b4f7088e951983d34a626 => generated 344 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:47:38.969892 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a80ca-0fb2-4fcd-9a89-8f78eedcbcc4 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:39.033634 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f0f25-05ac-4e65-aa41-9302171f4fd9 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:39.033952 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f0f25-05ac-4e65-aa41-9302171f4fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:39.034202 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f0f25-05ac-4e65-aa41-9302171f4fd9 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:39.035585 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 195/379] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:47:39.043756 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df822ea3-334c-4841-8998-51c696d61e2e None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:39.044347 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df822ea3-334c-4841-8998-51c696d61e2e None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:39.044848 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df822ea3-334c-4841-8998-51c696d61e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:39.069657 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-df822ea3-334c-4841-8998-51c696d61e2e None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:39.070870 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-df822ea3-334c-4841-8998-51c696d61e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:39.096278 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:39.128899 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a80ca-0fb2-4fcd-9a89-8f78eedcbcc4 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:39.175121 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff20f3-ced2-48fd-b920-e6648608df40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:39.175917 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff20f3-ced2-48fd-b920-e6648608df40 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:39.176233 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff20f3-ced2-48fd-b920-e6648608df40 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:39.176530 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff20f3-ced2-48fd-b920-e6648608df40 None admin] PATH_INFO: `/v3/groups/8d2cb1fed8994a5c996f439a8a5c1cb8` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:39.182175 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff20f3-ced2-48fd-b920-e6648608df40 None admin] RBAC: Authorizing `identity:get_group(group_id=8d2cb1fed8994a5c996f439a8a5c1cb8)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:39.183638 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff20f3-ced2-48fd-b920-e6648608df40 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:39.186105 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 185/380] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Jul 11 20:47:38 2022] GET /identity/v3/groups/8d2cb1fed8994a5c996f439a8a5c1cb8 => generated 229 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:39.191861 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff20f3-ced2-48fd-b920-e6648608df40 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:39.213534 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 196/381] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:47:39.250248 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df822ea3-334c-4841-8998-51c696d61e2e None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:39.313736 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff20f3-ced2-48fd-b920-e6648608df40 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:39.355408 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a75b4-a496-4200-a1e2-f23f669980ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:39.356110 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a75b4-a496-4200-a1e2-f23f669980ed None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:39.356400 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a75b4-a496-4200-a1e2-f23f669980ed None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:39.356710 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a75b4-a496-4200-a1e2-f23f669980ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:39.358127 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a75b4-a496-4200-a1e2-f23f669980ed None admin] RBAC: Adding query filter params (group.id=8d2cb1fed8994a5c996f439a8a5c1cb8, role.id=86273ff072f3438d822e870272491768, scope.project.id=ae8bc79b1b6b4f7088e951983d34a626) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:39.358451 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a75b4-a496-4200-a1e2-f23f669980ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:39.359890 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a75b4-a496-4200-a1e2-f23f669980ed None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:39.368403 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 186/382] 10.222.0.40 () {56 vars in 1376 bytes} [Mon Jul 11 20:47:39 2022] GET /identity/v3/role_assignments?group.id=8d2cb1fed8994a5c996f439a8a5c1cb8&scope.project.id=ae8bc79b1b6b4f7088e951983d34a626&role.id=86273ff072f3438d822e870272491768 => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:39.420134 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df822ea3-334c-4841-8998-51c696d61e2e None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:39.454500 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:39.465641 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b3eb20-9872-4089-b6ca-ff7a03d6aaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:39.466485 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3eb20-9872-4089-b6ca-ff7a03d6aaba None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:39.466779 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3eb20-9872-4089-b6ca-ff7a03d6aaba None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:39.467061 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3eb20-9872-4089-b6ca-ff7a03d6aaba None admin] PATH_INFO: `/v3/roles/member` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:39.482999 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b3eb20-9872-4089-b6ca-ff7a03d6aaba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:39.490763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164b4da-bc80-440b-8e30-07fe306cef79 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:39.491058 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164b4da-bc80-440b-8e30-07fe306cef79 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:39.491344 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164b4da-bc80-440b-8e30-07fe306cef79 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:39.493712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-75b3eb20-9872-4089-b6ca-ff7a03d6aaba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:47:39.493712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:39.493712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:39.493712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:39.493712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:39.493712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:39.493712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:39.493712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:39.493712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:39.493712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:39.493712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:39.493712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:39.493712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:39.493712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:39.493712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:39.493712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:39.494581 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:39.494581 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:39.494581 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:39.494581 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:39.494581 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:39.494581 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:39.494581 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:39.494581 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:39.494581 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:39.494581 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:39.494581 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:39.494581 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:39.494581 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:39.494581 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:39.494581 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:39.494581 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:39.495392 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:39.495392 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:39.495392 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:39.495392 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:39.495392 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:39.495392 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:39.495392 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:39.495392 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:39.495392 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:39.495392 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:39.495392 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:47:39.495392 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:47:39.496489 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 187/383] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:47:39.498503 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 197/384] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:47:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:39.502995 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5030dea-bd66-4abf-99a0-50678fbce214 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:39.503357 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5030dea-bd66-4abf-99a0-50678fbce214 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:39.503647 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5030dea-bd66-4abf-99a0-50678fbce214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:39.509328 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b3eb20-9872-4089-b6ca-ff7a03d6aaba None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:39.540052 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-c5030dea-bd66-4abf-99a0-50678fbce214 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:39.541869 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c5030dea-bd66-4abf-99a0-50678fbce214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:39.549192 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:39.641875 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b3eb20-9872-4089-b6ca-ff7a03d6aaba None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:39.698653 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f867a0-0b32-4239-a903-f9dfc4bf73aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:39.699350 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f867a0-0b32-4239-a903-f9dfc4bf73aa None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:39.699638 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f867a0-0b32-4239-a903-f9dfc4bf73aa None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:39.699912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f867a0-0b32-4239-a903-f9dfc4bf73aa None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:39.700696 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f867a0-0b32-4239-a903-f9dfc4bf73aa None admin] RBAC: Adding query filter params (name=member) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:39.701007 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f867a0-0b32-4239-a903-f9dfc4bf73aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:39.702514 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f867a0-0b32-4239-a903-f9dfc4bf73aa None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:39.719818 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 198/385] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 11 20:47:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:47:39.725060 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f867a0-0b32-4239-a903-f9dfc4bf73aa None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:39.749695 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 188/386] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:39.802062 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:39.810172 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5030dea-bd66-4abf-99a0-50678fbce214 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:39.906769 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f867a0-0b32-4239-a903-f9dfc4bf73aa None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:39.975704 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5030dea-bd66-4abf-99a0-50678fbce214 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:39.978664 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe1935-f586-4232-9d74-d2d8f19cc1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:39.979545 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe1935-f586-4232-9d74-d2d8f19cc1ce None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:39.979829 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe1935-f586-4232-9d74-d2d8f19cc1ce None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:39.980132 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe1935-f586-4232-9d74-d2d8f19cc1ce None admin] PATH_INFO: `/v3/groups/1df601de797c453195fcdc94d24b5fd4` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:39.981420 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe1935-f586-4232-9d74-d2d8f19cc1ce None admin] RBAC: Authorizing `identity:get_group(group_id=1df601de797c453195fcdc94d24b5fd4)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:39.982857 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe1935-f586-4232-9d74-d2d8f19cc1ce None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:39.984680 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 199/387] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Jul 11 20:47:39 2022] GET /identity/v3/groups/1df601de797c453195fcdc94d24b5fd4 => generated 226 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:39.991679 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe1935-f586-4232-9d74-d2d8f19cc1ce None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:40.052702 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee7813-dc31-408e-8a30-19c1c39aeb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:40.053527 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee7813-dc31-408e-8a30-19c1c39aeb52 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:40.053814 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee7813-dc31-408e-8a30-19c1c39aeb52 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:40.054089 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee7813-dc31-408e-8a30-19c1c39aeb52 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:40.070437 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:40.074882 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee7813-dc31-408e-8a30-19c1c39aeb52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:40.086831 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-83ee7813-dc31-408e-8a30-19c1c39aeb52 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:47:40.086831 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:40.086831 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:40.086831 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:40.086831 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:40.086831 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:40.086831 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:40.086831 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:40.086831 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:40.086831 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:40.086831 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:40.086831 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:40.086831 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:40.086831 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:40.086831 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:40.086831 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:40.088552 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:40.088552 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:40.088552 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:40.088552 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:40.088552 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:40.088552 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:40.088552 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:40.088552 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:40.088552 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:40.088552 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:40.088552 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:40.088552 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:40.088552 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:40.088552 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:40.088552 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:40.088552 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:40.089332 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:40.089332 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:40.089332 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:40.089332 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:40.089332 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:40.089332 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:40.089332 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:40.089332 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:40.089332 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:40.089332 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:40.089332 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:47:40.089332 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:47:40.092315 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 189/388] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jul 11 20:47:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:47:40.100393 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee7813-dc31-408e-8a30-19c1c39aeb52 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:40.200054 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe1935-f586-4232-9d74-d2d8f19cc1ce None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:40.223531 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee7813-dc31-408e-8a30-19c1c39aeb52 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:40.246523 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:40.268728 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360dd88-82a6-4cca-aa78-2dab23b4a280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:40.270011 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360dd88-82a6-4cca-aa78-2dab23b4a280 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:40.270557 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360dd88-82a6-4cca-aa78-2dab23b4a280 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:40.271042 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360dd88-82a6-4cca-aa78-2dab23b4a280 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:40.272212 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360dd88-82a6-4cca-aa78-2dab23b4a280 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:40.272753 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360dd88-82a6-4cca-aa78-2dab23b4a280 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:40.274362 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360dd88-82a6-4cca-aa78-2dab23b4a280 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:40.277267 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3dcf7-d5a5-41eb-a21e-f44c08c26198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:40.278162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3dcf7-d5a5-41eb-a21e-f44c08c26198 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:40.278445 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3dcf7-d5a5-41eb-a21e-f44c08c26198 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:40.278743 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3dcf7-d5a5-41eb-a21e-f44c08c26198 None admin] PATH_INFO: `/v3/projects/73bb6e1fa903475382715a00881f5cce` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:40.280705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda3dcf7-d5a5-41eb-a21e-f44c08c26198 None admin] RBAC: Authorizing `identity:get_project(project_id=73bb6e1fa903475382715a00881f5cce)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:40.282152 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda3dcf7-d5a5-41eb-a21e-f44c08c26198 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:40.284309 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 200/389] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:47:39 2022] GET /identity/v3/projects/73bb6e1fa903475382715a00881f5cce => generated 298 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:40.286594 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 190/390] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:47:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:40.289761 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3dcf7-d5a5-41eb-a21e-f44c08c26198 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:40.293139 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360dd88-82a6-4cca-aa78-2dab23b4a280 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:40.379605 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:40.454645 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360dd88-82a6-4cca-aa78-2dab23b4a280 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:40.474213 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3dcf7-d5a5-41eb-a21e-f44c08c26198 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:40.523948 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc4e90-d4aa-4e9f-95f1-20ed655cd83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:40.525326 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc4e90-d4aa-4e9f-95f1-20ed655cd83e None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:40.525592 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc4e90-d4aa-4e9f-95f1-20ed655cd83e None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:40.525907 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc4e90-d4aa-4e9f-95f1-20ed655cd83e None admin] PATH_INFO: `/v3/groups/1df601de797c453195fcdc94d24b5fd4` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:40.527699 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc4e90-d4aa-4e9f-95f1-20ed655cd83e None admin] RBAC: Authorizing `identity:get_group(group_id=1df601de797c453195fcdc94d24b5fd4)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:40.529170 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc4e90-d4aa-4e9f-95f1-20ed655cd83e None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:40.535853 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 191/391] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Jul 11 20:47:40 2022] GET /identity/v3/groups/1df601de797c453195fcdc94d24b5fd4 => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:40.543148 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc4e90-d4aa-4e9f-95f1-20ed655cd83e None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:40.544129 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e8a81-8eff-4b70-939f-6d46792540a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:40.545031 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e8a81-8eff-4b70-939f-6d46792540a5 None admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:40.545316 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e8a81-8eff-4b70-939f-6d46792540a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:40.545594 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e8a81-8eff-4b70-939f-6d46792540a5 None admin] PATH_INFO: `/v3/projects/73bb6e1fa903475382715a00881f5cce/groups/1df601de797c453195fcdc94d24b5fd4/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:40.549329 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e8a81-8eff-4b70-939f-6d46792540a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=73bb6e1fa903475382715a00881f5cce, group_id=1df601de797c453195fcdc94d24b5fd4, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:40.552652 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e8a81-8eff-4b70-939f-6d46792540a5 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:40.669316 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc4e90-d4aa-4e9f-95f1-20ed655cd83e None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:40.685077 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 201/392] 10.222.0.40 () {58 vars in 1442 bytes} [Mon Jul 11 20:47:40 2022] PUT /identity/v3/projects/73bb6e1fa903475382715a00881f5cce/groups/1df601de797c453195fcdc94d24b5fd4/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:47:40.688994 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a27f35-e739-4c5b-b881-642d6522d7b4 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:40.688994 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a27f35-e739-4c5b-b881-642d6522d7b4 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:40.688994 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a27f35-e739-4c5b-b881-642d6522d7b4 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:40.689879 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 202/393] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:40.702745 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2b963-50a1-4300-bc67-2522a3081525 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:40.703040 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2b963-50a1-4300-bc67-2522a3081525 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:40.704159 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2b963-50a1-4300-bc67-2522a3081525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:40.711941 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:40.727043 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96452b55-bf19-47de-9583-68cb79d796d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:40.728493 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96452b55-bf19-47de-9583-68cb79d796d4 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:40.728801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96452b55-bf19-47de-9583-68cb79d796d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:40.729123 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96452b55-bf19-47de-9583-68cb79d796d4 None admin] PATH_INFO: `/v3/projects/73bb6e1fa903475382715a00881f5cce` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:40.730603 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96452b55-bf19-47de-9583-68cb79d796d4 None admin] RBAC: Authorizing `identity:get_project(project_id=73bb6e1fa903475382715a00881f5cce)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:40.733652 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96452b55-bf19-47de-9583-68cb79d796d4 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:40.738389 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-06b2b963-50a1-4300-bc67-2522a3081525 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:40.739606 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-06b2b963-50a1-4300-bc67-2522a3081525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:40.740269 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 192/394] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:47:40 2022] GET /identity/v3/projects/73bb6e1fa903475382715a00881f5cce => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:40.741230 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96452b55-bf19-47de-9583-68cb79d796d4 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:40.831911 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:40.883258 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 203/395] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:40.908309 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2b963-50a1-4300-bc67-2522a3081525 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:40.909407 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96452b55-bf19-47de-9583-68cb79d796d4 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:40.954523 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1642315c-821a-481e-9c2d-8eef8497862c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:40.956246 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642315c-821a-481e-9c2d-8eef8497862c None admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:40.956562 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642315c-821a-481e-9c2d-8eef8497862c None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:40.956851 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642315c-821a-481e-9c2d-8eef8497862c None admin] PATH_INFO: `/v3/projects/73bb6e1fa903475382715a00881f5cce/groups/1df601de797c453195fcdc94d24b5fd4/roles/c2117c810f7b4e6aaf684c3d37b0ea3e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:40.959955 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1642315c-821a-481e-9c2d-8eef8497862c None admin] RBAC: Authorizing `identity:create_grant(project_id=73bb6e1fa903475382715a00881f5cce, group_id=1df601de797c453195fcdc94d24b5fd4, role_id=c2117c810f7b4e6aaf684c3d37b0ea3e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:40.961897 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1642315c-821a-481e-9c2d-8eef8497862c None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:41.026997 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 193/396] 10.222.0.40 () {58 vars in 1442 bytes} [Mon Jul 11 20:47:40 2022] PUT /identity/v3/projects/73bb6e1fa903475382715a00881f5cce/groups/1df601de797c453195fcdc94d24b5fd4/roles/c2117c810f7b4e6aaf684c3d37b0ea3e => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:47:41.041352 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2b963-50a1-4300-bc67-2522a3081525 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:41.084586 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28c8e3-f14b-47d0-9a3a-f0145b3ff905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:41.085735 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28c8e3-f14b-47d0-9a3a-f0145b3ff905 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:41.086224 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28c8e3-f14b-47d0-9a3a-f0145b3ff905 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:41.086714 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28c8e3-f14b-47d0-9a3a-f0145b3ff905 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:41.103197 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a28c8e3-f14b-47d0-9a3a-f0145b3ff905 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:41.111618 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-7a28c8e3-f14b-47d0-9a3a-f0145b3ff905 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:47:41.111618 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:41.111618 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:41.111618 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:41.111618 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:41.111618 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:41.111618 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:41.111618 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:41.111618 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:41.111618 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:41.111618 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:41.111618 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:41.111618 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:41.111618 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:41.111618 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:41.111618 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:41.112578 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:41.112578 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:41.112578 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:41.112578 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:41.112578 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:41.112578 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:41.112578 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:41.112578 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:41.112578 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:41.112578 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:41.112578 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:41.112578 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:41.112578 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:41.112578 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:41.112578 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:41.112578 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:41.113436 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:41.113436 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:41.113436 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:41.113436 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:41.113436 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:41.113436 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:41.113436 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:41.113436 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:41.113436 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:41.113436 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:41.113436 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:47:41.113436 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:47:41.115808 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 204/397] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:47:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:47:41.122528 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1642315c-821a-481e-9c2d-8eef8497862c None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:41.195793 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:41.246657 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1642315c-821a-481e-9c2d-8eef8497862c None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:41.285458 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f65ee-cb0d-45ec-ae80-3e4c1bbde091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:41.286489 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f65ee-cb0d-45ec-ae80-3e4c1bbde091 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:41.286989 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f65ee-cb0d-45ec-ae80-3e4c1bbde091 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:41.288747 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f65ee-cb0d-45ec-ae80-3e4c1bbde091 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:41.293706 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f65ee-cb0d-45ec-ae80-3e4c1bbde091 None admin] RBAC: Adding query filter params (name=member) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:41.293706 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f65ee-cb0d-45ec-ae80-3e4c1bbde091 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:41.293706 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f65ee-cb0d-45ec-ae80-3e4c1bbde091 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:41.301392 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 194/398] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 11 20:47:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:41.307727 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28c8e3-f14b-47d0-9a3a-f0145b3ff905 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:41.363275 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:41.433909 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878b28c-4bbc-47a4-9dc6-c9587164d193 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:41.434246 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878b28c-4bbc-47a4-9dc6-c9587164d193 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:41.434481 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878b28c-4bbc-47a4-9dc6-c9587164d193 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:41.437348 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 195/399] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:41.439457 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28c8e3-f14b-47d0-9a3a-f0145b3ff905 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:41.441413 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64529c20-af83-4431-9294-4c5ea2d89d21 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:41.441705 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64529c20-af83-4431-9294-4c5ea2d89d21 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:41.441988 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64529c20-af83-4431-9294-4c5ea2d89d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:41.474645 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-64529c20-af83-4431-9294-4c5ea2d89d21 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:41.477425 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-64529c20-af83-4431-9294-4c5ea2d89d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:41.502378 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ab44b-97e2-4513-bdb6-74dcda6c696e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:41.503747 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ab44b-97e2-4513-bdb6-74dcda6c696e None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:41.505728 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ab44b-97e2-4513-bdb6-74dcda6c696e None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:41.507592 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ab44b-97e2-4513-bdb6-74dcda6c696e None admin] PATH_INFO: `/v3/groups/1df601de797c453195fcdc94d24b5fd4` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:41.509223 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ab44b-97e2-4513-bdb6-74dcda6c696e None admin] RBAC: Authorizing `identity:get_group(group_id=1df601de797c453195fcdc94d24b5fd4)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:41.513365 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ab44b-97e2-4513-bdb6-74dcda6c696e None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:41.515267 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 205/400] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Jul 11 20:47:41 2022] GET /identity/v3/groups/1df601de797c453195fcdc94d24b5fd4 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:47:41.533520 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ab44b-97e2-4513-bdb6-74dcda6c696e None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:41.630568 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 196/401] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:47:41.649639 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64529c20-af83-4431-9294-4c5ea2d89d21 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:41.705850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:41.744410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ab44b-97e2-4513-bdb6-74dcda6c696e None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:41.755337 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:41.770264 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64529c20-af83-4431-9294-4c5ea2d89d21 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:41.797622 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b268c93-508f-43a2-bbf7-2cd82b4132bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:41.798528 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b268c93-508f-43a2-bbf7-2cd82b4132bf None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:41.798818 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b268c93-508f-43a2-bbf7-2cd82b4132bf None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:41.799096 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b268c93-508f-43a2-bbf7-2cd82b4132bf None admin] PATH_INFO: `/v3/projects/549948b5ac834c07b634e08f7b1ec58d` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:41.802709 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b268c93-508f-43a2-bbf7-2cd82b4132bf None admin] RBAC: Authorizing `identity:get_project(project_id=549948b5ac834c07b634e08f7b1ec58d)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:41.804194 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b268c93-508f-43a2-bbf7-2cd82b4132bf None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:41.806315 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 206/402] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:47:41 2022] GET /identity/v3/projects/549948b5ac834c07b634e08f7b1ec58d => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:41.811392 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7700ce-3b55-4020-91be-f7442ffdffab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:41.811595 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b268c93-508f-43a2-bbf7-2cd82b4132bf None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:41.812368 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7700ce-3b55-4020-91be-f7442ffdffab None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:41.812812 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7700ce-3b55-4020-91be-f7442ffdffab None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:41.813162 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7700ce-3b55-4020-91be-f7442ffdffab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:41.824598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7700ce-3b55-4020-91be-f7442ffdffab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:41.833058 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-ca7700ce-3b55-4020-91be-f7442ffdffab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:47:41.833058 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:41.833058 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:41.833058 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:41.833058 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:41.833058 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:41.833058 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:41.833058 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:41.833058 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:41.833058 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:41.833058 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:41.833058 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:41.833058 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:41.833058 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:41.833058 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:41.833058 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:41.833939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:41.833939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:41.833939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:41.833939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:41.833939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:41.833939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:41.833939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:41.833939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:41.833939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:41.833939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:41.833939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:41.833939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:41.833939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:41.833939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:41.833939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:41.833939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:41.834731 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:41.834731 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:41.834731 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:41.834731 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:41.834731 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:41.834731 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:41.834731 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:41.834731 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:41.834731 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:41.834731 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:41.834731 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:47:41.834731 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:47:41.834731 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 197/403] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jul 11 20:47:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:41.842779 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7700ce-3b55-4020-91be-f7442ffdffab None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:42.013636 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b268c93-508f-43a2-bbf7-2cd82b4132bf None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:42.036120 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7700ce-3b55-4020-91be-f7442ffdffab None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:42.047789 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:42.058480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136511f1-6114-4b36-841b-8ea4e482dde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:42.062855 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136511f1-6114-4b36-841b-8ea4e482dde4 None admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:42.062855 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136511f1-6114-4b36-841b-8ea4e482dde4 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:42.062855 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136511f1-6114-4b36-841b-8ea4e482dde4 None admin] PATH_INFO: `/v3/projects/549948b5ac834c07b634e08f7b1ec58d/groups/1df601de797c453195fcdc94d24b5fd4/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:42.063101 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136511f1-6114-4b36-841b-8ea4e482dde4 None admin] RBAC: Authorizing `identity:create_grant(project_id=549948b5ac834c07b634e08f7b1ec58d, group_id=1df601de797c453195fcdc94d24b5fd4, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:42.064532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136511f1-6114-4b36-841b-8ea4e482dde4 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:42.076243 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731d543-8d94-44b8-b83a-a136ffbb3148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:42.076928 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731d543-8d94-44b8-b83a-a136ffbb3148 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:42.077222 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731d543-8d94-44b8-b83a-a136ffbb3148 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:42.077506 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731d543-8d94-44b8-b83a-a136ffbb3148 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:42.078409 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5731d543-8d94-44b8-b83a-a136ffbb3148 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:42.078763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5731d543-8d94-44b8-b83a-a136ffbb3148 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:42.080206 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5731d543-8d94-44b8-b83a-a136ffbb3148 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:42.093677 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 198/404] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:47:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:42.093677 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0af7cd-b2b2-48fd-8ebe-36fc7e6076b3 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:42.093677 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0af7cd-b2b2-48fd-8ebe-36fc7e6076b3 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:42.093677 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0af7cd-b2b2-48fd-8ebe-36fc7e6076b3 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:42.096051 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 199/405] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:42.097304 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0af7cd-b2b2-48fd-8ebe-36fc7e6076b3 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:42.178410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 207/406] 10.222.0.40 () {58 vars in 1442 bytes} [Mon Jul 11 20:47:41 2022] PUT /identity/v3/projects/549948b5ac834c07b634e08f7b1ec58d/groups/1df601de797c453195fcdc94d24b5fd4/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:47:42.178410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd813fe4-9660-4ac3-8afb-21f1edc86e66 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:42.178410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd813fe4-9660-4ac3-8afb-21f1edc86e66 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:42.178410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd813fe4-9660-4ac3-8afb-21f1edc86e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:42.209539 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-bd813fe4-9660-4ac3-8afb-21f1edc86e66 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:42.210974 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-bd813fe4-9660-4ac3-8afb-21f1edc86e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:42.256198 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0af7cd-b2b2-48fd-8ebe-36fc7e6076b3 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:42.271737 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:42.329232 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad1f55-7120-4670-86c9-f00ff39e1781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:42.330121 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad1f55-7120-4670-86c9-f00ff39e1781 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:42.330403 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad1f55-7120-4670-86c9-f00ff39e1781 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:42.330678 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad1f55-7120-4670-86c9-f00ff39e1781 None admin] PATH_INFO: `/v3/groups/1df601de797c453195fcdc94d24b5fd4` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:42.332139 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad1f55-7120-4670-86c9-f00ff39e1781 None admin] RBAC: Authorizing `identity:get_group(group_id=1df601de797c453195fcdc94d24b5fd4)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:42.333586 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad1f55-7120-4670-86c9-f00ff39e1781 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:42.339589 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 200/407] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Jul 11 20:47:42 2022] GET /identity/v3/groups/1df601de797c453195fcdc94d24b5fd4 => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:42.346950 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad1f55-7120-4670-86c9-f00ff39e1781 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:42.349505 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 208/408] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:42.380686 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd813fe4-9660-4ac3-8afb-21f1edc86e66 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:42.408607 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:42.481547 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad1f55-7120-4670-86c9-f00ff39e1781 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:42.522046 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696ea2f-716a-4a84-9b84-fd79b540b90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:42.522843 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696ea2f-716a-4a84-9b84-fd79b540b90b None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:42.523130 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696ea2f-716a-4a84-9b84-fd79b540b90b None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:42.523841 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696ea2f-716a-4a84-9b84-fd79b540b90b None admin] PATH_INFO: `/v3/projects/549948b5ac834c07b634e08f7b1ec58d` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:42.525745 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1696ea2f-716a-4a84-9b84-fd79b540b90b None admin] RBAC: Authorizing `identity:get_project(project_id=549948b5ac834c07b634e08f7b1ec58d)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:42.527352 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1696ea2f-716a-4a84-9b84-fd79b540b90b None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:42.529679 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 201/409] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:47:42 2022] GET /identity/v3/projects/549948b5ac834c07b634e08f7b1ec58d => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:42.534787 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696ea2f-716a-4a84-9b84-fd79b540b90b None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:42.545278 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd813fe4-9660-4ac3-8afb-21f1edc86e66 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:42.648014 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696ea2f-716a-4a84-9b84-fd79b540b90b None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:42.671745 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:42.692697 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c502f-4070-44df-80ef-ad238f400fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:42.699087 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c502f-4070-44df-80ef-ad238f400fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:42.699087 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c502f-4070-44df-80ef-ad238f400fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:42.699087 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c502f-4070-44df-80ef-ad238f400fb9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:42.699369 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c674d6-4807-4a20-9d1c-544487b7eb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:42.699633 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c674d6-4807-4a20-9d1c-544487b7eb27 None admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:42.700127 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c674d6-4807-4a20-9d1c-544487b7eb27 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:42.700616 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c674d6-4807-4a20-9d1c-544487b7eb27 None admin] PATH_INFO: `/v3/projects/549948b5ac834c07b634e08f7b1ec58d/groups/1df601de797c453195fcdc94d24b5fd4/roles/c2117c810f7b4e6aaf684c3d37b0ea3e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:42.703358 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c674d6-4807-4a20-9d1c-544487b7eb27 None admin] RBAC: Authorizing `identity:create_grant(project_id=549948b5ac834c07b634e08f7b1ec58d, group_id=1df601de797c453195fcdc94d24b5fd4, role_id=c2117c810f7b4e6aaf684c3d37b0ea3e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:42.705450 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c674d6-4807-4a20-9d1c-544487b7eb27 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:42.720252 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c502f-4070-44df-80ef-ad238f400fb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:42.728951 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-445c502f-4070-44df-80ef-ad238f400fb9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:47:42.728951 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:42.728951 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:42.728951 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:42.728951 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:42.728951 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:42.728951 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:42.728951 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:42.728951 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:42.728951 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:42.728951 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:42.728951 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:42.728951 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:42.728951 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:42.728951 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:42.728951 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:42.736314 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:42.736314 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:42.736314 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:42.736314 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:42.736314 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:42.736314 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:42.736314 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:42.736314 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:42.736314 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:42.736314 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:42.736314 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:42.736314 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:42.736314 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:42.736314 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:42.736314 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:42.736314 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:42.737098 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:42.737098 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:42.737098 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:42.737098 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:42.737098 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:42.737098 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:42.737098 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:42.737098 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:42.737098 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:42.737098 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:42.737098 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:47:42.737098 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:47:42.737098 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 209/410] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 11 20:47:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:47:42.738808 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c502f-4070-44df-80ef-ad238f400fb9 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:42.766963 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:42.792267 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 202/411] 10.222.0.40 () {58 vars in 1442 bytes} [Mon Jul 11 20:47:42 2022] PUT /identity/v3/projects/549948b5ac834c07b634e08f7b1ec58d/groups/1df601de797c453195fcdc94d24b5fd4/roles/c2117c810f7b4e6aaf684c3d37b0ea3e => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:47:42.864396 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c502f-4070-44df-80ef-ad238f400fb9 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:42.922178 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59430f62-6f3f-447b-bb9e-548ca81c7780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:42.922883 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59430f62-6f3f-447b-bb9e-548ca81c7780 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:42.923173 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59430f62-6f3f-447b-bb9e-548ca81c7780 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:42.923452 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59430f62-6f3f-447b-bb9e-548ca81c7780 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:42.924246 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59430f62-6f3f-447b-bb9e-548ca81c7780 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:42.924564 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59430f62-6f3f-447b-bb9e-548ca81c7780 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:42.925978 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59430f62-6f3f-447b-bb9e-548ca81c7780 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:42.940933 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 210/412] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:47:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:42.946517 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c674d6-4807-4a20-9d1c-544487b7eb27 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:43.071463 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c674d6-4807-4a20-9d1c-544487b7eb27 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:43.106634 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37088ec-5f5e-44d1-9fb4-d58def0b7d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:43.107555 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37088ec-5f5e-44d1-9fb4-d58def0b7d19 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:43.107842 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37088ec-5f5e-44d1-9fb4-d58def0b7d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:43.108151 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37088ec-5f5e-44d1-9fb4-d58def0b7d19 None admin] PATH_INFO: `/v3/groups/8d2cb1fed8994a5c996f439a8a5c1cb8` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:43.109330 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37088ec-5f5e-44d1-9fb4-d58def0b7d19 None admin] RBAC: Authorizing `identity:get_group(group_id=8d2cb1fed8994a5c996f439a8a5c1cb8)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:43.110764 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37088ec-5f5e-44d1-9fb4-d58def0b7d19 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:43.112584 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 203/413] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Jul 11 20:47:42 2022] GET /identity/v3/groups/8d2cb1fed8994a5c996f439a8a5c1cb8 => generated 229 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:43.118084 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59430f62-6f3f-447b-bb9e-548ca81c7780 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:43.205594 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e8977-4a7f-4e74-ab92-fcce62c3d57a None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:43.205952 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e8977-4a7f-4e74-ab92-fcce62c3d57a None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:43.206164 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e8977-4a7f-4e74-ab92-fcce62c3d57a None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:43.210206 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 204/414] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:43.216445 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef0981-8b0a-4a42-95e5-fbdd4357a012 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:43.216846 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef0981-8b0a-4a42-95e5-fbdd4357a012 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:43.217128 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef0981-8b0a-4a42-95e5-fbdd4357a012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:43.244380 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-18ef0981-8b0a-4a42-95e5-fbdd4357a012 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:43.245753 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-18ef0981-8b0a-4a42-95e5-fbdd4357a012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:43.255395 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:43.279858 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59430f62-6f3f-447b-bb9e-548ca81c7780 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:43.303587 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:43.356268 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b23ae8-b077-4f15-9845-cd6b33e780c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:43.357076 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b23ae8-b077-4f15-9845-cd6b33e780c1 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:43.357363 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b23ae8-b077-4f15-9845-cd6b33e780c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:43.357645 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b23ae8-b077-4f15-9845-cd6b33e780c1 None admin] PATH_INFO: `/v3/projects/ae8bc79b1b6b4f7088e951983d34a626` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:43.360198 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b23ae8-b077-4f15-9845-cd6b33e780c1 None admin] RBAC: Authorizing `identity:get_project(project_id=ae8bc79b1b6b4f7088e951983d34a626)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:43.361652 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b23ae8-b077-4f15-9845-cd6b33e780c1 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:43.363381 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 211/415] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:47:43 2022] GET /identity/v3/projects/ae8bc79b1b6b4f7088e951983d34a626 => generated 344 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:43.380717 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b23ae8-b077-4f15-9845-cd6b33e780c1 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:43.390910 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 205/416] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:47:43.427780 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef0981-8b0a-4a42-95e5-fbdd4357a012 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:43.539962 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b23ae8-b077-4f15-9845-cd6b33e780c1 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:43.582528 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce500b1-88d7-4800-a00d-9bce322fd39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:43.583791 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce500b1-88d7-4800-a00d-9bce322fd39a None admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:43.584515 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce500b1-88d7-4800-a00d-9bce322fd39a None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:43.585003 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce500b1-88d7-4800-a00d-9bce322fd39a None admin] PATH_INFO: `/v3/projects/ae8bc79b1b6b4f7088e951983d34a626/groups/8d2cb1fed8994a5c996f439a8a5c1cb8/roles/86273ff072f3438d822e870272491768` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:43.587191 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce500b1-88d7-4800-a00d-9bce322fd39a None admin] RBAC: Authorizing `identity:create_grant(project_id=ae8bc79b1b6b4f7088e951983d34a626, group_id=8d2cb1fed8994a5c996f439a8a5c1cb8, role_id=86273ff072f3438d822e870272491768)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:43.589386 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce500b1-88d7-4800-a00d-9bce322fd39a None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:43.630036 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef0981-8b0a-4a42-95e5-fbdd4357a012 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:43.679754 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dabf7f1-dac4-4dc2-a7d3-76d7128b7827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:43.680687 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dabf7f1-dac4-4dc2-a7d3-76d7128b7827 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:43.681221 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dabf7f1-dac4-4dc2-a7d3-76d7128b7827 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:43.682063 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dabf7f1-dac4-4dc2-a7d3-76d7128b7827 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:43.684431 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 212/417] 10.222.0.40 () {58 vars in 1442 bytes} [Mon Jul 11 20:47:43 2022] PUT /identity/v3/projects/ae8bc79b1b6b4f7088e951983d34a626/groups/8d2cb1fed8994a5c996f439a8a5c1cb8/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:47:43.686043 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ac4ab-cabb-4902-b6f9-7d137d6081d5 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:43.692568 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ac4ab-cabb-4902-b6f9-7d137d6081d5 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:43.693751 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ac4ab-cabb-4902-b6f9-7d137d6081d5 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:43.700280 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 213/418] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:43 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:43.707206 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b9cb4-aef0-47a4-9ae5-27ab63cefdeb None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:43.707828 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b9cb4-aef0-47a4-9ae5-27ab63cefdeb None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:43.708351 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b9cb4-aef0-47a4-9ae5-27ab63cefdeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:43.713691 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dabf7f1-dac4-4dc2-a7d3-76d7128b7827 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:43.732072 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-6dabf7f1-dac4-4dc2-a7d3-76d7128b7827 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:47:43.732072 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:43.732072 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:43.732072 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:43.732072 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:43.732072 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:43.732072 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:43.732072 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:43.732072 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:43.732072 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:43.732072 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:43.732072 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:43.732072 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:43.732072 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:43.732072 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:43.732072 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:43.733078 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:43.733078 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:43.733078 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:43.733078 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:43.733078 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:43.733078 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:43.733078 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:43.733078 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:43.733078 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:43.733078 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:43.733078 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:43.733078 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:43.733078 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:43.733078 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:43.733078 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:43.733078 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:43.733871 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:43.733871 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:43.733871 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:43.733871 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:43.733871 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:43.733871 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:43.733871 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:43.733871 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:43.733871 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:43.733871 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:43.733871 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:47:43.733871 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:47:43.733871 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 206/419] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:47:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:47:43.738286 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dabf7f1-dac4-4dc2-a7d3-76d7128b7827 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:43.758604 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-514b9cb4-aef0-47a4-9ae5-27ab63cefdeb None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:43.768522 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-514b9cb4-aef0-47a4-9ae5-27ab63cefdeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:43.792106 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:43.810273 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:43.981576 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 214/420] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:43.995994 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dabf7f1-dac4-4dc2-a7d3-76d7128b7827 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:44.027679 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b9cb4-aef0-47a4-9ae5-27ab63cefdeb None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:44.067998 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c689c73-71bc-4fb0-a9b8-eacea4967a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:44.067998 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c689c73-71bc-4fb0-a9b8-eacea4967a5b None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:44.067998 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c689c73-71bc-4fb0-a9b8-eacea4967a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:44.067998 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c689c73-71bc-4fb0-a9b8-eacea4967a5b None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:44.068414 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c689c73-71bc-4fb0-a9b8-eacea4967a5b None admin] RBAC: Adding query filter params (name=member) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:44.068414 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c689c73-71bc-4fb0-a9b8-eacea4967a5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:44.072922 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c689c73-71bc-4fb0-a9b8-eacea4967a5b None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:44.096459 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 207/421] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 11 20:47:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:44.105160 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c689c73-71bc-4fb0-a9b8-eacea4967a5b None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:44.199123 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b9cb4-aef0-47a4-9ae5-27ab63cefdeb None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:44.271918 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9bdca8-8dca-4919-96db-5bb0a0ba3534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:44.272821 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9bdca8-8dca-4919-96db-5bb0a0ba3534 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:44.273119 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9bdca8-8dca-4919-96db-5bb0a0ba3534 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:44.273399 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9bdca8-8dca-4919-96db-5bb0a0ba3534 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:44.288984 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:44.297111 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9bdca8-8dca-4919-96db-5bb0a0ba3534 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:44.301365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c689c73-71bc-4fb0-a9b8-eacea4967a5b None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:44.314067 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-1f9bdca8-8dca-4919-96db-5bb0a0ba3534 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:47:44.314067 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:44.314067 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:44.314067 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:44.314067 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:44.314067 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:44.314067 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:44.314067 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:44.314067 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:44.314067 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:44.314067 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:44.314067 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:44.314067 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:44.314067 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:44.314067 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:44.314067 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:44.315049 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:44.315049 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:44.315049 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:44.315049 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:44.315049 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:44.315049 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:44.315049 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:44.315049 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:44.315049 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:44.315049 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:44.315049 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:44.315049 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:44.315049 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:44.315049 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:44.315049 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:44.315049 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:44.316489 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:44.316489 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:44.316489 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:44.316489 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:44.316489 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:44.316489 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:44.316489 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:44.316489 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:44.316489 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:44.316489 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:44.316489 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:47:44.316489 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:47:44.316489 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 215/422] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jul 11 20:47:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:44.322590 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9bdca8-8dca-4919-96db-5bb0a0ba3534 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:44.331543 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:44.346829 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c1c7c-8e86-4717-b9cd-357e55e62b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:44.348179 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c1c7c-8e86-4717-b9cd-357e55e62b1e None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:44.348837 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c1c7c-8e86-4717-b9cd-357e55e62b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:44.349347 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c1c7c-8e86-4717-b9cd-357e55e62b1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:44.433934 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c1c7c-8e86-4717-b9cd-357e55e62b1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:44.435723 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c1c7c-8e86-4717-b9cd-357e55e62b1e None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:44.494824 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9bdca8-8dca-4919-96db-5bb0a0ba3534 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:44.532737 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b25c5-548d-4602-9be0-d6918ce4a162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:44.533756 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b25c5-548d-4602-9be0-d6918ce4a162 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:44.534279 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b25c5-548d-4602-9be0-d6918ce4a162 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:44.534762 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b25c5-548d-4602-9be0-d6918ce4a162 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:44.535736 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b25c5-548d-4602-9be0-d6918ce4a162 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:44.536319 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b25c5-548d-4602-9be0-d6918ce4a162 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:44.537931 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b25c5-548d-4602-9be0-d6918ce4a162 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:44.548353 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 216/423] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:47:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:44.553416 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b25c5-548d-4602-9be0-d6918ce4a162 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:44.600362 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:44.625176 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 208/424] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:47:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:47:44.630785 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c1c7c-8e86-4717-b9cd-357e55e62b1e None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:44.633773 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:44.675169 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b25c5-548d-4602-9be0-d6918ce4a162 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:44.721540 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d383566-520d-407c-a09d-12dacc2a125e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:44.722651 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d383566-520d-407c-a09d-12dacc2a125e None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:44.723220 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d383566-520d-407c-a09d-12dacc2a125e None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:44.723701 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d383566-520d-407c-a09d-12dacc2a125e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:44.762060 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c1c7c-8e86-4717-b9cd-357e55e62b1e None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:44.802478 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d383566-520d-407c-a09d-12dacc2a125e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:44.804376 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d383566-520d-407c-a09d-12dacc2a125e None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:44.829591 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ae898-b41d-4236-8f53-d201fed60e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:44.830474 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ae898-b41d-4236-8f53-d201fed60e71 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:44.830761 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ae898-b41d-4236-8f53-d201fed60e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:44.831042 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ae898-b41d-4236-8f53-d201fed60e71 None admin] PATH_INFO: `/v3/projects/73bb6e1fa903475382715a00881f5cce` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:44.832274 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ae898-b41d-4236-8f53-d201fed60e71 None admin] RBAC: Authorizing `identity:get_project(project_id=73bb6e1fa903475382715a00881f5cce)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:44.833716 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ae898-b41d-4236-8f53-d201fed60e71 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:44.845134 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 209/425] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:47:44 2022] GET /identity/v3/projects/73bb6e1fa903475382715a00881f5cce => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:47:44.849459 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ae898-b41d-4236-8f53-d201fed60e71 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:44.880112 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:44.921243 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 217/426] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:47:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:47:44.922918 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906309a-884b-4ddd-9d00-95534110ff60 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:44.923413 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906309a-884b-4ddd-9d00-95534110ff60 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:44.923895 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906309a-884b-4ddd-9d00-95534110ff60 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:44.925653 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 218/427] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:44.926550 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906309a-884b-4ddd-9d00-95534110ff60 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:44.961639 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:45.014887 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ae898-b41d-4236-8f53-d201fed60e71 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:45.054389 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb1113-facf-403d-9295-ef76d513a14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:45.055607 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb1113-facf-403d-9295-ef76d513a14d None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:45.056784 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb1113-facf-403d-9295-ef76d513a14d None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:45.057335 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb1113-facf-403d-9295-ef76d513a14d None admin] PATH_INFO: `/v3/groups/1df601de797c453195fcdc94d24b5fd4` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:45.058792 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906309a-884b-4ddd-9d00-95534110ff60 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:45.059039 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bb1113-facf-403d-9295-ef76d513a14d None admin] RBAC: Authorizing `identity:get_group(group_id=1df601de797c453195fcdc94d24b5fd4)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:45.060886 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bb1113-facf-403d-9295-ef76d513a14d None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:45.062791 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 210/428] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Jul 11 20:47:44 2022] GET /identity/v3/groups/1df601de797c453195fcdc94d24b5fd4 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:45.064088 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127687b-82f7-4132-b6ac-79787c561739 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:45.064443 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127687b-82f7-4132-b6ac-79787c561739 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:45.064819 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127687b-82f7-4132-b6ac-79787c561739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:45.082685 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-c127687b-82f7-4132-b6ac-79787c561739 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:45.084137 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c127687b-82f7-4132-b6ac-79787c561739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:45.098429 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501d2e9-1df6-48d0-9b44-30d4d5c2897a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:45.099695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501d2e9-1df6-48d0-9b44-30d4d5c2897a None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:45.100261 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501d2e9-1df6-48d0-9b44-30d4d5c2897a None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:45.100737 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501d2e9-1df6-48d0-9b44-30d4d5c2897a None admin] PATH_INFO: `/v3/projects/73bb6e1fa903475382715a00881f5cce` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:45.102337 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8501d2e9-1df6-48d0-9b44-30d4d5c2897a None admin] RBAC: Authorizing `identity:get_project(project_id=73bb6e1fa903475382715a00881f5cce)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:45.104698 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8501d2e9-1df6-48d0-9b44-30d4d5c2897a None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:45.106861 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 219/429] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:47:44 2022] GET /identity/v3/projects/73bb6e1fa903475382715a00881f5cce => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:45.108062 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501d2e9-1df6-48d0-9b44-30d4d5c2897a None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:45.149648 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:45.172229 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 211/430] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:45.173112 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127687b-82f7-4132-b6ac-79787c561739 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:45.226707 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501d2e9-1df6-48d0-9b44-30d4d5c2897a None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:45.259388 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:45.282093 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03095ec0-2afc-48c7-a30d-8bc0a5413cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:45.283396 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03095ec0-2afc-48c7-a30d-8bc0a5413cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:45.283860 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03095ec0-2afc-48c7-a30d-8bc0a5413cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:45.284646 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03095ec0-2afc-48c7-a30d-8bc0a5413cc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:45.285918 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03095ec0-2afc-48c7-a30d-8bc0a5413cc0 None admin] RBAC: Adding query filter params (group.id=1df601de797c453195fcdc94d24b5fd4, role.id=cf0f875ea1ba45758bd4f52a845d807e, scope.project.id=73bb6e1fa903475382715a00881f5cce) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:45.286409 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03095ec0-2afc-48c7-a30d-8bc0a5413cc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:45.288560 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03095ec0-2afc-48c7-a30d-8bc0a5413cc0 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:45.297181 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 220/431] 10.222.0.40 () {56 vars in 1376 bytes} [Mon Jul 11 20:47:45 2022] GET /identity/v3/role_assignments?group.id=1df601de797c453195fcdc94d24b5fd4&scope.project.id=73bb6e1fa903475382715a00881f5cce&role.id=cf0f875ea1ba45758bd4f52a845d807e => generated 611 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:45.298198 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03095ec0-2afc-48c7-a30d-8bc0a5413cc0 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:45.327348 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127687b-82f7-4132-b6ac-79787c561739 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:45.376563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f18ec-2839-4733-a148-ede7ccd4cc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:45.377493 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f18ec-2839-4733-a148-ede7ccd4cc61 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:45.377783 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f18ec-2839-4733-a148-ede7ccd4cc61 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:45.378064 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f18ec-2839-4733-a148-ede7ccd4cc61 None admin] PATH_INFO: `/v3/groups/1df601de797c453195fcdc94d24b5fd4` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:45.379401 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f18ec-2839-4733-a148-ede7ccd4cc61 None admin] RBAC: Authorizing `identity:get_group(group_id=1df601de797c453195fcdc94d24b5fd4)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:45.381071 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f18ec-2839-4733-a148-ede7ccd4cc61 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:45.383091 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 212/432] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Jul 11 20:47:45 2022] GET /identity/v3/groups/1df601de797c453195fcdc94d24b5fd4 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:45.385668 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bbf08-eb90-4329-aed3-9df16ebe00aa None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:45.386066 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bbf08-eb90-4329-aed3-9df16ebe00aa None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:45.386871 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bbf08-eb90-4329-aed3-9df16ebe00aa None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:45.392276 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 213/433] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:45 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:45.393237 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547bbf08-eb90-4329-aed3-9df16ebe00aa None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:45.440663 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:45.445977 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03095ec0-2afc-48c7-a30d-8bc0a5413cc0 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:45.498043 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d67a06-194e-46ec-916f-5be426f46f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:45.500717 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d67a06-194e-46ec-916f-5be426f46f88 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:45.501198 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d67a06-194e-46ec-916f-5be426f46f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:45.501640 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d67a06-194e-46ec-916f-5be426f46f88 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:45.515687 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d67a06-194e-46ec-916f-5be426f46f88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:45.526785 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-98d67a06-194e-46ec-916f-5be426f46f88 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:47:45.526785 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:45.526785 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:45.526785 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:45.526785 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:45.526785 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:45.526785 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:45.526785 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:45.526785 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:45.526785 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:45.526785 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:45.526785 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:45.526785 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:45.526785 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:45.526785 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:45.526785 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:45.528077 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:45.528077 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:45.528077 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:45.528077 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:45.528077 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:45.528077 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:45.528077 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:45.528077 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:45.528077 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:45.528077 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:45.528077 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:45.528077 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:45.528077 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:45.528077 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:45.528077 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:45.528077 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:45.528865 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:45.528865 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:45.528865 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:45.528865 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:45.528865 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:45.528865 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:45.528865 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:45.528865 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:45.528865 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:45.528865 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:45.528865 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 20:47:45.528865 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:47:45.532291 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 221/434] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:47:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:45.534012 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8c106-3729-4520-8337-678073ad4205 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:45.534453 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8c106-3729-4520-8337-678073ad4205 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:45.534901 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8c106-3729-4520-8337-678073ad4205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:45.544059 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547bbf08-eb90-4329-aed3-9df16ebe00aa None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:45.558745 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-37e8c106-3729-4520-8337-678073ad4205 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:45.560358 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-37e8c106-3729-4520-8337-678073ad4205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:45.575162 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:45.598234 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db474009-3829-4413-b743-59ee8aefe92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:45.599129 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db474009-3829-4413-b743-59ee8aefe92e None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:45.599573 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db474009-3829-4413-b743-59ee8aefe92e None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:45.600047 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db474009-3829-4413-b743-59ee8aefe92e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:45.601033 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db474009-3829-4413-b743-59ee8aefe92e None admin] RBAC: Adding query filter params (group.id=1df601de797c453195fcdc94d24b5fd4, role.id=c2117c810f7b4e6aaf684c3d37b0ea3e, scope.project.id=73bb6e1fa903475382715a00881f5cce) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:45.601549 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db474009-3829-4413-b743-59ee8aefe92e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:45.604316 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db474009-3829-4413-b743-59ee8aefe92e None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:45.613638 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 214/435] 10.222.0.40 () {56 vars in 1376 bytes} [Mon Jul 11 20:47:45 2022] GET /identity/v3/role_assignments?group.id=1df601de797c453195fcdc94d24b5fd4&scope.project.id=73bb6e1fa903475382715a00881f5cce&role.id=c2117c810f7b4e6aaf684c3d37b0ea3e => generated 611 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:45.615091 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db474009-3829-4413-b743-59ee8aefe92e None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:45.675808 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 222/436] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:45.699663 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e8c106-3729-4520-8337-678073ad4205 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:45.768076 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db474009-3829-4413-b743-59ee8aefe92e None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:45.822611 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea91d1-4a5a-436a-a91f-d21154b2c075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:45.823199 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:45.823765 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea91d1-4a5a-436a-a91f-d21154b2c075 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:45.824247 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea91d1-4a5a-436a-a91f-d21154b2c075 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:45.824532 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea91d1-4a5a-436a-a91f-d21154b2c075 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:45.825302 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea91d1-4a5a-436a-a91f-d21154b2c075 None admin] RBAC: Adding query filter params (name=member) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:45.825618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea91d1-4a5a-436a-a91f-d21154b2c075 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:45.827093 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea91d1-4a5a-436a-a91f-d21154b2c075 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:45.838356 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 215/437] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 11 20:47:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:45.839151 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e8c106-3729-4520-8337-678073ad4205 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:45.849954 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea91d1-4a5a-436a-a91f-d21154b2c075 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:45.898804 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a930f-8269-48a3-9414-90449f13f61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:45.899213 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a930f-8269-48a3-9414-90449f13f61a None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:45.899518 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a930f-8269-48a3-9414-90449f13f61a None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:45.900571 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a930f-8269-48a3-9414-90449f13f61a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:45.921014 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a930f-8269-48a3-9414-90449f13f61a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:45.924197 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:45.929656 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-c45a930f-8269-48a3-9414-90449f13f61a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:47:45.929656 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:45.929656 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:45.929656 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:45.929656 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:45.929656 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:45.929656 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:45.929656 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:45.929656 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:45.929656 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:45.929656 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:45.929656 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:45.929656 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:45.929656 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:45.929656 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:45.929656 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:45.930590 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:45.930590 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:45.930590 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:45.930590 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:45.930590 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:45.930590 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:45.930590 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:45.930590 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:45.930590 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:45.930590 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:45.930590 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:45.930590 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:45.930590 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:45.930590 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:45.930590 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:45.930590 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:45.931553 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:45.931553 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:45.931553 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:45.931553 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:45.931553 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:45.931553 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:45.931553 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:45.931553 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:45.931553 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:45.931553 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:45.931553 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:47:45.931553 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:47:45.935623 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 223/438] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jul 11 20:47:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:47:45.937554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a930f-8269-48a3-9414-90449f13f61a None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:46.016447 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea91d1-4a5a-436a-a91f-d21154b2c075 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:46.070836 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887440de-d36a-4def-b36d-53d8ceeeaf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:46.072164 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887440de-d36a-4def-b36d-53d8ceeeaf5e None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:46.072619 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887440de-d36a-4def-b36d-53d8ceeeaf5e None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:46.072903 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887440de-d36a-4def-b36d-53d8ceeeaf5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:46.091388 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a930f-8269-48a3-9414-90449f13f61a None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:46.144368 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc0f0b-5e05-42ef-ba76-e3b4f63c687b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:46.146006 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc0f0b-5e05-42ef-ba76-e3b4f63c687b None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:46.146006 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc0f0b-5e05-42ef-ba76-e3b4f63c687b None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:46.146006 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc0f0b-5e05-42ef-ba76-e3b4f63c687b None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:46.146794 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cc0f0b-5e05-42ef-ba76-e3b4f63c687b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:46.148757 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cc0f0b-5e05-42ef-ba76-e3b4f63c687b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:46.149576 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cc0f0b-5e05-42ef-ba76-e3b4f63c687b None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:46.160449 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 224/439] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:47:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:46.166822 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc0f0b-5e05-42ef-ba76-e3b4f63c687b None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:46.169284 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887440de-d36a-4def-b36d-53d8ceeeaf5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:46.170755 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887440de-d36a-4def-b36d-53d8ceeeaf5e None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:46.184037 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:46.226280 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:46.279212 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc0f0b-5e05-42ef-ba76-e3b4f63c687b None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:46.286741 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 216/440] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:47:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:47:46.289358 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7824d8-3dae-4fab-b35b-2b643c6841d0 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:46.289656 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7824d8-3dae-4fab-b35b-2b643c6841d0 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:46.289944 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7824d8-3dae-4fab-b35b-2b643c6841d0 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:46.292409 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 217/441] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:46.293121 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7824d8-3dae-4fab-b35b-2b643c6841d0 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:46.314973 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efe4de-da1b-4c7e-b47a-474fd5b163c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:46.315629 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efe4de-da1b-4c7e-b47a-474fd5b163c3 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:46.315918 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efe4de-da1b-4c7e-b47a-474fd5b163c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:46.316226 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efe4de-da1b-4c7e-b47a-474fd5b163c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:46.385050 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7efe4de-da1b-4c7e-b47a-474fd5b163c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:46.386498 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7efe4de-da1b-4c7e-b47a-474fd5b163c3 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:46.395631 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7824d8-3dae-4fab-b35b-2b643c6841d0 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:46.397219 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:46.430440 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc81b9-e7ee-4467-89e4-8b2d519c29d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:46.431832 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc81b9-e7ee-4467-89e4-8b2d519c29d4 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:46.432188 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc81b9-e7ee-4467-89e4-8b2d519c29d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:46.432424 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc81b9-e7ee-4467-89e4-8b2d519c29d4 None admin] PATH_INFO: `/v3/projects/549948b5ac834c07b634e08f7b1ec58d` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:46.433601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc81b9-e7ee-4467-89e4-8b2d519c29d4 None admin] RBAC: Authorizing `identity:get_project(project_id=549948b5ac834c07b634e08f7b1ec58d)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:46.435025 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc81b9-e7ee-4467-89e4-8b2d519c29d4 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:46.436747 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 218/442] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:47:46 2022] GET /identity/v3/projects/549948b5ac834c07b634e08f7b1ec58d => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:46.439733 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d59f8-440f-448c-9096-20962433dba0 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:46.439733 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d59f8-440f-448c-9096-20962433dba0 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:46.439733 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d59f8-440f-448c-9096-20962433dba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:46.454670 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-6d5d59f8-440f-448c-9096-20962433dba0 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:46.455838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-6d5d59f8-440f-448c-9096-20962433dba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:46.467458 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:46.486328 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 225/443] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:47:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 20:47:46.487170 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efe4de-da1b-4c7e-b47a-474fd5b163c3 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:46.524983 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 219/444] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:46.525828 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d59f8-440f-448c-9096-20962433dba0 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:46.587976 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efe4de-da1b-4c7e-b47a-474fd5b163c3 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:46.599052 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:46.622218 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5438c6-3926-411c-8f36-8b38375015ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:46.623098 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5438c6-3926-411c-8f36-8b38375015ec None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:46.623382 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5438c6-3926-411c-8f36-8b38375015ec None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:46.623665 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5438c6-3926-411c-8f36-8b38375015ec None admin] PATH_INFO: `/v3/groups/1df601de797c453195fcdc94d24b5fd4` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:46.625122 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5438c6-3926-411c-8f36-8b38375015ec None admin] RBAC: Authorizing `identity:get_group(group_id=1df601de797c453195fcdc94d24b5fd4)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:46.626555 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5438c6-3926-411c-8f36-8b38375015ec None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:46.628224 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 226/445] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Jul 11 20:47:46 2022] GET /identity/v3/groups/1df601de797c453195fcdc94d24b5fd4 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:46.628973 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5438c6-3926-411c-8f36-8b38375015ec None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:46.639027 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d59f8-440f-448c-9096-20962433dba0 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:46.676051 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bafbd9-bcdb-4f06-90cd-f8ffc929d247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:46.676928 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bafbd9-bcdb-4f06-90cd-f8ffc929d247 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:46.677217 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bafbd9-bcdb-4f06-90cd-f8ffc929d247 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:46.677493 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bafbd9-bcdb-4f06-90cd-f8ffc929d247 None admin] PATH_INFO: `/v3/projects/549948b5ac834c07b634e08f7b1ec58d` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:46.678678 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bafbd9-bcdb-4f06-90cd-f8ffc929d247 None admin] RBAC: Authorizing `identity:get_project(project_id=549948b5ac834c07b634e08f7b1ec58d)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:46.680148 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bafbd9-bcdb-4f06-90cd-f8ffc929d247 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:46.682097 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 220/446] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:47:46 2022] GET /identity/v3/projects/549948b5ac834c07b634e08f7b1ec58d => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:46.682097 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bafbd9-bcdb-4f06-90cd-f8ffc929d247 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:46.701273 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:46.745451 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5438c6-3926-411c-8f36-8b38375015ec None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:46.780076 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dff3e9-f708-4585-851a-7ce89d1c9ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:46.780872 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dff3e9-f708-4585-851a-7ce89d1c9ecf None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:46.781156 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dff3e9-f708-4585-851a-7ce89d1c9ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:46.781439 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dff3e9-f708-4585-851a-7ce89d1c9ecf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:46.784156 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bafbd9-bcdb-4f06-90cd-f8ffc929d247 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:46.791833 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dff3e9-f708-4585-851a-7ce89d1c9ecf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:46.799411 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-00dff3e9-f708-4585-851a-7ce89d1c9ecf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:47:46.799411 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:46.799411 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:46.799411 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:46.799411 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:46.799411 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:46.799411 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:46.799411 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:46.799411 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:46.799411 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:46.799411 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:46.799411 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:46.799411 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:46.799411 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:46.799411 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:46.799411 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:46.800336 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:46.800336 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:46.800336 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:46.800336 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:46.800336 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:46.800336 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:46.800336 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:46.800336 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:46.800336 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:46.800336 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:46.800336 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:46.800336 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:46.800336 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:46.800336 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:46.800336 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:46.800336 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:46.801130 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:46.801130 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:46.801130 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:46.801130 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:46.801130 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:46.801130 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:46.801130 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:46.801130 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:46.801130 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:46.801130 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:46.801130 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:47:46.801130 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:47:46.801130 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 227/447] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 11 20:47:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:46.801814 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dff3e9-f708-4585-851a-7ce89d1c9ecf None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:46.823811 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03fa458-c72c-46f5-a6e1-724113b6f116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:46.824521 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fa458-c72c-46f5-a6e1-724113b6f116 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:46.824810 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fa458-c72c-46f5-a6e1-724113b6f116 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:46.825085 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fa458-c72c-46f5-a6e1-724113b6f116 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:46.825920 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03fa458-c72c-46f5-a6e1-724113b6f116 None admin] RBAC: Adding query filter params (group.id=1df601de797c453195fcdc94d24b5fd4, role.id=cf0f875ea1ba45758bd4f52a845d807e, scope.project.id=549948b5ac834c07b634e08f7b1ec58d) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:46.826235 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03fa458-c72c-46f5-a6e1-724113b6f116 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:46.827652 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03fa458-c72c-46f5-a6e1-724113b6f116 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:46.833410 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 221/448] 10.222.0.40 () {56 vars in 1376 bytes} [Mon Jul 11 20:47:46 2022] GET /identity/v3/role_assignments?group.id=1df601de797c453195fcdc94d24b5fd4&scope.project.id=549948b5ac834c07b634e08f7b1ec58d&role.id=cf0f875ea1ba45758bd4f52a845d807e => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:46.834167 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03fa458-c72c-46f5-a6e1-724113b6f116 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:46.847113 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:46.917285 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dff3e9-f708-4585-851a-7ce89d1c9ecf None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:46.939483 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:46.956292 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf884bb-75a8-438e-a236-bd3593262a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:46.957167 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf884bb-75a8-438e-a236-bd3593262a0b None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:46.957682 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf884bb-75a8-438e-a236-bd3593262a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:46.957787 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf884bb-75a8-438e-a236-bd3593262a0b None admin] PATH_INFO: `/v3/groups/1df601de797c453195fcdc94d24b5fd4` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:46.958925 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf884bb-75a8-438e-a236-bd3593262a0b None admin] RBAC: Authorizing `identity:get_group(group_id=1df601de797c453195fcdc94d24b5fd4)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:46.960428 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf884bb-75a8-438e-a236-bd3593262a0b None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:46.963616 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03fa458-c72c-46f5-a6e1-724113b6f116 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:46.964298 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 228/449] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Jul 11 20:47:46 2022] GET /identity/v3/groups/1df601de797c453195fcdc94d24b5fd4 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:46.968904 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf884bb-75a8-438e-a236-bd3593262a0b None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:47.004619 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45ee3e-3839-463d-a43c-99f55227c989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:47.004983 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45ee3e-3839-463d-a43c-99f55227c989 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:47.005271 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45ee3e-3839-463d-a43c-99f55227c989 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:47.005550 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45ee3e-3839-463d-a43c-99f55227c989 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:47.006295 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45ee3e-3839-463d-a43c-99f55227c989 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:47.006610 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45ee3e-3839-463d-a43c-99f55227c989 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:47.007987 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45ee3e-3839-463d-a43c-99f55227c989 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:47.018498 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 222/450] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:47:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:47.024074 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45ee3e-3839-463d-a43c-99f55227c989 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:47.088446 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf884bb-75a8-438e-a236-bd3593262a0b None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:47.096038 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:47.128875 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e823236-ce1d-494d-a36d-a9974afcadb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:47.129568 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e823236-ce1d-494d-a36d-a9974afcadb8 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:47.130151 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e823236-ce1d-494d-a36d-a9974afcadb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:47.130151 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e823236-ce1d-494d-a36d-a9974afcadb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:47.131871 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e823236-ce1d-494d-a36d-a9974afcadb8 None admin] RBAC: Adding query filter params (group.id=1df601de797c453195fcdc94d24b5fd4, role.id=c2117c810f7b4e6aaf684c3d37b0ea3e, scope.project.id=549948b5ac834c07b634e08f7b1ec58d) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:47.131871 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e823236-ce1d-494d-a36d-a9974afcadb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:47.133406 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e823236-ce1d-494d-a36d-a9974afcadb8 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:47.140206 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 229/451] 10.222.0.40 () {56 vars in 1376 bytes} [Mon Jul 11 20:47:46 2022] GET /identity/v3/role_assignments?group.id=1df601de797c453195fcdc94d24b5fd4&scope.project.id=549948b5ac834c07b634e08f7b1ec58d&role.id=c2117c810f7b4e6aaf684c3d37b0ea3e => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:47:47.143762 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45ee3e-3839-463d-a43c-99f55227c989 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:47.184138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ecd87-9a22-4bd2-a611-5ed097a216e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:47.184751 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ecd87-9a22-4bd2-a611-5ed097a216e3 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:47.185006 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ecd87-9a22-4bd2-a611-5ed097a216e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:47.185307 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ecd87-9a22-4bd2-a611-5ed097a216e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:47.199088 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:47.264334 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ecd87-9a22-4bd2-a611-5ed097a216e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:47.265817 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ecd87-9a22-4bd2-a611-5ed097a216e3 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:47.367837 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 223/452] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:47:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 20:47:47.373757 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e823236-ce1d-494d-a36d-a9974afcadb8 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:47.476048 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e823236-ce1d-494d-a36d-a9974afcadb8 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:47.508747 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b5e5d-9966-4f5c-8c47-dbddd1ba390d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:47.510146 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b5e5d-9966-4f5c-8c47-dbddd1ba390d None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:47.510428 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b5e5d-9966-4f5c-8c47-dbddd1ba390d None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:47.510701 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b5e5d-9966-4f5c-8c47-dbddd1ba390d None admin] PATH_INFO: `/v3/projects/ae8bc79b1b6b4f7088e951983d34a626` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:47.511861 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b5e5d-9966-4f5c-8c47-dbddd1ba390d None admin] RBAC: Authorizing `identity:get_project(project_id=ae8bc79b1b6b4f7088e951983d34a626)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:47.513323 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b5e5d-9966-4f5c-8c47-dbddd1ba390d None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:47.514985 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 230/453] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:47:47 2022] GET /identity/v3/projects/ae8bc79b1b6b4f7088e951983d34a626 => generated 344 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:47.520531 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ecd87-9a22-4bd2-a611-5ed097a216e3 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:47.560886 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:47.617238 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ecd87-9a22-4bd2-a611-5ed097a216e3 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:47.651095 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc7905-4ed0-4fc6-ab65-162a1f592501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:47.651980 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc7905-4ed0-4fc6-ab65-162a1f592501 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:47.652273 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc7905-4ed0-4fc6-ab65-162a1f592501 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:47.652552 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc7905-4ed0-4fc6-ab65-162a1f592501 None admin] PATH_INFO: `/v3/groups/8d2cb1fed8994a5c996f439a8a5c1cb8` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:47.653735 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc7905-4ed0-4fc6-ab65-162a1f592501 None admin] RBAC: Authorizing `identity:get_group(group_id=8d2cb1fed8994a5c996f439a8a5c1cb8)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:47.655175 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc7905-4ed0-4fc6-ab65-162a1f592501 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:47.656824 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 224/454] 10.222.0.40 () {56 vars in 1180 bytes} [Mon Jul 11 20:47:47 2022] GET /identity/v3/groups/8d2cb1fed8994a5c996f439a8a5c1cb8 => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:47.662547 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b5e5d-9966-4f5c-8c47-dbddd1ba390d None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:47.702487 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:47.761631 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b5e5d-9966-4f5c-8c47-dbddd1ba390d None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:47.793126 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038512c-7c36-4056-87bb-0b371b2f4c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:47.793770 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038512c-7c36-4056-87bb-0b371b2f4c8f None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:47.794079 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038512c-7c36-4056-87bb-0b371b2f4c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:47.794355 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038512c-7c36-4056-87bb-0b371b2f4c8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:47.795172 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5038512c-7c36-4056-87bb-0b371b2f4c8f None admin] RBAC: Adding query filter params (group.id=8d2cb1fed8994a5c996f439a8a5c1cb8, role.id=86273ff072f3438d822e870272491768, scope.project.id=ae8bc79b1b6b4f7088e951983d34a626) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:47.795485 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5038512c-7c36-4056-87bb-0b371b2f4c8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:47.796940 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5038512c-7c36-4056-87bb-0b371b2f4c8f None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:47.802567 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 231/455] 10.222.0.40 () {56 vars in 1376 bytes} [Mon Jul 11 20:47:47 2022] GET /identity/v3/role_assignments?group.id=8d2cb1fed8994a5c996f439a8a5c1cb8&scope.project.id=ae8bc79b1b6b4f7088e951983d34a626&role.id=86273ff072f3438d822e870272491768 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:50.286127 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0103190-235e-43a5-a5c2-1488267fbce6 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:50.287179 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0103190-235e-43a5-a5c2-1488267fbce6 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:50.287698 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0103190-235e-43a5-a5c2-1488267fbce6 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:50.289410 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 225/456] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:50.301456 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd524d-d08d-448a-a4ec-7a4ef0d98809 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:50.302395 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd524d-d08d-448a-a4ec-7a4ef0d98809 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:50.302892 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd524d-d08d-448a-a4ec-7a4ef0d98809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:50.322577 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-dfcd524d-d08d-448a-a4ec-7a4ef0d98809 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:50.323780 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-dfcd524d-d08d-448a-a4ec-7a4ef0d98809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:50.418537 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 232/457] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:50.467454 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0103190-235e-43a5-a5c2-1488267fbce6 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:50.587327 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ea404-462f-4642-b83e-44b31813e780 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:50.587670 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ea404-462f-4642-b83e-44b31813e780 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:50.587959 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ea404-462f-4642-b83e-44b31813e780 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:50.589490 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 233/458] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:50.594973 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be9f40-a2b1-4416-97af-c5a5eb2b6dc2 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:50.595446 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be9f40-a2b1-4416-97af-c5a5eb2b6dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:50.595897 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be9f40-a2b1-4416-97af-c5a5eb2b6dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:50.601665 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0103190-235e-43a5-a5c2-1488267fbce6 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:50.612330 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:50.622103 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-30be9f40-a2b1-4416-97af-c5a5eb2b6dc2 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:50.623544 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-30be9f40-a2b1-4416-97af-c5a5eb2b6dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:50.657816 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ded784-29bb-4ec8-acb6-19e40ad1b62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:50.658559 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ded784-29bb-4ec8-acb6-19e40ad1b62f None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:50.658855 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ded784-29bb-4ec8-acb6-19e40ad1b62f None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:50.659137 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ded784-29bb-4ec8-acb6-19e40ad1b62f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:50.671044 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:50.672473 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ded784-29bb-4ec8-acb6-19e40ad1b62f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:50.674169 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ded784-29bb-4ec8-acb6-19e40ad1b62f None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:50.695224 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-14ded784-29bb-4ec8-acb6-19e40ad1b62f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:47:50.695224 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:50.695224 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:50.695224 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:50.695224 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:50.695224 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:50.695224 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:50.695224 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:50.695224 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:50.695224 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:50.695224 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:50.695224 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:50.695224 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:47:50.695224 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:47:50.695224 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:47:50.696284 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:47:50.696284 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:50.696284 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:50.696284 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:50.696284 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:50.696284 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:50.696284 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:50.696284 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:50.696284 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:50.696284 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:50.696284 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:50.696284 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:50.696284 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:50.696284 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:50.696284 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:50.696284 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:50.696284 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:50.697314 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:47:50.697314 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:47:50.697314 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:47:50.697314 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:47:50.699325 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 226/459] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:47:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:50.701074 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4bfd1-866a-4ea4-92d2-f1fcca23d965 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:50.701563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4bfd1-866a-4ea4-92d2-f1fcca23d965 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:50.702015 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4bfd1-866a-4ea4-92d2-f1fcca23d965 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:50.707863 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 227/460] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:50.709951 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc61c95-43cf-4e8a-b740-145d199b22a9 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:50.710464 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc61c95-43cf-4e8a-b740-145d199b22a9 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:50.710916 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc61c95-43cf-4e8a-b740-145d199b22a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:50.731183 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-5fc61c95-43cf-4e8a-b740-145d199b22a9 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:50.732069 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 234/461] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:50.732903 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-5fc61c95-43cf-4e8a-b740-145d199b22a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:50.733034 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be9f40-a2b1-4416-97af-c5a5eb2b6dc2 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:50.819989 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 228/462] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:50.819989 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc61c95-43cf-4e8a-b740-145d199b22a9 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:50.878021 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be9f40-a2b1-4416-97af-c5a5eb2b6dc2 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:50.916025 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf06e9-9ceb-4419-b0a8-5730a9b6790f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:50.916793 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf06e9-9ceb-4419-b0a8-5730a9b6790f None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:50.917081 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf06e9-9ceb-4419-b0a8-5730a9b6790f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:50.917360 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf06e9-9ceb-4419-b0a8-5730a9b6790f None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:50.918138 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cf06e9-9ceb-4419-b0a8-5730a9b6790f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:50.918457 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cf06e9-9ceb-4419-b0a8-5730a9b6790f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:50.919556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:50.921602 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cf06e9-9ceb-4419-b0a8-5730a9b6790f None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:50.934135 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc61c95-43cf-4e8a-b740-145d199b22a9 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:50.935197 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 235/463] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:47:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:50.936287 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf06e9-9ceb-4419-b0a8-5730a9b6790f None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:50.962028 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:50.979131 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935247d8-e75b-4eee-8d4d-119e6640b9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:50.979943 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935247d8-e75b-4eee-8d4d-119e6640b9cb None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:50.980260 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935247d8-e75b-4eee-8d4d-119e6640b9cb None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:50.980538 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935247d8-e75b-4eee-8d4d-119e6640b9cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:50.991126 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935247d8-e75b-4eee-8d4d-119e6640b9cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:50.992621 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935247d8-e75b-4eee-8d4d-119e6640b9cb None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:51.011077 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-935247d8-e75b-4eee-8d4d-119e6640b9cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:47:51.011077 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:51.011077 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:51.011077 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:51.011077 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:51.011077 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:51.011077 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:51.011077 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:51.011077 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:51.011077 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:51.011077 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:51.011077 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:51.011077 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:47:51.011077 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:47:51.011077 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:47:51.011927 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:47:51.011927 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:51.011927 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:51.011927 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:51.011927 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:51.011927 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:51.011927 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:51.011927 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:51.011927 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:51.011927 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:51.011927 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:51.011927 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:51.011927 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:51.011927 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:51.011927 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:51.011927 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:51.011927 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:51.013067 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:47:51.013067 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:47:51.013067 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:47:51.013067 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:47:51.016982 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 229/464] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:47:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:51.017715 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935247d8-e75b-4eee-8d4d-119e6640b9cb None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:51.046233 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf06e9-9ceb-4419-b0a8-5730a9b6790f None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:51.085036 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae076c33-e1bb-43da-9725-87396acdda13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:51.086128 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae076c33-e1bb-43da-9725-87396acdda13 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:51.086787 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae076c33-e1bb-43da-9725-87396acdda13 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:51.087406 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae076c33-e1bb-43da-9725-87396acdda13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:51.098750 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae076c33-e1bb-43da-9725-87396acdda13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:51.101355 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae076c33-e1bb-43da-9725-87396acdda13 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:51.120336 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-ae076c33-e1bb-43da-9725-87396acdda13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:47:51.120336 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:51.120336 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:51.120336 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:51.120336 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:51.120336 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:51.120336 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:51.120336 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:51.120336 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:51.120336 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:51.120336 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:51.120336 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:51.120336 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:47:51.120336 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:47:51.120336 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:47:51.121374 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:47:51.121374 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:51.121374 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:51.121374 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:51.121374 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:51.121374 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:51.121374 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:51.121374 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:51.121374 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:51.121374 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:51.121374 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:51.121374 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:51.121374 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:51.121374 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:51.121374 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:51.121374 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:51.121374 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:51.122425 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:47:51.122425 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:47:51.122425 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:47:51.122425 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:47:51.123477 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935247d8-e75b-4eee-8d4d-119e6640b9cb None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:51.124149 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 236/465] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:47:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:51.125752 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d3378-2509-436e-b21d-43730a74893e None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:51.126036 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d3378-2509-436e-b21d-43730a74893e None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:51.126311 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d3378-2509-436e-b21d-43730a74893e None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:51.127750 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 237/466] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:51.128333 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d3378-2509-436e-b21d-43730a74893e None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:51.167486 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06892127-7b86-4441-80c0-9df290ffd932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:51.168486 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06892127-7b86-4441-80c0-9df290ffd932 None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:51.168778 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06892127-7b86-4441-80c0-9df290ffd932 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:51.169839 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06892127-7b86-4441-80c0-9df290ffd932 None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:51.170565 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06892127-7b86-4441-80c0-9df290ffd932 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:51.172017 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06892127-7b86-4441-80c0-9df290ffd932 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:51.209353 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:51.235960 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d3378-2509-436e-b21d-43730a74893e None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:51.268625 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31155097-9952-4b10-9bcf-141449bda6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:51.269286 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31155097-9952-4b10-9bcf-141449bda6e8 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:51.269573 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31155097-9952-4b10-9bcf-141449bda6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:51.269845 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31155097-9952-4b10-9bcf-141449bda6e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:51.270558 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31155097-9952-4b10-9bcf-141449bda6e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:51.270867 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31155097-9952-4b10-9bcf-141449bda6e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:51.272273 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31155097-9952-4b10-9bcf-141449bda6e8 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:51.284237 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 238/467] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:47:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:51.285507 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320aad67-22f5-4896-8c30-72c21d0db965 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:51.285803 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320aad67-22f5-4896-8c30-72c21d0db965 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:51.286083 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320aad67-22f5-4896-8c30-72c21d0db965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:51.303884 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-320aad67-22f5-4896-8c30-72c21d0db965 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:51.309784 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-320aad67-22f5-4896-8c30-72c21d0db965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:51.363637 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:51.370230 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 230/468] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jul 11 20:47:51 2022] POST /identity/v3/users => generated 246 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:47:51.380072 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 239/469] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:51.380072 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320aad67-22f5-4896-8c30-72c21d0db965 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:51.381498 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06892127-7b86-4441-80c0-9df290ffd932 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:51.463419 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:51.514977 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320aad67-22f5-4896-8c30-72c21d0db965 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:51.554459 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06892127-7b86-4441-80c0-9df290ffd932 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:51.562386 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5fa044-5ff6-4d38-b219-dadb72f96dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:51.563073 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5fa044-5ff6-4d38-b219-dadb72f96dd8 None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:51.563359 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5fa044-5ff6-4d38-b219-dadb72f96dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:51.564140 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5fa044-5ff6-4d38-b219-dadb72f96dd8 None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:51.564862 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5fa044-5ff6-4d38-b219-dadb72f96dd8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:51.566695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5fa044-5ff6-4d38-b219-dadb72f96dd8 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:51.596326 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad66c0-70a4-47f4-a322-a54b00774e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:51.597007 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad66c0-70a4-47f4-a322-a54b00774e8f None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:51.597298 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad66c0-70a4-47f4-a322-a54b00774e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:51.597580 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad66c0-70a4-47f4-a322-a54b00774e8f None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:51.598475 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad66c0-70a4-47f4-a322-a54b00774e8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:51.598796 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad66c0-70a4-47f4-a322-a54b00774e8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:51.600201 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad66c0-70a4-47f4-a322-a54b00774e8f None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:51.620871 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 231/470] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:47:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:51.621773 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad66c0-70a4-47f4-a322-a54b00774e8f None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:51.668045 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 240/471] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jul 11 20:47:51 2022] POST /identity/v3/users => generated 248 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:47:51.671700 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5fa044-5ff6-4d38-b219-dadb72f96dd8 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:51.723469 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:51.779068 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad66c0-70a4-47f4-a322-a54b00774e8f None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:51.799588 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5fa044-5ff6-4d38-b219-dadb72f96dd8 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:51.816664 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33548c1c-83c4-40f8-bbce-1dfc4f2b9237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:51.817565 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33548c1c-83c4-40f8-bbce-1dfc4f2b9237 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:51.817919 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33548c1c-83c4-40f8-bbce-1dfc4f2b9237 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:51.818256 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33548c1c-83c4-40f8-bbce-1dfc4f2b9237 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:51.822456 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:51.830771 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33548c1c-83c4-40f8-bbce-1dfc4f2b9237 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:51.832453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33548c1c-83c4-40f8-bbce-1dfc4f2b9237 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:51.839093 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b18ef-ac5c-445a-b50c-a4aa7283a617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:51.839793 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b18ef-ac5c-445a-b50c-a4aa7283a617 None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:51.840110 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b18ef-ac5c-445a-b50c-a4aa7283a617 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:51.840393 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b18ef-ac5c-445a-b50c-a4aa7283a617 None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:51.841109 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b18ef-ac5c-445a-b50c-a4aa7283a617 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:51.842731 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b18ef-ac5c-445a-b50c-a4aa7283a617 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:51.851801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-33548c1c-83c4-40f8-bbce-1dfc4f2b9237 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:47:51.851801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:51.851801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:51.851801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:51.851801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:51.851801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:51.851801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:51.851801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:51.851801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:51.851801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:51.851801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:51.851801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:51.851801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:47:51.851801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:47:51.851801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:47:51.853255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:47:51.853255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:51.853255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:51.853255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:51.853255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:51.853255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:51.853255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:51.853255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:51.853255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:51.853255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:51.853255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:51.853255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:51.853255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:51.853255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:51.853255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:51.853255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:51.853255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:51.854102 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:47:51.854102 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:47:51.854102 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:47:51.854102 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:47:51.856223 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 232/472] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:47:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:51.857849 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3f0ad-c7d7-48eb-b633-d3be552a57fa None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:51.858140 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3f0ad-c7d7-48eb-b633-d3be552a57fa None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:51.858418 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3f0ad-c7d7-48eb-b633-d3be552a57fa None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:51.859812 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 233/473] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:51.863834 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3f0ad-c7d7-48eb-b633-d3be552a57fa None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:51.937587 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 241/474] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jul 11 20:47:51 2022] POST /identity/v3/users => generated 248 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:47:51.940081 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319e8dc-0bad-4915-942c-2014deab41b7 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:51.940538 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319e8dc-0bad-4915-942c-2014deab41b7 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:51.941239 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319e8dc-0bad-4915-942c-2014deab41b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:51.966745 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-a319e8dc-0bad-4915-942c-2014deab41b7 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:51.968075 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a319e8dc-0bad-4915-942c-2014deab41b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:51.983239 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3f0ad-c7d7-48eb-b633-d3be552a57fa None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:51.995263 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:52.021661 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c6963-2ec8-482f-9465-fcb8be6dcd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:52.022357 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c6963-2ec8-482f-9465-fcb8be6dcd50 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:52.022645 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c6963-2ec8-482f-9465-fcb8be6dcd50 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:52.022928 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c6963-2ec8-482f-9465-fcb8be6dcd50 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:52.023673 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c6963-2ec8-482f-9465-fcb8be6dcd50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:52.024132 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c6963-2ec8-482f-9465-fcb8be6dcd50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:52.026128 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c6963-2ec8-482f-9465-fcb8be6dcd50 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:52.041960 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 234/475] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:47:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:52.048808 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c6963-2ec8-482f-9465-fcb8be6dcd50 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:52.060453 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 242/476] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:52.083575 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319e8dc-0bad-4915-942c-2014deab41b7 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:52.164919 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c6963-2ec8-482f-9465-fcb8be6dcd50 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:52.189160 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319e8dc-0bad-4915-942c-2014deab41b7 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:52.197877 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:52.207244 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a67749-b224-454d-93db-afbb441d5dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:52.208241 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a67749-b224-454d-93db-afbb441d5dbb None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:52.208966 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a67749-b224-454d-93db-afbb441d5dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:52.211922 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a67749-b224-454d-93db-afbb441d5dbb None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:52.211922 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a67749-b224-454d-93db-afbb441d5dbb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:52.212913 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a67749-b224-454d-93db-afbb441d5dbb None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:52.229157 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17803bc3-f5fc-429b-a4c6-98f60c1c19e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:52.230433 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17803bc3-f5fc-429b-a4c6-98f60c1c19e3 None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:52.234893 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17803bc3-f5fc-429b-a4c6-98f60c1c19e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:52.234893 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17803bc3-f5fc-429b-a4c6-98f60c1c19e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:52.234893 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17803bc3-f5fc-429b-a4c6-98f60c1c19e3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:52.234893 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17803bc3-f5fc-429b-a4c6-98f60c1c19e3 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:52.277343 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.sql.core [None req-17803bc3-f5fc-429b-a4c6-98f60c1c19e3 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 11 20:47:52.277343 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 11 20:47:52.277343 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [parameters: {'id': '5d26f9ecca014f40b2e63496e1cf37ff', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 11 20:47:52.277343 dv-cinder-849022-2-smb devstack@keystone.service[80375]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80375) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 11 20:47:52.294762 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-17803bc3-f5fc-429b-a4c6-98f60c1c19e3 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 11 20:47:52.294762 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:52.294762 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 20:47:52.294762 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 20:47:52.294762 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 20:47:52.294762 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 20:47:52.294762 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 20:47:52.294762 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 20:47:52.294762 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 20:47:52.294762 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application conn.query(q) Jul 11 20:47:52.294762 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 20:47:52.294762 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 20:47:52.294762 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 20:47:52.294762 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application result.read() Jul 11 20:47:52.294762 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 20:47:52.295660 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 20:47:52.295660 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 20:47:52.295660 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 20:47:52.295660 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 20:47:52.295660 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 20:47:52.295660 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 20:47:52.295660 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 20:47:52.295660 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 11 20:47:52.295660 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:47:52.295660 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 11 20:47:52.295660 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:47:52.295660 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:52.295660 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 11 20:47:52.295660 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 11 20:47:52.295660 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 11 20:47:52.295660 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return ref.to_dict() Jul 11 20:47:52.295660 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 20:47:52.295660 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application next(self.gen) Jul 11 20:47:52.296667 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 11 20:47:52.296667 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application yield resource Jul 11 20:47:52.296667 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 20:47:52.296667 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application next(self.gen) Jul 11 20:47:52.296667 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 11 20:47:52.296667 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self.session.rollback() Jul 11 20:47:52.296667 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 11 20:47:52.296667 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self.force_reraise() Jul 11 20:47:52.296667 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 11 20:47:52.296667 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise self.value Jul 11 20:47:52.296667 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 11 20:47:52.296667 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 11 20:47:52.296667 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 11 20:47:52.296667 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application session.commit() Jul 11 20:47:52.296667 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 11 20:47:52.296667 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 11 20:47:52.296667 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 11 20:47:52.297514 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._prepare_impl() Jul 11 20:47:52.297514 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 11 20:47:52.297514 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self.session.flush() Jul 11 20:47:52.297514 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 11 20:47:52.297514 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._flush(objects) Jul 11 20:47:52.297514 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 11 20:47:52.297514 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 11 20:47:52.297514 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 11 20:47:52.297514 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application compat.raise_( Jul 11 20:47:52.297514 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 20:47:52.297514 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception Jul 11 20:47:52.297514 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 11 20:47:52.297514 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application flush_context.execute() Jul 11 20:47:52.297514 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 11 20:47:52.297514 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rec.execute(self) Jul 11 20:47:52.297514 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 11 20:47:52.297514 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 11 20:47:52.299589 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 11 20:47:52.299589 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 11 20:47:52.299589 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 11 20:47:52.299589 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 11 20:47:52.299589 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 11 20:47:52.299589 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 11 20:47:52.299589 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 11 20:47:52.299589 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 11 20:47:52.299589 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 11 20:47:52.299589 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 11 20:47:52.299589 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 11 20:47:52.299589 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 11 20:47:52.299589 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 11 20:47:52.299589 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 11 20:47:52.299589 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 20:47:52.299589 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception Jul 11 20:47:52.301500 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 20:47:52.301500 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 20:47:52.301500 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 20:47:52.301500 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 20:47:52.301500 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 20:47:52.301500 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 20:47:52.301500 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 20:47:52.301500 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application conn.query(q) Jul 11 20:47:52.301500 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 20:47:52.301500 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 20:47:52.301500 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 20:47:52.301500 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application result.read() Jul 11 20:47:52.301500 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 20:47:52.301500 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 20:47:52.301500 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 20:47:52.301500 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 20:47:52.303442 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 20:47:52.303442 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 20:47:52.303442 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 20:47:52.303442 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 20:47:52.303442 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 11 20:47:52.303442 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 11 20:47:52.303442 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [parameters: {'id': '5d26f9ecca014f40b2e63496e1cf37ff', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 11 20:47:52.303442 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 11 20:47:52.303442 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:47:52.303442 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:47:52.303442 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:47:52.303442 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:52.303442 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:52.303442 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:52.303442 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:52.303442 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:52.310759 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:52.310759 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:52.310759 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:52.310759 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:52.310759 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:52.310759 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:52.310759 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 11 20:47:52.310759 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 11 20:47:52.310759 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:52.310759 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:52.310759 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 11 20:47:52.310759 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 11 20:47:52.310759 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 11 20:47:52.310759 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 11 20:47:52.310759 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 11 20:47:52.310759 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:47:52.312572 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 243/477] 10.222.0.40 () {60 vars in 1131 bytes} [Mon Jul 11 20:47:52 2022] POST /identity/v3/roles => generated 144 bytes in 216 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:47:52.312572 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17803bc3-f5fc-429b-a4c6-98f60c1c19e3 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:52.407469 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 235/478] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jul 11 20:47:52 2022] POST /identity/v3/users => generated 249 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 20:47:52.438701 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17803bc3-f5fc-429b-a4c6-98f60c1c19e3 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:52.501953 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a9a5b-06ed-4d6e-8f6f-ac2795b62ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:52.502868 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a9a5b-06ed-4d6e-8f6f-ac2795b62ede None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:52.503199 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a9a5b-06ed-4d6e-8f6f-ac2795b62ede None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:52.503491 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a9a5b-06ed-4d6e-8f6f-ac2795b62ede None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:52.516302 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a9a5b-06ed-4d6e-8f6f-ac2795b62ede None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:52.525410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-032a9a5b-06ed-4d6e-8f6f-ac2795b62ede None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:47:52.525410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:52.525410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:52.525410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:52.525410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:52.525410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:52.525410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:52.525410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:52.525410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:52.525410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:52.525410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:52.525410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:52.525410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:52.525410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:52.525410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:52.525410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:52.526471 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:52.526471 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:52.526471 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:52.526471 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:52.526471 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:52.526471 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:52.526471 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:52.526471 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:52.526471 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:52.526471 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:52.526471 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:52.526471 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:52.526471 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:52.526471 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:52.526471 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:52.526471 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:52.527252 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:52.527252 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:52.527252 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:52.527252 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:52.527252 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:52.527252 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:52.527252 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:52.527252 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:52.527252 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:52.527252 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:52.527252 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 20:47:52.527252 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:47:52.527882 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 244/479] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jul 11 20:47:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:52.533490 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a67749-b224-454d-93db-afbb441d5dbb None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:52.575555 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:52.662052 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a67749-b224-454d-93db-afbb441d5dbb None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:52.700267 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b6fba-d169-4c37-b12a-80cfbfbea64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:52.701304 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b6fba-d169-4c37-b12a-80cfbfbea64d None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:52.701839 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b6fba-d169-4c37-b12a-80cfbfbea64d None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:52.702298 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b6fba-d169-4c37-b12a-80cfbfbea64d None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:52.703295 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b6fba-d169-4c37-b12a-80cfbfbea64d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:52.703802 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b6fba-d169-4c37-b12a-80cfbfbea64d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:52.705377 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b6fba-d169-4c37-b12a-80cfbfbea64d None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:52.715149 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 236/480] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:47:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:53.731290 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291e5c7-80e2-4dbd-8116-41619d7f175b None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:53.731792 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291e5c7-80e2-4dbd-8116-41619d7f175b None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:53.731900 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291e5c7-80e2-4dbd-8116-41619d7f175b None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:53.733534 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 245/481] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:53.738370 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225f2e5-f16b-4b10-a302-d6e6f9414aae None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:53.738765 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225f2e5-f16b-4b10-a302-d6e6f9414aae None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:53.738933 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225f2e5-f16b-4b10-a302-d6e6f9414aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:53.769026 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-9225f2e5-f16b-4b10-a302-d6e6f9414aae None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:53.770253 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-9225f2e5-f16b-4b10-a302-d6e6f9414aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:53.857648 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 237/482] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:53.895156 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291e5c7-80e2-4dbd-8116-41619d7f175b None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:53.936651 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:54.033674 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291e5c7-80e2-4dbd-8116-41619d7f175b None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:54.080692 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b9cb5-eef4-454a-ad2d-e43d79f465db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:54.081512 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b9cb5-eef4-454a-ad2d-e43d79f465db None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:54.081797 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b9cb5-eef4-454a-ad2d-e43d79f465db None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:54.082076 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b9cb5-eef4-454a-ad2d-e43d79f465db None admin] PATH_INFO: `/v3/roles/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:54.094819 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367b9cb5-eef4-454a-ad2d-e43d79f465db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:54.102561 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-367b9cb5-eef4-454a-ad2d-e43d79f465db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:47:54.102561 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:54.102561 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:54.102561 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:54.102561 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:54.102561 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:54.102561 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:54.102561 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:54.102561 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:54.102561 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:54.102561 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:54.102561 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:54.102561 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:54.102561 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:54.102561 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:54.102561 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:54.104117 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:54.104117 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:54.104117 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:54.104117 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:54.104117 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:54.104117 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:54.104117 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:54.104117 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:54.104117 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:54.104117 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:54.104117 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:54.104117 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:54.104117 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:54.104117 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:54.104117 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:54.104117 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:54.104919 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:54.104919 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:54.104919 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:54.104919 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:54.104919 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:54.104919 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:54.104919 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:54.104919 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:54.104919 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:54.104919 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:54.104919 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:47:54.104919 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:47:54.104919 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 246/483] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 11 20:47:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:54.110307 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225f2e5-f16b-4b10-a302-d6e6f9414aae None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:54.153181 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:54.283256 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225f2e5-f16b-4b10-a302-d6e6f9414aae None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:54.308068 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ae402-f964-4074-804f-e77746771886 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:54.308374 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ae402-f964-4074-804f-e77746771886 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:54.308643 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ae402-f964-4074-804f-e77746771886 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:54.311247 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 247/484] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:54.315113 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0722d-8309-4b52-be63-61ed85c80367 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:54.315405 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0722d-8309-4b52-be63-61ed85c80367 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:54.315688 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0722d-8309-4b52-be63-61ed85c80367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:54.335172 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-1dc0722d-8309-4b52-be63-61ed85c80367 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:54.336376 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-1dc0722d-8309-4b52-be63-61ed85c80367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:54.349159 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc366a-fc0c-454f-b156-70532b5d933f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:54.349858 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc366a-fc0c-454f-b156-70532b5d933f None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:54.350142 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc366a-fc0c-454f-b156-70532b5d933f None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:54.350441 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc366a-fc0c-454f-b156-70532b5d933f None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:54.351176 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc366a-fc0c-454f-b156-70532b5d933f None admin] RBAC: Adding query filter params (name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:54.351489 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc366a-fc0c-454f-b156-70532b5d933f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:54.352966 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc366a-fc0c-454f-b156-70532b5d933f None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:54.374462 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 238/485] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jul 11 20:47:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:54.380257 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc366a-fc0c-454f-b156-70532b5d933f None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:54.479416 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 248/486] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:47:54.517496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0722d-8309-4b52-be63-61ed85c80367 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:54.548431 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:54.564993 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc366a-fc0c-454f-b156-70532b5d933f None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:54.572425 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:54.629355 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cfb4e2-3afa-4138-a851-0b22b41c3297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:54.630325 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cfb4e2-3afa-4138-a851-0b22b41c3297 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:54.631009 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cfb4e2-3afa-4138-a851-0b22b41c3297 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:54.631314 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cfb4e2-3afa-4138-a851-0b22b41c3297 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:54.645484 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cfb4e2-3afa-4138-a851-0b22b41c3297 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:54.647347 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cfb4e2-3afa-4138-a851-0b22b41c3297 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:54.669029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-b1cfb4e2-3afa-4138-a851-0b22b41c3297 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:47:54.669029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:54.669029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:54.669029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:54.669029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:54.669029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:54.669029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:54.669029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:54.669029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:54.669029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:54.669029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:54.669029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:54.669029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:47:54.669029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:47:54.669029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:47:54.669851 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:47:54.669851 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:54.669851 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:54.669851 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:54.669851 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:54.669851 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:54.669851 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:54.669851 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:54.669851 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:54.669851 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:54.669851 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:54.669851 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:54.669851 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:54.669851 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:54.669851 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:54.669851 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:54.669851 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:54.670884 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:47:54.670884 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:47:54.670884 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:47:54.670884 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:47:54.671151 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 239/487] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:47:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:47:54.672822 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e24f92-1866-46d3-b8b5-c33b13eb758a None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:54.673111 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e24f92-1866-46d3-b8b5-c33b13eb758a None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:54.673391 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e24f92-1866-46d3-b8b5-c33b13eb758a None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:54.675603 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 240/488] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:54.676343 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e24f92-1866-46d3-b8b5-c33b13eb758a None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:54.684618 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0722d-8309-4b52-be63-61ed85c80367 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:54.723469 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec2f12-5345-459b-9df0-3d7f43303172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:54.724508 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec2f12-5345-459b-9df0-3d7f43303172 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:54.724970 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec2f12-5345-459b-9df0-3d7f43303172 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:54.725322 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec2f12-5345-459b-9df0-3d7f43303172 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:54.737341 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec2f12-5345-459b-9df0-3d7f43303172 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:54.746121 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-c8ec2f12-5345-459b-9df0-3d7f43303172 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:47:54.746121 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:54.746121 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:54.746121 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:54.746121 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:54.746121 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:54.746121 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:54.746121 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:54.746121 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:54.746121 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:54.746121 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:54.746121 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:54.746121 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:54.746121 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:54.746121 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:54.746121 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:54.747919 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:54.747919 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:54.747919 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:54.747919 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:54.747919 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:54.747919 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:54.747919 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:54.747919 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:54.747919 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:54.747919 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:54.747919 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:54.747919 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:54.747919 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:54.747919 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:54.747919 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:54.747919 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:54.749904 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:54.749904 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:54.749904 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:54.749904 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:54.749904 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:54.749904 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:54.749904 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:54.749904 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:54.749904 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:54.749904 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:54.749904 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:47:54.749904 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:47:54.749904 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 249/489] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 11 20:47:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:54.752262 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc0ceb-8b72-48bc-8668-86aafb82eff8 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:54.752262 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc0ceb-8b72-48bc-8668-86aafb82eff8 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:54.752262 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc0ceb-8b72-48bc-8668-86aafb82eff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:54.772510 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-adfc0ceb-8b72-48bc-8668-86aafb82eff8 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:54.773896 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-adfc0ceb-8b72-48bc-8668-86aafb82eff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:54.803552 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e24f92-1866-46d3-b8b5-c33b13eb758a None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:54.841569 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:54.847246 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe490d-b52c-4a36-aea8-4bee901bd04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:54.847934 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe490d-b52c-4a36-aea8-4bee901bd04d None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:54.848288 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe490d-b52c-4a36-aea8-4bee901bd04d None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:54.848580 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe490d-b52c-4a36-aea8-4bee901bd04d None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:54.849314 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbe490d-b52c-4a36-aea8-4bee901bd04d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:54.849634 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbe490d-b52c-4a36-aea8-4bee901bd04d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:54.860100 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 250/490] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:54.860239 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbe490d-b52c-4a36-aea8-4bee901bd04d None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:54.860314 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc0ceb-8b72-48bc-8668-86aafb82eff8 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:54.865360 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 241/491] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:54.871423 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe490d-b52c-4a36-aea8-4bee901bd04d None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:54.876178 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:54.995186 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc0ceb-8b72-48bc-8668-86aafb82eff8 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:55.000672 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe490d-b52c-4a36-aea8-4bee901bd04d None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:55.034818 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9a77d-bf98-4995-b352-dded0a84c2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:55.035590 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9a77d-bf98-4995-b352-dded0a84c2f4 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:55.035949 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9a77d-bf98-4995-b352-dded0a84c2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:55.036326 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9a77d-bf98-4995-b352-dded0a84c2f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:55.037729 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9a77d-bf98-4995-b352-dded0a84c2f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:55.038341 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9a77d-bf98-4995-b352-dded0a84c2f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:55.038967 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791367e-8723-4fca-b27d-5770c515bb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:55.039989 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791367e-8723-4fca-b27d-5770c515bb1b None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:55.041159 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791367e-8723-4fca-b27d-5770c515bb1b None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:55.041321 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9a77d-bf98-4995-b352-dded0a84c2f4 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:55.041827 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791367e-8723-4fca-b27d-5770c515bb1b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:55.049771 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791367e-8723-4fca-b27d-5770c515bb1b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:55.050739 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 251/492] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jul 11 20:47:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:55.051661 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791367e-8723-4fca-b27d-5770c515bb1b None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:55.051769 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9a77d-bf98-4995-b352-dded0a84c2f4 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:55.069275 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-b791367e-8723-4fca-b27d-5770c515bb1b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 20:47:55.069275 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:55.069275 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:55.069275 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:55.069275 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:55.069275 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:55.069275 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:55.069275 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:55.069275 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:55.069275 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:55.069275 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:55.069275 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:55.069275 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:47:55.069275 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:47:55.069275 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:47:55.069275 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:47:55.070214 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:55.070214 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:55.070214 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:47:55.070214 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:47:55.070214 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:47:55.070214 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:47:55.070214 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:55.070214 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:55.070214 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:55.070214 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:55.070214 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:55.070214 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:55.070214 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:55.070214 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:55.070214 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:55.070214 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:55.070214 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:55.070214 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:55.071105 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:55.071105 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:55.071105 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:47:55.071105 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:47:55.071105 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:47:55.071105 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:47:55.071105 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:47:55.071105 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:47:55.071105 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 20:47:55.071105 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:47:55.074150 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 242/493] 10.222.0.40 () {56 vars in 1093 bytes} [Mon Jul 11 20:47:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:55.075142 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791367e-8723-4fca-b27d-5770c515bb1b None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:55.131302 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:55.132958 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:55.163493 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9a77d-bf98-4995-b352-dded0a84c2f4 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:55.180379 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791367e-8723-4fca-b27d-5770c515bb1b None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:55.201312 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d703b3e-a829-4ac6-860c-d648b52159f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:55.202113 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d703b3e-a829-4ac6-860c-d648b52159f0 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:55.202399 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d703b3e-a829-4ac6-860c-d648b52159f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:55.202673 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d703b3e-a829-4ac6-860c-d648b52159f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:55.214273 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d703b3e-a829-4ac6-860c-d648b52159f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:55.217529 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa061a1c-dea7-4b0d-9c51-4e49675f806c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:55.218328 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa061a1c-dea7-4b0d-9c51-4e49675f806c None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:55.218618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa061a1c-dea7-4b0d-9c51-4e49675f806c None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:55.218896 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa061a1c-dea7-4b0d-9c51-4e49675f806c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:55.221930 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-0d703b3e-a829-4ac6-860c-d648b52159f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:47:55.221930 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:55.221930 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:55.221930 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:55.221930 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:55.221930 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:55.221930 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:55.221930 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:55.221930 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:55.221930 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:55.221930 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:55.221930 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:55.221930 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:55.221930 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:55.221930 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:55.221930 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:55.222944 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:55.222944 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:55.222944 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:55.222944 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:55.222944 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:55.222944 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:55.222944 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:55.222944 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:55.222944 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:55.222944 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:55.222944 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:55.222944 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:55.222944 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:55.222944 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:55.222944 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:55.222944 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:55.223746 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:55.223746 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:55.223746 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:55.223746 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:55.223746 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:55.223746 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:55.223746 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:55.223746 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:55.223746 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:55.223746 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:55.223746 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:47:55.223746 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:47:55.228907 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 252/494] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 11 20:47:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:55.235652 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d703b3e-a829-4ac6-860c-d648b52159f0 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:55.235756 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa061a1c-dea7-4b0d-9c51-4e49675f806c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:55.235756 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa061a1c-dea7-4b0d-9c51-4e49675f806c None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:55.252396 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-aa061a1c-dea7-4b0d-9c51-4e49675f806c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:47:55.252396 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:55.252396 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:55.252396 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:55.252396 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:55.252396 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:55.252396 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:55.252396 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:55.252396 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:55.252396 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:55.252396 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:55.252396 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:55.252396 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:47:55.252396 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:47:55.252396 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:47:55.253365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:47:55.253365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:55.253365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:55.253365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:55.253365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:55.253365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:55.253365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:55.253365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:55.253365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:55.253365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:55.253365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:55.253365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:55.253365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:55.253365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:55.253365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:55.253365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:55.253365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:55.254205 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:47:55.254205 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:47:55.254205 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:47:55.254205 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:47:55.254205 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 243/495] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:47:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:55.254927 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8c985-a144-4cc3-b7af-25b223310848 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:55.255227 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8c985-a144-4cc3-b7af-25b223310848 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:55.255511 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8c985-a144-4cc3-b7af-25b223310848 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:55.261150 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 244/496] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:55.261150 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8c985-a144-4cc3-b7af-25b223310848 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:55.353627 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d703b3e-a829-4ac6-860c-d648b52159f0 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:55.365452 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8c985-a144-4cc3-b7af-25b223310848 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:55.367770 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:55.382149 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:55.386784 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5881af-8e20-4e19-9e74-6317222e2adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:55.387462 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5881af-8e20-4e19-9e74-6317222e2adf None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:55.387755 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5881af-8e20-4e19-9e74-6317222e2adf None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:55.388070 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5881af-8e20-4e19-9e74-6317222e2adf None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:55.388901 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5881af-8e20-4e19-9e74-6317222e2adf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:55.389218 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5881af-8e20-4e19-9e74-6317222e2adf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:55.390665 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5881af-8e20-4e19-9e74-6317222e2adf None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:55.401214 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ada977-f2cd-4c5c-94b9-4a639f390198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:55.404312 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ada977-f2cd-4c5c-94b9-4a639f390198 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:55.404312 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ada977-f2cd-4c5c-94b9-4a639f390198 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:55.404312 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ada977-f2cd-4c5c-94b9-4a639f390198 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:55.404312 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ada977-f2cd-4c5c-94b9-4a639f390198 None admin] RBAC: Adding query filter params (name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:55.404312 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ada977-f2cd-4c5c-94b9-4a639f390198 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:55.404791 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ada977-f2cd-4c5c-94b9-4a639f390198 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:55.412718 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 245/497] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jul 11 20:47:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:55.413497 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ada977-f2cd-4c5c-94b9-4a639f390198 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:55.430916 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 253/498] 10.222.0.40 () {56 vars in 1133 bytes} [Mon Jul 11 20:47:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:55.430916 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dcfd38-2545-4585-8931-3b2b66037c03 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:55.430916 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dcfd38-2545-4585-8931-3b2b66037c03 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:55.430916 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dcfd38-2545-4585-8931-3b2b66037c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:55.446573 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-d4dcfd38-2545-4585-8931-3b2b66037c03 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:55.447862 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-d4dcfd38-2545-4585-8931-3b2b66037c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:55.513520 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ada977-f2cd-4c5c-94b9-4a639f390198 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:55.513726 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 254/499] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:55.514849 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7788f-0775-48dd-9159-9858516d93ce None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:55.515144 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7788f-0775-48dd-9159-9858516d93ce None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:55.515423 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7788f-0775-48dd-9159-9858516d93ce None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:55.516890 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 255/500] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:55.521779 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7788f-0775-48dd-9159-9858516d93ce None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:55.548524 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7020d3-8a85-4296-ac3c-55f78966ea4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:55.549194 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7020d3-8a85-4296-ac3c-55f78966ea4e None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:55.549505 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7020d3-8a85-4296-ac3c-55f78966ea4e None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:55.549783 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7020d3-8a85-4296-ac3c-55f78966ea4e None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:55.550500 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7020d3-8a85-4296-ac3c-55f78966ea4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:55.550809 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7020d3-8a85-4296-ac3c-55f78966ea4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:55.552196 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7020d3-8a85-4296-ac3c-55f78966ea4e None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:55.563699 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 246/501] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:55.564521 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7020d3-8a85-4296-ac3c-55f78966ea4e None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:55.595368 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:55.623192 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7788f-0775-48dd-9159-9858516d93ce None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:55.644131 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:55.658746 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc365d23-2d95-44db-af99-b04896741aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:55.659554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc365d23-2d95-44db-af99-b04896741aeb None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:55.659876 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc365d23-2d95-44db-af99-b04896741aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:55.662740 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc365d23-2d95-44db-af99-b04896741aeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:55.669404 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7020d3-8a85-4296-ac3c-55f78966ea4e None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:55.671807 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc365d23-2d95-44db-af99-b04896741aeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:55.673331 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc365d23-2d95-44db-af99-b04896741aeb None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:55.692554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-bc365d23-2d95-44db-af99-b04896741aeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:47:55.692554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:55.692554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:55.692554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:55.692554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:55.692554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:55.692554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:55.692554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:55.692554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:55.692554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:55.692554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:55.692554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:55.692554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:47:55.692554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:47:55.692554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:47:55.693620 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:47:55.693620 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:55.693620 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:55.693620 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:55.693620 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:55.693620 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:55.693620 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:55.693620 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:55.693620 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:55.693620 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:55.693620 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:55.693620 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:55.693620 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:55.693620 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:55.693620 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:55.693620 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:55.693620 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:55.694488 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:47:55.694488 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:47:55.694488 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:47:55.694488 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:47:55.694488 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 256/502] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:47:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:55.694916 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09809a-31f4-4ca9-b213-f62944c4b69f None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:55.695207 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09809a-31f4-4ca9-b213-f62944c4b69f None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:55.695487 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09809a-31f4-4ca9-b213-f62944c4b69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:55.705072 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa66121-f4a5-4fd1-9132-5779d5309e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:55.705729 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa66121-f4a5-4fd1-9132-5779d5309e53 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:55.706014 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa66121-f4a5-4fd1-9132-5779d5309e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:55.706292 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa66121-f4a5-4fd1-9132-5779d5309e53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:55.713418 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-6d09809a-31f4-4ca9-b213-f62944c4b69f None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:55.714619 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-6d09809a-31f4-4ca9-b213-f62944c4b69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:55.773486 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa66121-f4a5-4fd1-9132-5779d5309e53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:55.775022 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa66121-f4a5-4fd1-9132-5779d5309e53 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:55.779402 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 257/503] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:55.780254 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09809a-31f4-4ca9-b213-f62944c4b69f None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:55.803919 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:55.876331 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 247/504] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:47:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:47:55.876926 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa66121-f4a5-4fd1-9132-5779d5309e53 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:55.879997 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09809a-31f4-4ca9-b213-f62944c4b69f None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:55.881856 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:55.913584 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9aeb9d-56de-44b4-9694-b9589e5ec0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:55.914385 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9aeb9d-56de-44b4-9694-b9589e5ec0a5 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:55.914666 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9aeb9d-56de-44b4-9694-b9589e5ec0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:55.914942 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9aeb9d-56de-44b4-9694-b9589e5ec0a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:55.925925 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9aeb9d-56de-44b4-9694-b9589e5ec0a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:55.934267 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-da9aeb9d-56de-44b4-9694-b9589e5ec0a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:47:55.934267 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:55.934267 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:55.934267 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:55.934267 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:55.934267 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:55.934267 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:55.934267 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:55.934267 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:55.934267 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:55.934267 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:55.934267 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:55.934267 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:55.934267 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:55.934267 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:55.934267 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:55.935215 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:55.935215 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:55.935215 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:55.935215 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:55.935215 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:55.935215 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:55.935215 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:55.935215 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:55.935215 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:55.935215 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:55.935215 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:55.935215 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:55.935215 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:55.935215 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:55.935215 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:55.935215 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:55.936042 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:55.936042 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:55.936042 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:55.936042 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:55.936042 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:55.936042 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:55.936042 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:55.936042 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:55.936042 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:55.936042 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:55.936042 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:47:55.936042 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:47:55.936042 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 258/505] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 11 20:47:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:55.936769 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9aeb9d-56de-44b4-9694-b9589e5ec0a5 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:55.978889 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa66121-f4a5-4fd1-9132-5779d5309e53 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:56.004135 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:56.012152 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5651b7-7bfe-47ac-96ee-ceac6510f8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:56.012948 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5651b7-7bfe-47ac-96ee-ceac6510f8ea None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:56.013235 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5651b7-7bfe-47ac-96ee-ceac6510f8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:56.013511 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5651b7-7bfe-47ac-96ee-ceac6510f8ea None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:56.020339 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5651b7-7bfe-47ac-96ee-ceac6510f8ea None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:56.021803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5651b7-7bfe-47ac-96ee-ceac6510f8ea None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:56.034423 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9aeb9d-56de-44b4-9694-b9589e5ec0a5 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:56.037366 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-0f5651b7-7bfe-47ac-96ee-ceac6510f8ea None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 20:47:56.037366 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:56.037366 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:56.037366 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:56.037366 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:56.037366 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:56.037366 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:56.037366 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:56.037366 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:56.037366 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:56.037366 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:56.037366 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:56.037366 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:47:56.037366 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:47:56.037366 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:47:56.037366 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:47:56.038240 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:56.038240 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:56.038240 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:47:56.038240 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:47:56.038240 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:47:56.038240 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:47:56.038240 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:56.038240 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:56.038240 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:56.038240 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:56.038240 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:56.038240 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:56.038240 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:56.038240 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:56.038240 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:56.038240 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:56.038240 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:56.038240 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:56.039107 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:56.039107 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:56.039107 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:47:56.039107 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:47:56.039107 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:47:56.039107 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:47:56.039107 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:47:56.039107 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:47:56.039107 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 20:47:56.039107 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:47:56.040136 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 248/506] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:47:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:56.041260 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5651b7-7bfe-47ac-96ee-ceac6510f8ea None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:56.067871 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f513a24b-e7b1-4135-82eb-d4cc3fc62eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:56.068569 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513a24b-e7b1-4135-82eb-d4cc3fc62eef None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:56.068858 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513a24b-e7b1-4135-82eb-d4cc3fc62eef None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:56.069136 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513a24b-e7b1-4135-82eb-d4cc3fc62eef None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:56.069857 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f513a24b-e7b1-4135-82eb-d4cc3fc62eef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:56.070174 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f513a24b-e7b1-4135-82eb-d4cc3fc62eef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:56.072013 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f513a24b-e7b1-4135-82eb-d4cc3fc62eef None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:56.083306 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 259/507] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:56.084119 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f513a24b-e7b1-4135-82eb-d4cc3fc62eef None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:56.107830 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:56.145731 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5651b7-7bfe-47ac-96ee-ceac6510f8ea None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:56.182162 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb414214-05b9-4c4f-944a-a45f0c4e8a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:56.182371 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f513a24b-e7b1-4135-82eb-d4cc3fc62eef None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:56.182947 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb414214-05b9-4c4f-944a-a45f0c4e8a3f None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:56.183232 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb414214-05b9-4c4f-944a-a45f0c4e8a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:56.183509 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb414214-05b9-4c4f-944a-a45f0c4e8a3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:56.193667 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb414214-05b9-4c4f-944a-a45f0c4e8a3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:56.195105 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb414214-05b9-4c4f-944a-a45f0c4e8a3f None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:56.213165 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-bb414214-05b9-4c4f-944a-a45f0c4e8a3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:47:56.213165 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:56.213165 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:56.213165 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:56.213165 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:56.213165 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:56.213165 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:56.213165 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:56.213165 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:56.213165 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:56.213165 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:56.213165 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:56.213165 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:47:56.213165 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:47:56.213165 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:47:56.214013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:47:56.214013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:56.214013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:56.214013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:56.214013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:56.214013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:56.214013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:56.214013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:56.214013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:56.214013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:56.214013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:56.214013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:56.214013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:56.214013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:56.214013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:56.214013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:56.214013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:56.214862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:47:56.214862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:47:56.214862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:47:56.214862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:47:56.214862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 249/508] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:47:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:56.215123 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb414214-05b9-4c4f-944a-a45f0c4e8a3f None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:56.220711 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e59014-bb3a-4e71-a8e9-5f2b92fa4c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:56.221516 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e59014-bb3a-4e71-a8e9-5f2b92fa4c9d None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:56.221806 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e59014-bb3a-4e71-a8e9-5f2b92fa4c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:56.222100 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e59014-bb3a-4e71-a8e9-5f2b92fa4c9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:56.233147 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e59014-bb3a-4e71-a8e9-5f2b92fa4c9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:56.234602 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e59014-bb3a-4e71-a8e9-5f2b92fa4c9d None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:56.252333 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-08e59014-bb3a-4e71-a8e9-5f2b92fa4c9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:47:56.252333 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:56.252333 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:56.252333 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:56.252333 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:56.252333 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:56.252333 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:56.252333 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:56.252333 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:56.252333 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:56.252333 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:56.252333 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:56.252333 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:47:56.252333 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:47:56.252333 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:47:56.253212 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:47:56.253212 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:56.253212 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:56.253212 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:56.253212 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:56.253212 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:56.253212 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:56.253212 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:56.253212 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:56.253212 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:56.253212 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:56.253212 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:56.253212 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:56.253212 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:56.253212 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:56.253212 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:56.253212 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:56.254068 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:47:56.254068 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:47:56.254068 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:47:56.254068 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:47:56.254068 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 260/509] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:47:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:56.254340 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e59014-bb3a-4e71-a8e9-5f2b92fa4c9d None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:56.261437 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:56.319862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb414214-05b9-4c4f-944a-a45f0c4e8a3f None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:56.328559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:56.353455 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e59014-bb3a-4e71-a8e9-5f2b92fa4c9d None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:56.353693 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1fbd5-955c-4e57-b8fa-ae9d0b8dfc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:56.354313 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1fbd5-955c-4e57-b8fa-ae9d0b8dfc4a None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:56.354599 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1fbd5-955c-4e57-b8fa-ae9d0b8dfc4a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:56.354880 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1fbd5-955c-4e57-b8fa-ae9d0b8dfc4a None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:56.356389 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a1fbd5-955c-4e57-b8fa-ae9d0b8dfc4a None admin] RBAC: Adding query filter params (name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:56.356389 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a1fbd5-955c-4e57-b8fa-ae9d0b8dfc4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:56.357344 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a1fbd5-955c-4e57-b8fa-ae9d0b8dfc4a None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:56.365131 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 250/510] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jul 11 20:47:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:56.365910 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1fbd5-955c-4e57-b8fa-ae9d0b8dfc4a None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:56.391987 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02fcba0-d4ce-4a2c-bf0a-b950d5faedcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:56.392669 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02fcba0-d4ce-4a2c-bf0a-b950d5faedcb None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:56.392959 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02fcba0-d4ce-4a2c-bf0a-b950d5faedcb None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:56.393230 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02fcba0-d4ce-4a2c-bf0a-b950d5faedcb None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:56.394056 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02fcba0-d4ce-4a2c-bf0a-b950d5faedcb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:56.394364 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02fcba0-d4ce-4a2c-bf0a-b950d5faedcb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:56.395848 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02fcba0-d4ce-4a2c-bf0a-b950d5faedcb None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:56.413188 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 261/511] 10.222.0.40 () {56 vars in 1137 bytes} [Mon Jul 11 20:47:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:56.413982 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02fcba0-d4ce-4a2c-bf0a-b950d5faedcb None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:56.465507 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:56.468525 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1fbd5-955c-4e57-b8fa-ae9d0b8dfc4a None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:56.502489 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d47848-4272-4adb-aed5-0a2aaa8d61ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:56.503290 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d47848-4272-4adb-aed5-0a2aaa8d61ac None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:56.503834 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d47848-4272-4adb-aed5-0a2aaa8d61ac None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:56.503834 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d47848-4272-4adb-aed5-0a2aaa8d61ac None admin] PATH_INFO: `/v3/users/glance` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:56.512431 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d47848-4272-4adb-aed5-0a2aaa8d61ac None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:56.512913 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02fcba0-d4ce-4a2c-bf0a-b950d5faedcb None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:56.513857 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d47848-4272-4adb-aed5-0a2aaa8d61ac None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:56.527738 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-f7d47848-4272-4adb-aed5-0a2aaa8d61ac None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 11 20:47:56.527738 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:56.527738 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:56.527738 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:56.527738 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:56.527738 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:56.527738 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:56.527738 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:56.527738 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:56.527738 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:56.527738 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:56.527738 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:56.527738 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:47:56.527738 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:47:56.527738 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:47:56.527738 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:47:56.528860 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:56.528860 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:56.528860 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:47:56.528860 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:47:56.528860 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:47:56.528860 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:47:56.528860 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:56.528860 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:56.528860 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:56.528860 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:56.528860 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:56.528860 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:56.528860 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:56.528860 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:56.528860 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:56.528860 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:56.528860 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:56.528860 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:56.529964 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:56.529964 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:56.529964 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:47:56.529964 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:47:56.529964 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:47:56.529964 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:47:56.529964 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:47:56.529964 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:47:56.529964 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 11 20:47:56.529964 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:47:56.529964 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 251/512] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:47:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:56.529964 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d47848-4272-4adb-aed5-0a2aaa8d61ac None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:56.546243 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:56.550984 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6343eff-4e0c-4e77-a5fd-270e17a0a410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:56.551656 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6343eff-4e0c-4e77-a5fd-270e17a0a410 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:56.551940 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6343eff-4e0c-4e77-a5fd-270e17a0a410 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:56.552251 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6343eff-4e0c-4e77-a5fd-270e17a0a410 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:56.552968 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6343eff-4e0c-4e77-a5fd-270e17a0a410 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:56.553275 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6343eff-4e0c-4e77-a5fd-270e17a0a410 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:56.554677 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6343eff-4e0c-4e77-a5fd-270e17a0a410 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:56.566269 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 262/513] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:56.567063 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6343eff-4e0c-4e77-a5fd-270e17a0a410 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:56.630394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d47848-4272-4adb-aed5-0a2aaa8d61ac None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:56.666076 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cc079-276c-4fce-a2de-8744660f9fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:56.666456 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cc079-276c-4fce-a2de-8744660f9fab None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:56.666656 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cc079-276c-4fce-a2de-8744660f9fab None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:56.666931 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cc079-276c-4fce-a2de-8744660f9fab None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:56.667688 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7cc079-276c-4fce-a2de-8744660f9fab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:56.667988 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7cc079-276c-4fce-a2de-8744660f9fab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:56.669387 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7cc079-276c-4fce-a2de-8744660f9fab None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:56.670252 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6343eff-4e0c-4e77-a5fd-270e17a0a410 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:56.681925 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 252/514] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:56.682747 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cc079-276c-4fce-a2de-8744660f9fab None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:56.705474 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:56.706702 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7871261-670b-4dac-ad65-aa20aef6312d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:56.707542 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7871261-670b-4dac-ad65-aa20aef6312d None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:56.707838 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7871261-670b-4dac-ad65-aa20aef6312d None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:56.708174 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7871261-670b-4dac-ad65-aa20aef6312d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:56.719536 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7871261-670b-4dac-ad65-aa20aef6312d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:56.721029 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7871261-670b-4dac-ad65-aa20aef6312d None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:56.740430 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-d7871261-670b-4dac-ad65-aa20aef6312d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:47:56.740430 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:56.740430 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:56.740430 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:56.740430 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:56.740430 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:56.740430 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:56.740430 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:56.740430 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:56.740430 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:56.740430 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:56.740430 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:56.740430 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:47:56.740430 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:47:56.740430 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:47:56.741354 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:47:56.741354 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:56.741354 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:56.741354 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:56.741354 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:56.741354 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:56.741354 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:56.741354 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:56.741354 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:56.741354 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:56.741354 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:56.741354 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:56.741354 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:56.741354 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:56.741354 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:56.741354 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:56.741354 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:56.742202 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:47:56.742202 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:47:56.742202 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:47:56.742202 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:47:56.742202 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 263/515] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:47:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:56.742460 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7871261-670b-4dac-ad65-aa20aef6312d None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:56.786595 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cc079-276c-4fce-a2de-8744660f9fab None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:56.787756 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:56.821128 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc246a-b2d7-4bad-b6e7-459a317495ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:56.821807 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc246a-b2d7-4bad-b6e7-459a317495ac None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:56.822103 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc246a-b2d7-4bad-b6e7-459a317495ac None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:56.822382 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc246a-b2d7-4bad-b6e7-459a317495ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:56.842537 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7871261-670b-4dac-ad65-aa20aef6312d None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:56.876765 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b670a42-f33d-48a8-a9f3-cc9276c05022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:56.877435 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b670a42-f33d-48a8-a9f3-cc9276c05022 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:56.877722 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b670a42-f33d-48a8-a9f3-cc9276c05022 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:56.878010 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b670a42-f33d-48a8-a9f3-cc9276c05022 None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:56.878838 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b670a42-f33d-48a8-a9f3-cc9276c05022 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:56.879152 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b670a42-f33d-48a8-a9f3-cc9276c05022 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:56.880633 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b670a42-f33d-48a8-a9f3-cc9276c05022 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:56.889883 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc246a-b2d7-4bad-b6e7-459a317495ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:56.891319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc246a-b2d7-4bad-b6e7-459a317495ac None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:56.897586 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 264/516] 10.222.0.40 () {56 vars in 1137 bytes} [Mon Jul 11 20:47:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:56.898369 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b670a42-f33d-48a8-a9f3-cc9276c05022 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:56.913130 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:56.990351 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 253/517] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:47:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:47:56.991176 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc246a-b2d7-4bad-b6e7-459a317495ac None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:56.995911 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b670a42-f33d-48a8-a9f3-cc9276c05022 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:56.997552 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:57.030912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0b292-fb81-40ab-a218-f0af94be3767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:57.031587 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0b292-fb81-40ab-a218-f0af94be3767 None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:57.031875 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0b292-fb81-40ab-a218-f0af94be3767 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:57.032183 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0b292-fb81-40ab-a218-f0af94be3767 None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:57.032882 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0b292-fb81-40ab-a218-f0af94be3767 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:57.034379 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0b292-fb81-40ab-a218-f0af94be3767 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:57.091492 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc246a-b2d7-4bad-b6e7-459a317495ac None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:57.110544 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:57.128045 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 265/518] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jul 11 20:47:56 2022] POST /identity/v3/users => generated 247 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:47:57.128045 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0b292-fb81-40ab-a218-f0af94be3767 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:57.128376 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85ad08-641b-43e0-b2b6-1edadd9a79aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:57.128376 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85ad08-641b-43e0-b2b6-1edadd9a79aa None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:57.128376 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85ad08-641b-43e0-b2b6-1edadd9a79aa None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:57.128376 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85ad08-641b-43e0-b2b6-1edadd9a79aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:57.135038 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec85ad08-641b-43e0-b2b6-1edadd9a79aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:57.136571 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec85ad08-641b-43e0-b2b6-1edadd9a79aa None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:57.153804 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-ec85ad08-641b-43e0-b2b6-1edadd9a79aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:47:57.153804 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:57.153804 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:57.153804 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:57.153804 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:57.153804 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:57.153804 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:57.153804 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:57.153804 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:57.153804 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:57.153804 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:57.153804 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:57.153804 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:47:57.153804 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:47:57.153804 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:47:57.154752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:47:57.154752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:57.154752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:57.154752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:57.154752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:57.154752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:57.154752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:57.154752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:57.154752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:57.154752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:57.154752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:57.154752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:57.154752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:57.154752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:57.154752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:57.154752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:57.154752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:57.155598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:47:57.155598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:47:57.155598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:47:57.155598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:47:57.155598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:47:57.155598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:47:57.155598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:47:57.155598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:47:57.155598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 254/519] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:47:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:57.156104 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85ad08-641b-43e0-b2b6-1edadd9a79aa None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:57.239322 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0b292-fb81-40ab-a218-f0af94be3767 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:57.269227 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85ad08-641b-43e0-b2b6-1edadd9a79aa None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:57.279015 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a954559-f3bd-417c-842c-70cdc5dc1e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:57.279699 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a954559-f3bd-417c-842c-70cdc5dc1e60 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:57.280019 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a954559-f3bd-417c-842c-70cdc5dc1e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:57.280299 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a954559-f3bd-417c-842c-70cdc5dc1e60 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:57.281033 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a954559-f3bd-417c-842c-70cdc5dc1e60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:57.281345 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a954559-f3bd-417c-842c-70cdc5dc1e60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:57.282818 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a954559-f3bd-417c-842c-70cdc5dc1e60 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:57.296315 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 266/520] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:47:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:57.300527 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a954559-f3bd-417c-842c-70cdc5dc1e60 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:57.315013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b23432-2ed9-474f-b3a9-a1ebe470b1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:57.315692 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b23432-2ed9-474f-b3a9-a1ebe470b1b7 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:57.316031 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b23432-2ed9-474f-b3a9-a1ebe470b1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:57.316323 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b23432-2ed9-474f-b3a9-a1ebe470b1b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:57.322937 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:57.372179 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:57.393246 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b23432-2ed9-474f-b3a9-a1ebe470b1b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:57.394920 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b23432-2ed9-474f-b3a9-a1ebe470b1b7 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:57.408645 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a954559-f3bd-417c-842c-70cdc5dc1e60 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:57.445447 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d49eb7-fa1e-49d2-861d-bd8a9e3029fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:57.446253 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d49eb7-fa1e-49d2-861d-bd8a9e3029fa None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:57.446632 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d49eb7-fa1e-49d2-861d-bd8a9e3029fa None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:57.447074 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d49eb7-fa1e-49d2-861d-bd8a9e3029fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:57.457422 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d49eb7-fa1e-49d2-861d-bd8a9e3029fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:57.458919 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d49eb7-fa1e-49d2-861d-bd8a9e3029fa None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:57.476933 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-52d49eb7-fa1e-49d2-861d-bd8a9e3029fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:47:57.476933 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:57.476933 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:57.476933 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:57.476933 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:57.476933 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:57.476933 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:57.476933 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:57.476933 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:57.476933 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:57.476933 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:57.476933 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:57.476933 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:47:57.476933 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:47:57.476933 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:47:57.477987 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:47:57.477987 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:57.477987 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:57.477987 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:57.477987 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:57.477987 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:57.477987 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:57.477987 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:57.477987 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:57.477987 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:57.477987 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:57.477987 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:57.477987 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:57.477987 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:57.477987 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:57.477987 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:57.477987 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:57.479061 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:47:57.479061 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:47:57.479061 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:47:57.479061 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:47:57.479061 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 267/521] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:47:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:57.479902 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d49eb7-fa1e-49d2-861d-bd8a9e3029fa None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:57.510735 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 255/522] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:47:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:47:57.512050 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b23432-2ed9-474f-b3a9-a1ebe470b1b7 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:57.562671 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:57.595229 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:57.600417 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d49eb7-fa1e-49d2-861d-bd8a9e3029fa None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:57.615733 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b23432-2ed9-474f-b3a9-a1ebe470b1b7 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:57.637502 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decffb6f-0a6e-4302-a5d4-fdda92094afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:57.638181 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decffb6f-0a6e-4302-a5d4-fdda92094afd None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:57.638467 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decffb6f-0a6e-4302-a5d4-fdda92094afd None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:57.638751 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decffb6f-0a6e-4302-a5d4-fdda92094afd None admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:57.639559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decffb6f-0a6e-4302-a5d4-fdda92094afd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:57.639848 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decffb6f-0a6e-4302-a5d4-fdda92094afd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:57.641335 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decffb6f-0a6e-4302-a5d4-fdda92094afd None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:57.656193 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b3a45-5afb-441a-90c5-cf5b25e4b578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:57.657249 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b3a45-5afb-441a-90c5-cf5b25e4b578 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:57.657535 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b3a45-5afb-441a-90c5-cf5b25e4b578 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:57.657811 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b3a45-5afb-441a-90c5-cf5b25e4b578 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:57.662854 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 268/523] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 11 20:47:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:57.662854 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decffb6f-0a6e-4302-a5d4-fdda92094afd None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:57.671853 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8b3a45-5afb-441a-90c5-cf5b25e4b578 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:57.673071 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8b3a45-5afb-441a-90c5-cf5b25e4b578 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:57.688375 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-3c8b3a45-5afb-441a-90c5-cf5b25e4b578 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 20:47:57.688375 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:57.688375 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:57.688375 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:57.688375 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:57.688375 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:57.688375 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:57.688375 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:57.688375 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:57.688375 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:57.688375 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:57.688375 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:57.688375 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:47:57.688375 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:47:57.688375 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:47:57.688375 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:47:57.689307 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:57.689307 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:57.689307 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:47:57.689307 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:47:57.689307 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:47:57.689307 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:47:57.689307 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:57.689307 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:57.689307 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:57.689307 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:57.689307 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:57.689307 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:57.689307 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:57.689307 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:57.689307 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:57.689307 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:57.689307 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:57.689307 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:57.690264 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:57.690264 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:57.690264 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:47:57.690264 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:47:57.690264 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:47:57.690264 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:47:57.690264 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:47:57.690264 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:47:57.690264 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 20:47:57.690264 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:47:57.690264 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 256/524] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 11 20:47:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:57.690841 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b3a45-5afb-441a-90c5-cf5b25e4b578 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:57.774397 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decffb6f-0a6e-4302-a5d4-fdda92094afd None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:57.799757 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b3a45-5afb-441a-90c5-cf5b25e4b578 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:57.806639 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:57.812463 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d5e33-ffce-4cc1-b07b-edfd64c41851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:57.813212 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d5e33-ffce-4cc1-b07b-edfd64c41851 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:57.813443 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d5e33-ffce-4cc1-b07b-edfd64c41851 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:57.813731 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d5e33-ffce-4cc1-b07b-edfd64c41851 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:57.814544 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d5e33-ffce-4cc1-b07b-edfd64c41851 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:57.814870 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d5e33-ffce-4cc1-b07b-edfd64c41851 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:57.816293 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d5e33-ffce-4cc1-b07b-edfd64c41851 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:57.828714 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 269/525] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:47:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:57.829617 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d5e33-ffce-4cc1-b07b-edfd64c41851 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:57.844305 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80d108-cd5e-42ef-a2de-199ff931f9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:57.845171 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80d108-cd5e-42ef-a2de-199ff931f9b4 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:57.845406 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80d108-cd5e-42ef-a2de-199ff931f9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:57.845685 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80d108-cd5e-42ef-a2de-199ff931f9b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:57.855401 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:57.857413 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa80d108-cd5e-42ef-a2de-199ff931f9b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:57.859544 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa80d108-cd5e-42ef-a2de-199ff931f9b4 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:57.880394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-fa80d108-cd5e-42ef-a2de-199ff931f9b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:47:57.880394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:57.880394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:57.880394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:57.880394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:57.880394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:57.880394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:57.880394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:57.880394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:57.880394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:57.880394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:57.880394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:57.880394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:47:57.880394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:47:57.880394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:47:57.881305 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:47:57.881305 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:57.881305 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:57.881305 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:57.881305 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:57.881305 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:57.881305 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:57.881305 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:57.881305 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:57.881305 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:57.881305 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:57.881305 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:57.881305 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:57.881305 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:57.881305 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:57.881305 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:57.881305 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:57.882230 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:47:57.882230 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:47:57.882230 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:47:57.882230 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:47:57.882230 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 257/526] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:47:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:57.882517 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80d108-cd5e-42ef-a2de-199ff931f9b4 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:57.943018 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d5e33-ffce-4cc1-b07b-edfd64c41851 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:57.978204 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9e284-2725-45f0-9b2a-1a2744757275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:57.978880 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9e284-2725-45f0-9b2a-1a2744757275 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:57.979178 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9e284-2725-45f0-9b2a-1a2744757275 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:57.979441 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9e284-2725-45f0-9b2a-1a2744757275 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:57.980296 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9e284-2725-45f0-9b2a-1a2744757275 None admin] RBAC: Adding query filter params (role.id=17bc727d82f24074aba8b1185cb99739, scope.project.id=eca3ef2561fa435e80ff451aeab14f3b, user.id=8ac15411c75f4bd4a86f6753c9240a5b) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:57.980615 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9e284-2725-45f0-9b2a-1a2744757275 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:57.982053 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9e284-2725-45f0-9b2a-1a2744757275 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:57.988000 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 270/527] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:47:57 2022] GET /identity/v3/role_assignments?user.id=8ac15411c75f4bd4a86f6753c9240a5b&scope.project.id=eca3ef2561fa435e80ff451aeab14f3b&role.id=17bc727d82f24074aba8b1185cb99739 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:57.988000 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9e284-2725-45f0-9b2a-1a2744757275 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:58.004676 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80d108-cd5e-42ef-a2de-199ff931f9b4 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:58.052993 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:58.055894 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8ae3f-27b6-4c23-9bf4-5e3785a08264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:58.056949 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8ae3f-27b6-4c23-9bf4-5e3785a08264 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:58.057244 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8ae3f-27b6-4c23-9bf4-5e3785a08264 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:58.057527 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8ae3f-27b6-4c23-9bf4-5e3785a08264 None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:58.058930 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8ae3f-27b6-4c23-9bf4-5e3785a08264 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:58.059258 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8ae3f-27b6-4c23-9bf4-5e3785a08264 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:58.061218 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8ae3f-27b6-4c23-9bf4-5e3785a08264 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:58.111818 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9e284-2725-45f0-9b2a-1a2744757275 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:58.120429 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 258/528] 10.222.0.40 () {56 vars in 1139 bytes} [Mon Jul 11 20:47:57 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:58.122180 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8ae3f-27b6-4c23-9bf4-5e3785a08264 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:58.154758 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b0eece-2c51-4285-8ed4-dc85df62ae4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:58.155569 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0eece-2c51-4285-8ed4-dc85df62ae4c None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:58.155859 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0eece-2c51-4285-8ed4-dc85df62ae4c None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:58.156169 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0eece-2c51-4285-8ed4-dc85df62ae4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:58.165619 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b0eece-2c51-4285-8ed4-dc85df62ae4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:58.167057 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b0eece-2c51-4285-8ed4-dc85df62ae4c None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:58.182996 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-23b0eece-2c51-4285-8ed4-dc85df62ae4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:47:58.182996 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:58.182996 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:58.182996 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:58.182996 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:58.182996 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:58.182996 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:58.182996 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:58.182996 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:58.182996 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:58.182996 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:58.182996 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:58.182996 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:47:58.182996 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:47:58.182996 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:47:58.183881 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:47:58.183881 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:58.183881 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:58.183881 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:58.183881 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:58.183881 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:58.183881 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:58.183881 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:58.183881 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:58.183881 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:58.183881 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:58.183881 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:58.183881 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:58.183881 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:58.183881 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:58.183881 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:58.183881 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:58.184795 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:47:58.184795 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:47:58.184795 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:47:58.184795 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:47:58.184795 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:47:58.184795 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:47:58.184795 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:47:58.184795 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:47:58.189058 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 271/529] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:47:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:58.189926 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b0eece-2c51-4285-8ed4-dc85df62ae4c None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:58.194960 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:58.258471 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8ae3f-27b6-4c23-9bf4-5e3785a08264 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:58.297763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643216e-3989-4244-8b81-f7438305dc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:58.298505 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643216e-3989-4244-8b81-f7438305dc3b None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:58.298792 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643216e-3989-4244-8b81-f7438305dc3b None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:58.299072 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643216e-3989-4244-8b81-f7438305dc3b None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:58.300199 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2643216e-3989-4244-8b81-f7438305dc3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:58.300199 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2643216e-3989-4244-8b81-f7438305dc3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:58.301575 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2643216e-3989-4244-8b81-f7438305dc3b None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:58.313341 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b0eece-2c51-4285-8ed4-dc85df62ae4c None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:58.314090 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 259/530] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:58.314935 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643216e-3989-4244-8b81-f7438305dc3b None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:58.331798 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:58.360298 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415bc76c-7505-420a-9832-8ab03fb3897b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:58.362462 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bc76c-7505-420a-9832-8ab03fb3897b None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:58.362933 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bc76c-7505-420a-9832-8ab03fb3897b None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:58.364255 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bc76c-7505-420a-9832-8ab03fb3897b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:58.447498 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643216e-3989-4244-8b81-f7438305dc3b None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:58.450997 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415bc76c-7505-420a-9832-8ab03fb3897b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:58.452718 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415bc76c-7505-420a-9832-8ab03fb3897b None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:58.459047 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:58.485281 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a9d7a-4f28-41c0-a246-7c1ad066e151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:58.485963 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a9d7a-4f28-41c0-a246-7c1ad066e151 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:58.486250 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a9d7a-4f28-41c0-a246-7c1ad066e151 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:58.486528 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a9d7a-4f28-41c0-a246-7c1ad066e151 None admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:58.487493 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6a9d7a-4f28-41c0-a246-7c1ad066e151 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:58.487812 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6a9d7a-4f28-41c0-a246-7c1ad066e151 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:58.490191 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6a9d7a-4f28-41c0-a246-7c1ad066e151 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:58.512007 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 260/531] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 11 20:47:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:58.512799 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a9d7a-4f28-41c0-a246-7c1ad066e151 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:58.565465 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 272/532] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:47:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:47:58.566687 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415bc76c-7505-420a-9832-8ab03fb3897b None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:58.582928 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:58.621405 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a9d7a-4f28-41c0-a246-7c1ad066e151 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:58.673147 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21b20c-b82f-4548-b5f7-610b234f13d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:58.674433 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21b20c-b82f-4548-b5f7-610b234f13d8 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:58.675114 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21b20c-b82f-4548-b5f7-610b234f13d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:58.675542 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21b20c-b82f-4548-b5f7-610b234f13d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:58.683018 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415bc76c-7505-420a-9832-8ab03fb3897b None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:58.686625 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21b20c-b82f-4548-b5f7-610b234f13d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:58.688468 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21b20c-b82f-4548-b5f7-610b234f13d8 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:58.706224 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-ee21b20c-b82f-4548-b5f7-610b234f13d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:47:58.706224 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:58.706224 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:58.706224 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:58.706224 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:58.706224 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:58.706224 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:58.706224 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:58.706224 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:58.706224 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:58.706224 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:58.706224 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:58.706224 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:47:58.706224 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:47:58.706224 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:47:58.707253 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:47:58.707253 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:58.707253 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:58.707253 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:58.707253 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:58.707253 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:58.707253 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:58.707253 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:58.707253 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:58.707253 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:58.707253 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:58.707253 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:58.707253 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:58.707253 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:58.707253 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:58.707253 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:58.707253 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:58.708320 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:47:58.708320 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:47:58.708320 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:47:58.708320 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:47:58.708320 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:47:58.708320 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:47:58.708320 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:47:58.708320 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:47:58.711312 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 261/533] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:47:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:58.712678 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21b20c-b82f-4548-b5f7-610b234f13d8 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:58.728832 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae96167-2cbc-4da5-a166-9bf9ee80b9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:58.729600 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae96167-2cbc-4da5-a166-9bf9ee80b9a9 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:58.729963 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae96167-2cbc-4da5-a166-9bf9ee80b9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:58.730592 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae96167-2cbc-4da5-a166-9bf9ee80b9a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:58.731351 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae96167-2cbc-4da5-a166-9bf9ee80b9a9 None admin] RBAC: Adding query filter params (role.id=17bc727d82f24074aba8b1185cb99739, scope.project.id=eca3ef2561fa435e80ff451aeab14f3b, user.id=e4ae1169746141bc8993707b12cacd80) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:58.731745 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae96167-2cbc-4da5-a166-9bf9ee80b9a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:58.733307 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae96167-2cbc-4da5-a166-9bf9ee80b9a9 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:58.740241 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 273/534] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:47:58 2022] GET /identity/v3/role_assignments?user.id=e4ae1169746141bc8993707b12cacd80&scope.project.id=eca3ef2561fa435e80ff451aeab14f3b&role.id=17bc727d82f24074aba8b1185cb99739 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:58.741196 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae96167-2cbc-4da5-a166-9bf9ee80b9a9 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:58.763264 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:58.836532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:58.861299 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae96167-2cbc-4da5-a166-9bf9ee80b9a9 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:58.865955 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21b20c-b82f-4548-b5f7-610b234f13d8 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:58.904219 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1fdb1-adc5-4673-971f-03cc6654803b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:58.904834 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1fdb1-adc5-4673-971f-03cc6654803b None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:58.905128 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1fdb1-adc5-4673-971f-03cc6654803b None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:58.905409 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1fdb1-adc5-4673-971f-03cc6654803b None admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:58.906225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce1fdb1-adc5-4673-971f-03cc6654803b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:58.906546 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce1fdb1-adc5-4673-971f-03cc6654803b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:58.908060 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce1fdb1-adc5-4673-971f-03cc6654803b None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:58.928022 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1735ba89-d8ae-47c8-9e9e-d0297826261c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:58.928022 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735ba89-d8ae-47c8-9e9e-d0297826261c None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:58.928022 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735ba89-d8ae-47c8-9e9e-d0297826261c None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:58.928022 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735ba89-d8ae-47c8-9e9e-d0297826261c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:58.931633 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 274/535] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 11 20:47:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:58.936878 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1fdb1-adc5-4673-971f-03cc6654803b None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:58.950499 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1735ba89-d8ae-47c8-9e9e-d0297826261c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:58.952093 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1735ba89-d8ae-47c8-9e9e-d0297826261c None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:58.985534 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-1735ba89-d8ae-47c8-9e9e-d0297826261c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:47:58.985534 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:58.985534 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:58.985534 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:58.985534 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:58.985534 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:58.985534 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:58.985534 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:58.985534 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:58.985534 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:58.985534 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:58.985534 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:58.985534 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:47:58.985534 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:47:58.985534 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:47:58.986523 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:47:58.986523 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:58.986523 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:58.986523 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:58.986523 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:58.986523 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:58.986523 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:58.986523 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:58.986523 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:58.986523 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:58.986523 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:58.986523 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:58.986523 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:58.986523 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:58.986523 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:58.986523 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:58.986523 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:58.987366 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:47:58.987366 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:47:58.987366 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:47:58.987366 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:47:58.987366 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 262/536] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:47:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:58.994497 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1735ba89-d8ae-47c8-9e9e-d0297826261c None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:59.085261 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1fdb1-adc5-4673-971f-03cc6654803b None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:59.092315 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:59.113112 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1735ba89-d8ae-47c8-9e9e-d0297826261c None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:59.141814 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8828fae-aef6-4584-bdfa-061c32b539af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:59.142502 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8828fae-aef6-4584-bdfa-061c32b539af None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:59.142771 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8828fae-aef6-4584-bdfa-061c32b539af None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:59.143079 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8828fae-aef6-4584-bdfa-061c32b539af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:59.147294 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8828fae-aef6-4584-bdfa-061c32b539af None admin] RBAC: Adding query filter params (role.id=17bc727d82f24074aba8b1185cb99739, scope.project.id=eca3ef2561fa435e80ff451aeab14f3b, user.id=da488c75631e4e5992304ff6c0579aab) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:59.147294 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8828fae-aef6-4584-bdfa-061c32b539af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:59.147294 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8828fae-aef6-4584-bdfa-061c32b539af None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:59.156142 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 275/537] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:47:58 2022] GET /identity/v3/role_assignments?user.id=da488c75631e4e5992304ff6c0579aab&scope.project.id=eca3ef2561fa435e80ff451aeab14f3b&role.id=17bc727d82f24074aba8b1185cb99739 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:59.164185 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b458a-7d6e-44b5-ba9b-01fefe028c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:59.164888 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b458a-7d6e-44b5-ba9b-01fefe028c71 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:59.165866 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b458a-7d6e-44b5-ba9b-01fefe028c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:59.166295 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b458a-7d6e-44b5-ba9b-01fefe028c71 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:59.167074 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b458a-7d6e-44b5-ba9b-01fefe028c71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:59.167395 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b458a-7d6e-44b5-ba9b-01fefe028c71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:59.168858 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b458a-7d6e-44b5-ba9b-01fefe028c71 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:59.186494 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 263/538] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:47:59.191825 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8828fae-aef6-4584-bdfa-061c32b539af None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:59.195940 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:59.371031 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8828fae-aef6-4584-bdfa-061c32b539af None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:59.413540 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906c28a-290a-47e8-90f6-dd966a82a996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:59.414276 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906c28a-290a-47e8-90f6-dd966a82a996 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:59.414564 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906c28a-290a-47e8-90f6-dd966a82a996 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:59.414845 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906c28a-290a-47e8-90f6-dd966a82a996 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:59.423624 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906c28a-290a-47e8-90f6-dd966a82a996 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:59.425124 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906c28a-290a-47e8-90f6-dd966a82a996 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:59.435086 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51270c61-1c11-46ca-bab8-26d7935deed7 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:59.435387 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51270c61-1c11-46ca-bab8-26d7935deed7 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:59.435673 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51270c61-1c11-46ca-bab8-26d7935deed7 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:59.437374 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 264/539] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:47:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:47:59.442324 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d197572-37c0-42a3-8d3a-c15cb596b7f4 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:59.442618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d197572-37c0-42a3-8d3a-c15cb596b7f4 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:59.442902 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d197572-37c0-42a3-8d3a-c15cb596b7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:59.443300 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-f906c28a-290a-47e8-90f6-dd966a82a996 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:47:59.443300 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:59.443300 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:59.443300 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:59.443300 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:59.443300 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:59.443300 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:59.443300 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:59.443300 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:59.443300 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:59.443300 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:59.443300 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:59.443300 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:47:59.443300 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:47:59.443300 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:47:59.444129 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:47:59.444129 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:59.444129 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:59.444129 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:59.444129 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:59.444129 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:59.444129 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:59.444129 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:59.444129 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:59.444129 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:59.444129 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:59.444129 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:59.444129 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:59.444129 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:59.444129 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:59.444129 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:59.444129 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:59.444973 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:47:59.444973 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:47:59.444973 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:47:59.444973 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:47:59.444973 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:47:59.444973 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:47:59.444973 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:47:59.444973 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:47:59.447890 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 276/540] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:47:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:47:59.454203 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906c28a-290a-47e8-90f6-dd966a82a996 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:59.461205 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-6d197572-37c0-42a3-8d3a-c15cb596b7f4 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:47:59.462966 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-6d197572-37c0-42a3-8d3a-c15cb596b7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:47:59.539654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:59.544185 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 265/541] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:47:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:47:59.570815 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d197572-37c0-42a3-8d3a-c15cb596b7f4 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:59.628640 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906c28a-290a-47e8-90f6-dd966a82a996 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:59.660474 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:59.695818 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d197572-37c0-42a3-8d3a-c15cb596b7f4 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:59.725782 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b362ffbb-aecf-43c4-b2b0-6fa74d8b217f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:59.726558 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362ffbb-aecf-43c4-b2b0-6fa74d8b217f None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:59.726855 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362ffbb-aecf-43c4-b2b0-6fa74d8b217f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:59.727136 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362ffbb-aecf-43c4-b2b0-6fa74d8b217f None admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:59.728001 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b362ffbb-aecf-43c4-b2b0-6fa74d8b217f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:59.728504 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b362ffbb-aecf-43c4-b2b0-6fa74d8b217f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:59.730087 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b362ffbb-aecf-43c4-b2b0-6fa74d8b217f None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:59.743998 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ead5f-2125-4143-b080-3962a53cfe99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:59.744843 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ead5f-2125-4143-b080-3962a53cfe99 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:59.745127 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ead5f-2125-4143-b080-3962a53cfe99 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:59.745408 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ead5f-2125-4143-b080-3962a53cfe99 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:59.758488 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 277/542] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 11 20:47:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:47:59.764585 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b362ffbb-aecf-43c4-b2b0-6fa74d8b217f None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:59.765373 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ead5f-2125-4143-b080-3962a53cfe99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:47:59.777934 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-257ead5f-2125-4143-b080-3962a53cfe99 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:47:59.777934 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:47:59.777934 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:47:59.777934 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:47:59.777934 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:47:59.777934 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:47:59.777934 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:47:59.777934 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:47:59.777934 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:47:59.777934 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:47:59.777934 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:47:59.777934 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:47:59.777934 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:47:59.777934 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:47:59.777934 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:47:59.777934 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:47:59.778838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:47:59.778838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:47:59.778838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:47:59.778838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:47:59.778838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:47:59.778838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:47:59.778838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:47:59.778838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:47:59.778838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:47:59.778838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:47:59.778838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:47:59.778838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:47:59.778838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:47:59.778838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:47:59.778838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:47:59.778838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:47:59.779631 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:47:59.779631 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:47:59.779631 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:47:59.779631 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:47:59.779631 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:47:59.779631 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:47:59.779631 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:47:59.779631 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:47:59.779631 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:47:59.779631 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:47:59.779631 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:47:59.779631 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:47:59.784973 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 266/543] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 11 20:47:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:47:59.797783 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ead5f-2125-4143-b080-3962a53cfe99 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:47:59.885887 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b362ffbb-aecf-43c4-b2b0-6fa74d8b217f None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:47:59.913455 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:47:59.929899 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d071a-e439-42d5-b2ad-9564e488e09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:47:59.930503 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d071a-e439-42d5-b2ad-9564e488e09d None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:47:59.931316 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d071a-e439-42d5-b2ad-9564e488e09d None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:47:59.931599 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d071a-e439-42d5-b2ad-9564e488e09d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:47:59.932455 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637d071a-e439-42d5-b2ad-9564e488e09d None admin] RBAC: Adding query filter params (role.id=17bc727d82f24074aba8b1185cb99739, scope.project.id=eca3ef2561fa435e80ff451aeab14f3b, user.id=29046b079f1a4f4ea2244e69cbbaa805) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:47:59.932774 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637d071a-e439-42d5-b2ad-9564e488e09d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:47:59.934275 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637d071a-e439-42d5-b2ad-9564e488e09d None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:47:59.940354 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 278/544] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:47:59 2022] GET /identity/v3/role_assignments?user.id=29046b079f1a4f4ea2244e69cbbaa805&scope.project.id=eca3ef2561fa435e80ff451aeab14f3b&role.id=17bc727d82f24074aba8b1185cb99739 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:00.039289 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ead5f-2125-4143-b080-3962a53cfe99 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:00.082252 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:00.089238 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39ce4f-3b96-4203-9235-796ae5155b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:00.089936 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39ce4f-3b96-4203-9235-796ae5155b75 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:00.090226 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39ce4f-3b96-4203-9235-796ae5155b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:00.090510 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39ce4f-3b96-4203-9235-796ae5155b75 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:00.093868 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b39ce4f-3b96-4203-9235-796ae5155b75 None admin] RBAC: Adding query filter params (name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:00.093868 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b39ce4f-3b96-4203-9235-796ae5155b75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:00.093868 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b39ce4f-3b96-4203-9235-796ae5155b75 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:00.109622 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 267/545] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jul 11 20:47:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:00.114856 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d071a-e439-42d5-b2ad-9564e488e09d None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:00.248277 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d071a-e439-42d5-b2ad-9564e488e09d None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:00.276680 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787b304-8237-475c-9a95-b4f1d2dc5d02 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:00.276982 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787b304-8237-475c-9a95-b4f1d2dc5d02 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:00.277259 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787b304-8237-475c-9a95-b4f1d2dc5d02 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:00.278918 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 268/546] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:48:00.283686 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850bd3c-ad32-4c40-ad28-2677c65e3143 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:00.284003 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850bd3c-ad32-4c40-ad28-2677c65e3143 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:00.284315 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850bd3c-ad32-4c40-ad28-2677c65e3143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:00.309883 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-f850bd3c-ad32-4c40-ad28-2677c65e3143 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:00.312396 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-f850bd3c-ad32-4c40-ad28-2677c65e3143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:00.314119 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05543ccc-986b-410e-85f1-8a4701a7a3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:00.315158 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05543ccc-986b-410e-85f1-8a4701a7a3fe None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:00.315596 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05543ccc-986b-410e-85f1-8a4701a7a3fe None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:00.316040 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05543ccc-986b-410e-85f1-8a4701a7a3fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:00.338271 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05543ccc-986b-410e-85f1-8a4701a7a3fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:00.340188 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05543ccc-986b-410e-85f1-8a4701a7a3fe None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:00.370411 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-05543ccc-986b-410e-85f1-8a4701a7a3fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:00.370411 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:00.370411 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:00.370411 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:00.370411 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:00.370411 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:00.370411 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:00.370411 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:00.370411 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:00.370411 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:00.370411 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:00.370411 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:00.370411 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:00.370411 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:00.370411 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:00.371496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:00.371496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:00.371496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:00.371496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:00.371496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:00.371496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:00.371496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:00.371496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:00.371496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:00.371496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:00.371496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:00.371496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:00.371496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:00.371496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:00.371496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:00.371496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:00.371496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:00.372647 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:00.372647 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:00.372647 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:00.372647 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:00.382661 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 279/547] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:00.389035 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05543ccc-986b-410e-85f1-8a4701a7a3fe None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:00.447396 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 269/548] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:48:00.452077 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:00.483493 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f850bd3c-ad32-4c40-ad28-2677c65e3143 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:00.515031 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05543ccc-986b-410e-85f1-8a4701a7a3fe None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:00.566340 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead8baa-bd76-4eac-bfc7-6d8f0e55a3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:00.567938 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead8baa-bd76-4eac-bfc7-6d8f0e55a3d2 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:00.568561 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead8baa-bd76-4eac-bfc7-6d8f0e55a3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:00.570662 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead8baa-bd76-4eac-bfc7-6d8f0e55a3d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:00.571825 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead8baa-bd76-4eac-bfc7-6d8f0e55a3d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:00.572506 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead8baa-bd76-4eac-bfc7-6d8f0e55a3d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:00.574703 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead8baa-bd76-4eac-bfc7-6d8f0e55a3d2 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:00.593890 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 280/549] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:00.603785 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead8baa-bd76-4eac-bfc7-6d8f0e55a3d2 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:00.668011 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f850bd3c-ad32-4c40-ad28-2677c65e3143 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:00.711022 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:00.734358 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039c20f-bfde-4144-a588-4bf5db5e9cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:00.735167 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039c20f-bfde-4144-a588-4bf5db5e9cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:00.735452 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039c20f-bfde-4144-a588-4bf5db5e9cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:00.735732 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039c20f-bfde-4144-a588-4bf5db5e9cd7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:00.761534 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2039c20f-bfde-4144-a588-4bf5db5e9cd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:48:00.769457 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-2039c20f-bfde-4144-a588-4bf5db5e9cd7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:48:00.769457 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:00.769457 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:00.769457 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:00.769457 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:00.769457 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:00.769457 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:00.769457 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:00.769457 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:00.769457 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:00.769457 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:00.769457 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:00.769457 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:48:00.769457 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:48:00.769457 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:48:00.769457 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:48:00.770487 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:48:00.770487 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:48:00.770487 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:48:00.770487 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:48:00.770487 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:00.770487 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:00.770487 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:00.770487 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:00.770487 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:00.770487 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:00.770487 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:00.770487 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:00.770487 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:00.770487 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:00.770487 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:00.770487 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:00.771277 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:00.771277 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:00.771277 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:00.771277 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:00.771277 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:48:00.771277 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:48:00.771277 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:48:00.771277 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:48:00.771277 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:48:00.771277 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:48:00.771277 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:48:00.771277 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:00.774068 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 270/550] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 11 20:48:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:48:00.780074 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039c20f-bfde-4144-a588-4bf5db5e9cd7 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:00.786460 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:00.794700 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead8baa-bd76-4eac-bfc7-6d8f0e55a3d2 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:00.831758 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855037f-ac50-4dea-86c2-fa1da3c688f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:00.832933 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855037f-ac50-4dea-86c2-fa1da3c688f5 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:00.833453 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855037f-ac50-4dea-86c2-fa1da3c688f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:00.833990 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855037f-ac50-4dea-86c2-fa1da3c688f5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:00.841973 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855037f-ac50-4dea-86c2-fa1da3c688f5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:00.843663 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855037f-ac50-4dea-86c2-fa1da3c688f5 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:00.860951 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-e855037f-ac50-4dea-86c2-fa1da3c688f5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 20:48:00.860951 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:00.860951 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:00.860951 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:00.860951 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:00.860951 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:00.860951 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:00.860951 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:00.860951 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:00.860951 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:00.860951 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:00.860951 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:00.860951 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:48:00.860951 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:48:00.860951 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:48:00.860951 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:48:00.862111 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:00.862111 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:00.862111 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:48:00.862111 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:00.862111 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:48:00.862111 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:00.862111 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:00.862111 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:00.862111 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:00.862111 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:00.862111 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:00.862111 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:00.862111 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:00.862111 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:00.862111 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:00.862111 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:00.862111 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:00.862111 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:00.863013 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:00.863013 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:00.863013 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:48:00.863013 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:48:00.863013 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:48:00.863013 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:48:00.863013 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:48:00.863013 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:48:00.863013 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 20:48:00.863013 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:00.865762 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 281/551] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 11 20:48:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:48:00.871430 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855037f-ac50-4dea-86c2-fa1da3c688f5 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:00.962344 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039c20f-bfde-4144-a588-4bf5db5e9cd7 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:01.029732 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c64928-f715-4891-849e-5e1908eabf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:01.030768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c64928-f715-4891-849e-5e1908eabf93 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:01.031266 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c64928-f715-4891-849e-5e1908eabf93 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:01.031734 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c64928-f715-4891-849e-5e1908eabf93 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:01.032701 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c64928-f715-4891-849e-5e1908eabf93 None admin] RBAC: Adding query filter params (name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:01.033209 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c64928-f715-4891-849e-5e1908eabf93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:01.034792 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c64928-f715-4891-849e-5e1908eabf93 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:01.055264 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 271/552] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jul 11 20:48:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:01.062470 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c64928-f715-4891-849e-5e1908eabf93 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:01.073271 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855037f-ac50-4dea-86c2-fa1da3c688f5 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:01.119644 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717d095-ebd2-4d87-bd03-35e7dd54fa88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:01.120372 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717d095-ebd2-4d87-bd03-35e7dd54fa88 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:01.120658 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717d095-ebd2-4d87-bd03-35e7dd54fa88 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:01.121015 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717d095-ebd2-4d87-bd03-35e7dd54fa88 None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:01.121788 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0717d095-ebd2-4d87-bd03-35e7dd54fa88 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:01.122104 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0717d095-ebd2-4d87-bd03-35e7dd54fa88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:01.123558 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0717d095-ebd2-4d87-bd03-35e7dd54fa88 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:01.143086 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 282/553] 10.222.0.40 () {56 vars in 1135 bytes} [Mon Jul 11 20:48:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:01.147614 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:01.148452 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717d095-ebd2-4d87-bd03-35e7dd54fa88 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:01.172180 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:01.251472 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c64928-f715-4891-849e-5e1908eabf93 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:01.302930 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717d095-ebd2-4d87-bd03-35e7dd54fa88 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:01.315889 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63e434-379a-4770-a7b7-4364bfec2985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:01.316744 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63e434-379a-4770-a7b7-4364bfec2985 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:01.317031 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63e434-379a-4770-a7b7-4364bfec2985 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:01.317308 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63e434-379a-4770-a7b7-4364bfec2985 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:01.334564 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c63e434-379a-4770-a7b7-4364bfec2985 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:01.337931 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c63e434-379a-4770-a7b7-4364bfec2985 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:01.370377 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82760fb3-3503-49ba-b714-91568e3e5ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:01.371380 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82760fb3-3503-49ba-b714-91568e3e5ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:01.371863 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82760fb3-3503-49ba-b714-91568e3e5ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:01.372381 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82760fb3-3503-49ba-b714-91568e3e5ee4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:01.388859 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-3c63e434-379a-4770-a7b7-4364bfec2985 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:01.388859 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:01.388859 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:01.388859 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:01.388859 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:01.388859 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:01.388859 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:01.388859 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:01.388859 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:01.388859 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:01.388859 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:01.388859 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:01.388859 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:01.388859 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:01.388859 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:01.389756 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:01.389756 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:01.389756 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:01.389756 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:01.389756 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:01.389756 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:01.389756 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:01.389756 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:01.389756 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:01.389756 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:01.389756 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:01.389756 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:01.389756 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:01.389756 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:01.389756 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:01.389756 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:01.389756 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:01.391237 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:01.391237 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:01.391237 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:01.391237 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:01.391237 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 272/554] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:01.400443 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63e434-379a-4770-a7b7-4364bfec2985 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:01.484197 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82760fb3-3503-49ba-b714-91568e3e5ee4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:01.486542 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82760fb3-3503-49ba-b714-91568e3e5ee4 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:01.513939 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:01.529208 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:01.532987 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63e434-379a-4770-a7b7-4364bfec2985 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:01.569902 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfc1f6-5b79-4149-ad94-626a7150e445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:01.570467 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfc1f6-5b79-4149-ad94-626a7150e445 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:01.570757 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfc1f6-5b79-4149-ad94-626a7150e445 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:01.571038 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfc1f6-5b79-4149-ad94-626a7150e445 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:01.571894 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dfc1f6-5b79-4149-ad94-626a7150e445 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:01.572239 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dfc1f6-5b79-4149-ad94-626a7150e445 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:01.573600 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dfc1f6-5b79-4149-ad94-626a7150e445 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:01.586118 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 273/555] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:01.587890 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63cdbe-ee82-4583-a31a-8fb702c6b21e None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:01.588282 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63cdbe-ee82-4583-a31a-8fb702c6b21e None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:01.588797 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63cdbe-ee82-4583-a31a-8fb702c6b21e None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:01.591673 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 274/556] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:01.591673 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ae568-b677-4dfb-94d4-bc267226a875 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:01.591866 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ae568-b677-4dfb-94d4-bc267226a875 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:01.592139 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ae568-b677-4dfb-94d4-bc267226a875 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:01.593592 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 275/557] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:01.594512 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ae568-b677-4dfb-94d4-bc267226a875 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:01.618905 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 283/558] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:48:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:48:01.620307 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c0c1d-4a72-46c6-a5d8-6b4216b3bc8e None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:01.620588 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c0c1d-4a72-46c6-a5d8-6b4216b3bc8e None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:01.620869 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c0c1d-4a72-46c6-a5d8-6b4216b3bc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:01.637396 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-a57c0c1d-4a72-46c6-a5d8-6b4216b3bc8e None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:01.638580 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a57c0c1d-4a72-46c6-a5d8-6b4216b3bc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:01.709363 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ae568-b677-4dfb-94d4-bc267226a875 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:01.711883 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 284/559] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:48:01.713181 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3777d6-cc49-42cc-8d75-427ced706440 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:01.713478 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3777d6-cc49-42cc-8d75-427ced706440 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:01.713762 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3777d6-cc49-42cc-8d75-427ced706440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:01.732877 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-3e3777d6-cc49-42cc-8d75-427ced706440 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:01.734066 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-3e3777d6-cc49-42cc-8d75-427ced706440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:01.756137 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52543c27-5cd2-4c78-9a1f-b32300c60dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:01.757323 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52543c27-5cd2-4c78-9a1f-b32300c60dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:01.757911 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52543c27-5cd2-4c78-9a1f-b32300c60dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:01.758361 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52543c27-5cd2-4c78-9a1f-b32300c60dc4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:01.766642 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52543c27-5cd2-4c78-9a1f-b32300c60dc4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:01.768307 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52543c27-5cd2-4c78-9a1f-b32300c60dc4 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:01.778164 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:01.784692 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-52543c27-5cd2-4c78-9a1f-b32300c60dc4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 20:48:01.784692 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:01.784692 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:01.784692 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:01.784692 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:01.784692 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:01.784692 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:01.784692 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:01.784692 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:01.784692 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:01.784692 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:01.784692 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:01.784692 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:48:01.784692 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:48:01.784692 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:48:01.784692 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:48:01.785618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:01.785618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:01.785618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:48:01.785618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:01.785618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:48:01.785618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:01.785618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:01.785618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:01.785618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:01.785618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:01.785618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:01.785618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:01.785618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:01.785618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:01.785618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:01.785618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:01.785618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:01.785618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:01.786552 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:01.786552 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:01.786552 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:48:01.786552 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:48:01.786552 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:48:01.786552 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:48:01.786552 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:48:01.786552 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:48:01.786552 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 20:48:01.786552 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:01.788788 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 276/560] 10.222.0.40 () {56 vars in 1093 bytes} [Mon Jul 11 20:48:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:01.789555 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52543c27-5cd2-4c78-9a1f-b32300c60dc4 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:01.811397 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:01.814047 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 285/561] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:48:01.814920 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3777d6-cc49-42cc-8d75-427ced706440 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:01.904906 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52543c27-5cd2-4c78-9a1f-b32300c60dc4 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:01.925058 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3777d6-cc49-42cc-8d75-427ced706440 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:01.941072 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09dbfb-2ad4-4779-9c61-5b55959817f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:01.941935 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09dbfb-2ad4-4779-9c61-5b55959817f1 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:01.942220 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09dbfb-2ad4-4779-9c61-5b55959817f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:01.942501 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09dbfb-2ad4-4779-9c61-5b55959817f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:01.954493 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09dbfb-2ad4-4779-9c61-5b55959817f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:01.956892 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09dbfb-2ad4-4779-9c61-5b55959817f1 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:01.963322 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2698d83-161f-4704-8d55-6ba3f3996ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:01.967714 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2698d83-161f-4704-8d55-6ba3f3996ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:01.967714 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2698d83-161f-4704-8d55-6ba3f3996ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:01.967714 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2698d83-161f-4704-8d55-6ba3f3996ba1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:01.975133 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-bf09dbfb-2ad4-4779-9c61-5b55959817f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:01.975133 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:01.975133 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:01.975133 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:01.975133 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:01.975133 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:01.975133 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:01.975133 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:01.975133 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:01.975133 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:01.975133 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:01.975133 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:01.975133 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:01.975133 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:01.975133 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:01.976045 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:01.976045 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:01.976045 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:01.976045 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:01.976045 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:01.976045 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:01.976045 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:01.976045 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:01.976045 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:01.976045 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:01.976045 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:01.976045 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:01.976045 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:01.976045 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:01.976045 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:01.976045 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:01.976045 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:01.976926 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:01.976926 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:01.976926 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:01.976926 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:01.977156 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2698d83-161f-4704-8d55-6ba3f3996ba1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:48:01.977225 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 277/562] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:01.981726 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09dbfb-2ad4-4779-9c61-5b55959817f1 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:01.983851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-a2698d83-161f-4704-8d55-6ba3f3996ba1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:48:01.983851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:01.983851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:01.983851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:01.983851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:01.983851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:01.983851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:01.983851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:01.983851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:01.983851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:01.983851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:01.983851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:01.983851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:48:01.983851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:48:01.983851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:48:01.983851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:48:01.984805 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:48:01.984805 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:48:01.984805 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:48:01.984805 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:48:01.984805 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:01.984805 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:01.984805 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:01.984805 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:01.984805 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:01.984805 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:01.984805 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:01.984805 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:01.984805 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:01.984805 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:01.984805 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:01.984805 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:01.985736 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:01.985736 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:01.985736 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:01.985736 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:01.985736 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:48:01.985736 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:48:01.985736 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:48:01.985736 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:48:01.985736 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:48:01.985736 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:48:01.985736 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:48:01.985736 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:01.985736 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 286/563] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 11 20:48:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:01.988114 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2698d83-161f-4704-8d55-6ba3f3996ba1 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:02.026416 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:02.068245 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:02.093263 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2698d83-161f-4704-8d55-6ba3f3996ba1 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:02.101011 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09dbfb-2ad4-4779-9c61-5b55959817f1 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:02.128990 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed225ecb-a040-4713-be93-f16737ad80ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:02.129790 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed225ecb-a040-4713-be93-f16737ad80ff None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:02.130075 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed225ecb-a040-4713-be93-f16737ad80ff None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:02.130353 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed225ecb-a040-4713-be93-f16737ad80ff None admin] PATH_INFO: `/v3/roles/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:02.138829 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff96494-04f8-41d8-84ad-baf3ff7ac5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:02.139512 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff96494-04f8-41d8-84ad-baf3ff7ac5d5 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:02.139801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff96494-04f8-41d8-84ad-baf3ff7ac5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:02.140112 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff96494-04f8-41d8-84ad-baf3ff7ac5d5 None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:02.140950 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff96494-04f8-41d8-84ad-baf3ff7ac5d5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:02.141241 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed225ecb-a040-4713-be93-f16737ad80ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:48:02.141342 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff96494-04f8-41d8-84ad-baf3ff7ac5d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:02.142662 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff96494-04f8-41d8-84ad-baf3ff7ac5d5 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:02.148880 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-ed225ecb-a040-4713-be93-f16737ad80ff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:48:02.148880 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:02.148880 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:02.148880 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:02.148880 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:02.148880 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:02.148880 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:02.148880 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:02.148880 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:02.148880 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:02.148880 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:02.148880 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:02.148880 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:48:02.148880 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:48:02.148880 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:48:02.148880 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:48:02.150002 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:48:02.150002 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:48:02.150002 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:48:02.150002 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:48:02.150002 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:02.150002 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:02.150002 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:02.150002 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:02.150002 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:02.150002 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:02.150002 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:02.150002 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:02.150002 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:02.150002 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:02.150002 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:02.150002 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:02.150996 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:02.150996 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:02.150996 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:02.150996 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:02.150996 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:48:02.150996 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:48:02.150996 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:48:02.150996 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:48:02.150996 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:48:02.150996 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:48:02.150996 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:48:02.150996 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:02.155130 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 287/564] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 11 20:48:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:02.155911 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed225ecb-a040-4713-be93-f16737ad80ff None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:02.163751 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 278/565] 10.222.0.40 () {56 vars in 1133 bytes} [Mon Jul 11 20:48:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:02.169333 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff96494-04f8-41d8-84ad-baf3ff7ac5d5 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:02.252772 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:02.259367 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed225ecb-a040-4713-be93-f16737ad80ff None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:02.272271 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff96494-04f8-41d8-84ad-baf3ff7ac5d5 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:02.294995 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83dbbf-4c33-4011-93b5-f0cb83494c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:02.295668 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83dbbf-4c33-4011-93b5-f0cb83494c74 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:02.295953 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83dbbf-4c33-4011-93b5-f0cb83494c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:02.296258 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83dbbf-4c33-4011-93b5-f0cb83494c74 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:02.297002 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d83dbbf-4c33-4011-93b5-f0cb83494c74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:02.297315 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d83dbbf-4c33-4011-93b5-f0cb83494c74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:02.298700 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d83dbbf-4c33-4011-93b5-f0cb83494c74 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:02.310194 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 288/566] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:02.311048 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83dbbf-4c33-4011-93b5-f0cb83494c74 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:02.334988 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:02.343660 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b141381-9821-4a31-8e98-95f72b253e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:02.344428 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b141381-9821-4a31-8e98-95f72b253e74 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:02.344717 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b141381-9821-4a31-8e98-95f72b253e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:02.345003 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b141381-9821-4a31-8e98-95f72b253e74 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:02.348070 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b141381-9821-4a31-8e98-95f72b253e74 None admin] RBAC: Adding query filter params (name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:02.348070 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b141381-9821-4a31-8e98-95f72b253e74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:02.348070 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b141381-9821-4a31-8e98-95f72b253e74 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:02.355727 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 279/567] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jul 11 20:48:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:02.356403 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b141381-9821-4a31-8e98-95f72b253e74 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:02.416344 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83dbbf-4c33-4011-93b5-f0cb83494c74 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:02.449763 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911a59a-3494-4213-8e28-0aa0ee436396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:02.450442 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911a59a-3494-4213-8e28-0aa0ee436396 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:02.450735 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911a59a-3494-4213-8e28-0aa0ee436396 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:02.451023 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911a59a-3494-4213-8e28-0aa0ee436396 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:02.451776 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1911a59a-3494-4213-8e28-0aa0ee436396 None admin] RBAC: Adding query filter params (name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:02.452124 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1911a59a-3494-4213-8e28-0aa0ee436396 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:02.453504 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1911a59a-3494-4213-8e28-0aa0ee436396 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:02.454744 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b141381-9821-4a31-8e98-95f72b253e74 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:02.466601 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 289/568] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jul 11 20:48:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:02.466601 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2f129-45d9-4e74-879e-3fa5d4fca31a None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:02.466601 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2f129-45d9-4e74-879e-3fa5d4fca31a None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:02.466601 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2f129-45d9-4e74-879e-3fa5d4fca31a None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:02.466601 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 290/569] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:02.466601 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2f129-45d9-4e74-879e-3fa5d4fca31a None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:02.485312 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:02.490708 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8887dc-7113-439c-a65a-7725589d828c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:02.491458 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8887dc-7113-439c-a65a-7725589d828c None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:02.491752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8887dc-7113-439c-a65a-7725589d828c None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:02.492053 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8887dc-7113-439c-a65a-7725589d828c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:02.502879 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8887dc-7113-439c-a65a-7725589d828c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:02.504332 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8887dc-7113-439c-a65a-7725589d828c None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:02.521343 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-4b8887dc-7113-439c-a65a-7725589d828c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:02.521343 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:02.521343 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:02.521343 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:02.521343 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:02.521343 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:02.521343 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:02.521343 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:02.521343 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:02.521343 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:02.521343 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:02.521343 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:02.521343 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:02.521343 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:02.521343 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:02.522210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:02.522210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:02.522210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:02.522210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:02.522210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:02.522210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:02.522210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:02.522210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:02.522210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:02.522210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:02.522210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:02.522210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:02.522210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:02.522210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:02.522210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:02.522210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:02.522210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:02.523360 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:02.523360 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:02.523360 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:02.523360 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:02.523360 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 280/570] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:02.523360 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8887dc-7113-439c-a65a-7725589d828c None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:02.566828 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:02.569632 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2f129-45d9-4e74-879e-3fa5d4fca31a None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:02.604213 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea318a-37ac-4e71-b6ef-71b448302759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:02.605008 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea318a-37ac-4e71-b6ef-71b448302759 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:02.605295 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea318a-37ac-4e71-b6ef-71b448302759 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:02.605570 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea318a-37ac-4e71-b6ef-71b448302759 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:02.612286 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea318a-37ac-4e71-b6ef-71b448302759 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:02.613725 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea318a-37ac-4e71-b6ef-71b448302759 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:02.624403 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8887dc-7113-439c-a65a-7725589d828c None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:02.627773 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-a6ea318a-37ac-4e71-b6ef-71b448302759 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:02.627773 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:02.627773 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:02.627773 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:02.627773 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:02.627773 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:02.627773 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:02.627773 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:02.627773 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:02.627773 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:02.627773 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:02.627773 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:02.627773 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:48:02.627773 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:48:02.627773 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:48:02.628715 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:48:02.628715 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:02.628715 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:02.628715 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:02.628715 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:02.628715 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:02.628715 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:02.628715 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:02.628715 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:02.628715 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:02.628715 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:02.628715 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:02.628715 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:02.628715 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:02.628715 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:02.628715 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:02.628715 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:02.629637 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:48:02.629637 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:48:02.629637 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:48:02.629637 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:48:02.629637 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:48:02.629637 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:48:02.629637 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:02.629637 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:02.629637 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 291/571] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:48:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:02.630116 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea318a-37ac-4e71-b6ef-71b448302759 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:02.658837 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb20f0-0a5e-40a2-9f31-f585e519cc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:02.659643 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb20f0-0a5e-40a2-9f31-f585e519cc5a None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:02.659932 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb20f0-0a5e-40a2-9f31-f585e519cc5a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:02.660281 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb20f0-0a5e-40a2-9f31-f585e519cc5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:02.673883 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb20f0-0a5e-40a2-9f31-f585e519cc5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:02.675247 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb20f0-0a5e-40a2-9f31-f585e519cc5a None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:02.692664 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-dbcb20f0-0a5e-40a2-9f31-f585e519cc5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:02.692664 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:02.692664 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:02.692664 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:02.692664 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:02.692664 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:02.692664 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:02.692664 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:02.692664 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:02.692664 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:02.692664 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:02.692664 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:02.692664 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:02.692664 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:02.692664 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:02.693752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:02.693752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:02.693752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:02.693752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:02.693752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:02.693752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:02.693752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:02.693752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:02.693752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:02.693752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:02.693752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:02.693752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:02.693752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:02.693752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:02.693752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:02.693752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:02.693752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:02.694634 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:02.694634 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:02.694634 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:02.694634 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:02.694634 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 281/572] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:02.695184 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975502d-0334-4e46-a2db-2eef4ddf7da0 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:02.695286 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975502d-0334-4e46-a2db-2eef4ddf7da0 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:02.695555 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975502d-0334-4e46-a2db-2eef4ddf7da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:02.712084 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-6975502d-0334-4e46-a2db-2eef4ddf7da0 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:02.713345 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-6975502d-0334-4e46-a2db-2eef4ddf7da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:02.716324 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:02.736723 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea318a-37ac-4e71-b6ef-71b448302759 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:02.770480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa526b53-63f2-45f4-a44c-e0a0858d4863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:02.771353 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa526b53-63f2-45f4-a44c-e0a0858d4863 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:02.771647 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa526b53-63f2-45f4-a44c-e0a0858d4863 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:02.771929 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa526b53-63f2-45f4-a44c-e0a0858d4863 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:02.781521 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 282/573] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:48:02.783463 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975502d-0334-4e46-a2db-2eef4ddf7da0 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:02.783597 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa526b53-63f2-45f4-a44c-e0a0858d4863 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:02.784957 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa526b53-63f2-45f4-a44c-e0a0858d4863 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:02.802055 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-fa526b53-63f2-45f4-a44c-e0a0858d4863 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:02.802055 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:02.802055 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:02.802055 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:02.802055 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:02.802055 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:02.802055 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:02.802055 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:02.802055 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:02.802055 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:02.802055 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:02.802055 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:02.802055 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:02.802055 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:02.802055 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:02.802972 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:02.802972 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:02.802972 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:02.802972 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:02.802972 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:02.802972 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:02.802972 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:02.802972 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:02.802972 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:02.802972 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:02.802972 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:02.802972 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:02.802972 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:02.802972 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:02.802972 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:02.802972 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:02.802972 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:02.803885 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:02.803885 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:02.803885 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:02.803885 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:02.803885 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 292/574] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:02.804623 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa526b53-63f2-45f4-a44c-e0a0858d4863 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:02.814478 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:02.889797 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975502d-0334-4e46-a2db-2eef4ddf7da0 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:02.906796 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa526b53-63f2-45f4-a44c-e0a0858d4863 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:02.924620 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ca7d8-6892-489f-ab0a-39f52a822653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:02.925231 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ca7d8-6892-489f-ab0a-39f52a822653 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:02.925574 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ca7d8-6892-489f-ab0a-39f52a822653 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:02.925859 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ca7d8-6892-489f-ab0a-39f52a822653 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:02.926584 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ca7d8-6892-489f-ab0a-39f52a822653 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:02.926896 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ca7d8-6892-489f-ab0a-39f52a822653 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:02.928277 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ca7d8-6892-489f-ab0a-39f52a822653 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:02.934548 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:02.944224 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 283/575] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:02.944381 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a7b90-75b6-4976-af43-3cee1c8fb0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:02.945567 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ca7d8-6892-489f-ab0a-39f52a822653 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:02.945686 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a7b90-75b6-4976-af43-3cee1c8fb0e5 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:02.945686 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a7b90-75b6-4976-af43-3cee1c8fb0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:02.945686 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a7b90-75b6-4976-af43-3cee1c8fb0e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:02.945686 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a7b90-75b6-4976-af43-3cee1c8fb0e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:02.945686 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a7b90-75b6-4976-af43-3cee1c8fb0e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:02.945686 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a7b90-75b6-4976-af43-3cee1c8fb0e5 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:02.956054 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 293/576] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 11 20:48:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:02.956850 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a7b90-75b6-4976-af43-3cee1c8fb0e5 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:03.032087 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:03.047335 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ca7d8-6892-489f-ab0a-39f52a822653 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:03.054771 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a7b90-75b6-4976-af43-3cee1c8fb0e5 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:03.081300 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d47ffb-3ae0-4b26-8cb1-0915de7048cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:03.081970 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d47ffb-3ae0-4b26-8cb1-0915de7048cf None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:03.082258 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d47ffb-3ae0-4b26-8cb1-0915de7048cf None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:03.082540 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d47ffb-3ae0-4b26-8cb1-0915de7048cf None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:03.083262 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d47ffb-3ae0-4b26-8cb1-0915de7048cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:03.083575 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d47ffb-3ae0-4b26-8cb1-0915de7048cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:03.084969 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d47ffb-3ae0-4b26-8cb1-0915de7048cf None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:03.090415 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e856e-9edf-41de-a3e3-4d180c211a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:03.091206 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e856e-9edf-41de-a3e3-4d180c211a56 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:03.091492 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e856e-9edf-41de-a3e3-4d180c211a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:03.091771 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e856e-9edf-41de-a3e3-4d180c211a56 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:03.096770 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 284/577] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:03.097705 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d47ffb-3ae0-4b26-8cb1-0915de7048cf None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:03.105667 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e856e-9edf-41de-a3e3-4d180c211a56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:48:03.113476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-609e856e-9edf-41de-a3e3-4d180c211a56 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:48:03.113476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:03.113476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:03.113476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:03.113476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:03.113476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:03.113476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:03.113476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:03.113476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:03.113476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:03.113476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:03.113476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:03.113476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:48:03.113476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:48:03.113476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:48:03.113476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:48:03.114406 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:48:03.114406 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:48:03.114406 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:48:03.114406 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:48:03.114406 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:03.114406 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:03.114406 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:03.114406 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:03.114406 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:03.114406 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:03.114406 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:03.114406 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:03.114406 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:03.114406 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:03.114406 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:03.114406 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:03.115631 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:03.115631 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:03.115631 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:03.115631 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:03.115631 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:48:03.115631 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:48:03.115631 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:48:03.115631 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:48:03.115631 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:48:03.115631 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:48:03.115631 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:48:03.115631 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:03.115631 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 294/578] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 11 20:48:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:03.116467 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e856e-9edf-41de-a3e3-4d180c211a56 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:03.164921 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:03.201744 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d47ffb-3ae0-4b26-8cb1-0915de7048cf None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:03.214125 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e856e-9edf-41de-a3e3-4d180c211a56 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:03.235412 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c3c2b-77ed-4fb2-8cf8-b41482c15b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:03.236116 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c3c2b-77ed-4fb2-8cf8-b41482c15b4d None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:03.236403 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c3c2b-77ed-4fb2-8cf8-b41482c15b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:03.236685 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c3c2b-77ed-4fb2-8cf8-b41482c15b4d None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:03.237432 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c3c2b-77ed-4fb2-8cf8-b41482c15b4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:03.237744 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c3c2b-77ed-4fb2-8cf8-b41482c15b4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:03.239092 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c3c2b-77ed-4fb2-8cf8-b41482c15b4d None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:03.246811 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c7d06-49e7-4052-a298-84fc2caaf45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:03.247595 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c7d06-49e7-4052-a298-84fc2caaf45d None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:03.247882 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c7d06-49e7-4052-a298-84fc2caaf45d None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:03.248190 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c7d06-49e7-4052-a298-84fc2caaf45d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:03.250400 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 285/579] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:03.251186 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c3c2b-77ed-4fb2-8cf8-b41482c15b4d None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:03.255387 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:03.255659 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c7d06-49e7-4052-a298-84fc2caaf45d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:03.257150 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c7d06-49e7-4052-a298-84fc2caaf45d None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:03.271811 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-986c7d06-49e7-4052-a298-84fc2caaf45d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:03.271811 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:03.271811 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:03.271811 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:03.271811 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:03.271811 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:03.271811 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:03.271811 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:03.271811 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:03.271811 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:03.271811 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:03.271811 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:03.271811 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:48:03.271811 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:48:03.271811 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:48:03.278327 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:48:03.278327 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:03.278327 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:03.278327 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:03.278327 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:03.278327 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:03.278327 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:03.278327 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:03.278327 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:03.278327 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:03.278327 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:03.278327 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:03.278327 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:03.278327 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:03.278327 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:03.278327 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:03.278327 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:03.279448 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:48:03.279448 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:48:03.279448 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:48:03.279448 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:48:03.279448 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:48:03.279448 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:48:03.279448 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:03.279448 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:03.279448 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 295/580] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:48:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:03.279448 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c7d06-49e7-4052-a298-84fc2caaf45d None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:03.378192 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c3c2b-77ed-4fb2-8cf8-b41482c15b4d None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:03.409034 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c7d06-49e7-4052-a298-84fc2caaf45d None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:03.410689 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab289f7-c2d8-47f7-9e51-b1eee0bf02c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:03.411348 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab289f7-c2d8-47f7-9e51-b1eee0bf02c5 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:03.411637 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab289f7-c2d8-47f7-9e51-b1eee0bf02c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:03.411911 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab289f7-c2d8-47f7-9e51-b1eee0bf02c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:03.412760 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab289f7-c2d8-47f7-9e51-b1eee0bf02c5 None admin] RBAC: Adding query filter params (role.id=17bc727d82f24074aba8b1185cb99739, scope.project.id=eca3ef2561fa435e80ff451aeab14f3b, user.id=dc950dfb1d3b4308a33f3d430fe34c1c) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:03.413072 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab289f7-c2d8-47f7-9e51-b1eee0bf02c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:03.414478 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab289f7-c2d8-47f7-9e51-b1eee0bf02c5 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:03.420444 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:03.420932 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 286/581] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:48:03 2022] GET /identity/v3/role_assignments?user.id=dc950dfb1d3b4308a33f3d430fe34c1c&scope.project.id=eca3ef2561fa435e80ff451aeab14f3b&role.id=17bc727d82f24074aba8b1185cb99739 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:03.421730 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab289f7-c2d8-47f7-9e51-b1eee0bf02c5 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:03.464350 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de53eb-de94-4aef-b8a9-27abb40452cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:03.465092 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de53eb-de94-4aef-b8a9-27abb40452cd None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:03.465384 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de53eb-de94-4aef-b8a9-27abb40452cd None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:03.465666 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de53eb-de94-4aef-b8a9-27abb40452cd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:03.475506 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de53eb-de94-4aef-b8a9-27abb40452cd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:03.477183 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de53eb-de94-4aef-b8a9-27abb40452cd None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:03.493155 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-57de53eb-de94-4aef-b8a9-27abb40452cd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 20:48:03.493155 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:03.493155 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:03.493155 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:03.493155 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:03.493155 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:03.493155 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:03.493155 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:03.493155 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:03.493155 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:03.493155 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:03.493155 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:03.493155 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:48:03.493155 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:48:03.493155 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:48:03.493155 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:48:03.494350 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:03.494350 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:03.494350 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:48:03.494350 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:03.494350 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:48:03.494350 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:03.494350 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:03.494350 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:03.494350 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:03.494350 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:03.494350 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:03.494350 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:03.494350 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:03.494350 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:03.494350 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:03.494350 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:03.494350 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:03.494350 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:03.495288 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:03.495288 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:03.495288 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:48:03.495288 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:48:03.495288 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:48:03.495288 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:48:03.495288 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:48:03.495288 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:48:03.495288 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 20:48:03.495288 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:03.499326 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 296/582] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:48:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:03.500589 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de53eb-de94-4aef-b8a9-27abb40452cd None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:03.501686 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:03.539272 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab289f7-c2d8-47f7-9e51-b1eee0bf02c5 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:03.578821 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dad88e-dc98-421b-88b7-bf197bf0b5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:03.579514 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dad88e-dc98-421b-88b7-bf197bf0b5f3 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:03.579807 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dad88e-dc98-421b-88b7-bf197bf0b5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:03.580147 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dad88e-dc98-421b-88b7-bf197bf0b5f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:03.580974 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dad88e-dc98-421b-88b7-bf197bf0b5f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:03.581207 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dad88e-dc98-421b-88b7-bf197bf0b5f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:03.582569 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dad88e-dc98-421b-88b7-bf197bf0b5f3 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:03.592306 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 287/583] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jul 11 20:48:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:03.592826 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dad88e-dc98-421b-88b7-bf197bf0b5f3 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:03.643024 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de53eb-de94-4aef-b8a9-27abb40452cd None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:03.686757 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529234b-4d23-4e60-abe4-38cc3302af93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:03.687679 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529234b-4d23-4e60-abe4-38cc3302af93 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:03.688122 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529234b-4d23-4e60-abe4-38cc3302af93 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:03.688411 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529234b-4d23-4e60-abe4-38cc3302af93 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:03.696815 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529234b-4d23-4e60-abe4-38cc3302af93 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:03.698276 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529234b-4d23-4e60-abe4-38cc3302af93 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:03.710414 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dad88e-dc98-421b-88b7-bf197bf0b5f3 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:03.714851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-0529234b-4d23-4e60-abe4-38cc3302af93 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 11 20:48:03.714851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:03.714851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:03.714851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:03.714851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:03.714851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:03.714851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:03.714851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:03.714851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:03.714851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:03.714851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:03.714851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:03.714851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:48:03.714851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:48:03.714851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:48:03.714851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:48:03.715756 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:03.715756 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:03.715756 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:48:03.715756 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:03.715756 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:48:03.715756 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:03.715756 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:03.715756 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:03.715756 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:03.715756 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:03.715756 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:03.715756 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:03.715756 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:03.715756 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:03.715756 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:03.715756 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:03.715756 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:03.715756 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:03.717022 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:03.717022 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:03.717022 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:48:03.717022 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:48:03.717022 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:48:03.717022 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:48:03.717022 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:48:03.717022 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:48:03.717022 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 11 20:48:03.717022 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:03.717022 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 297/584] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:48:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:03.717603 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529234b-4d23-4e60-abe4-38cc3302af93 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:03.742535 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:03.749065 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92b051-3961-41e8-8886-c95162d47cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:03.750000 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92b051-3961-41e8-8886-c95162d47cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:03.750534 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92b051-3961-41e8-8886-c95162d47cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:03.750534 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92b051-3961-41e8-8886-c95162d47cf7 None admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:03.751327 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df92b051-3961-41e8-8886-c95162d47cf7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:03.751643 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df92b051-3961-41e8-8886-c95162d47cf7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:03.753023 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:03.753134 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df92b051-3961-41e8-8886-c95162d47cf7 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:03.765361 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 288/585] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 11 20:48:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:03.765361 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92b051-3961-41e8-8886-c95162d47cf7 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:03.829775 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529234b-4d23-4e60-abe4-38cc3302af93 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:03.864218 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad3b809-2ac8-4d37-8d58-5fbfd23d0c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:03.864907 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3b809-2ac8-4d37-8d58-5fbfd23d0c3d None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:03.865198 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3b809-2ac8-4d37-8d58-5fbfd23d0c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:03.865482 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3b809-2ac8-4d37-8d58-5fbfd23d0c3d None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:03.866320 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad3b809-2ac8-4d37-8d58-5fbfd23d0c3d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:03.866638 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad3b809-2ac8-4d37-8d58-5fbfd23d0c3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:03.868267 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad3b809-2ac8-4d37-8d58-5fbfd23d0c3d None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:03.876832 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92b051-3961-41e8-8886-c95162d47cf7 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:03.890809 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 298/586] 10.222.0.40 () {56 vars in 1137 bytes} [Mon Jul 11 20:48:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:03.890809 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad3b809-2ac8-4d37-8d58-5fbfd23d0c3d None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:03.919904 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddad12a-6436-4abe-aa2b-058429e83e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:03.920723 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddad12a-6436-4abe-aa2b-058429e83e44 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:03.921009 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddad12a-6436-4abe-aa2b-058429e83e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:03.921284 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddad12a-6436-4abe-aa2b-058429e83e44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:03.931819 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddad12a-6436-4abe-aa2b-058429e83e44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:03.933366 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddad12a-6436-4abe-aa2b-058429e83e44 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:03.952751 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-9ddad12a-6436-4abe-aa2b-058429e83e44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:03.952751 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:03.952751 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:03.952751 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:03.952751 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:03.952751 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:03.952751 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:03.952751 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:03.952751 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:03.952751 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:03.952751 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:03.952751 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:03.952751 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:03.952751 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:03.952751 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:03.953668 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:03.953668 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:03.953668 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:03.953668 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:03.953668 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:03.953668 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:03.953668 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:03.953668 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:03.953668 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:03.953668 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:03.953668 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:03.953668 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:03.953668 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:03.953668 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:03.953668 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:03.953668 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:03.953668 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:03.954542 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:03.954542 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:03.954542 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:03.954542 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:03.954542 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 289/587] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:03.955242 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddad12a-6436-4abe-aa2b-058429e83e44 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:03.981374 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:03.993656 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad3b809-2ac8-4d37-8d58-5fbfd23d0c3d None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:04.002214 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:04.030425 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a076aad7-a6a2-4f32-b785-8cf7856cfce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:04.031154 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076aad7-a6a2-4f32-b785-8cf7856cfce9 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:04.031440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076aad7-a6a2-4f32-b785-8cf7856cfce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:04.031735 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076aad7-a6a2-4f32-b785-8cf7856cfce9 None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:04.032588 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a076aad7-a6a2-4f32-b785-8cf7856cfce9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:04.032900 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a076aad7-a6a2-4f32-b785-8cf7856cfce9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:04.034340 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a076aad7-a6a2-4f32-b785-8cf7856cfce9 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:04.057624 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 299/588] 10.222.0.40 () {56 vars in 1137 bytes} [Mon Jul 11 20:48:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:04.057624 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a076aad7-a6a2-4f32-b785-8cf7856cfce9 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:04.070596 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddad12a-6436-4abe-aa2b-058429e83e44 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:04.110020 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4112f-ed50-4fa5-907d-fcd249c5bd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:04.110925 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4112f-ed50-4fa5-907d-fcd249c5bd6c None admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:04.111734 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4112f-ed50-4fa5-907d-fcd249c5bd6c None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:04.112047 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4112f-ed50-4fa5-907d-fcd249c5bd6c None admin] PATH_INFO: `/v3/projects/eca3ef2561fa435e80ff451aeab14f3b/users/8ac15411c75f4bd4a86f6753c9240a5b/roles/17bc727d82f24074aba8b1185cb99739` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:04.134443 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a4112f-ed50-4fa5-907d-fcd249c5bd6c None admin] RBAC: Authorizing `identity:create_grant(project_id=eca3ef2561fa435e80ff451aeab14f3b, user_id=8ac15411c75f4bd4a86f6753c9240a5b, role_id=17bc727d82f24074aba8b1185cb99739)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:04.135880 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a4112f-ed50-4fa5-907d-fcd249c5bd6c None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:04.159944 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a076aad7-a6a2-4f32-b785-8cf7856cfce9 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:04.195378 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701101ad-a06b-4fbf-b776-7dfbdccd8c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:04.196259 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701101ad-a06b-4fbf-b776-7dfbdccd8c05 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:04.196546 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701101ad-a06b-4fbf-b776-7dfbdccd8c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:04.196825 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701101ad-a06b-4fbf-b776-7dfbdccd8c05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:04.212301 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 290/589] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 11 20:48:03 2022] PUT /identity/v3/projects/eca3ef2561fa435e80ff451aeab14f3b/users/8ac15411c75f4bd4a86f6753c9240a5b/roles/17bc727d82f24074aba8b1185cb99739 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:48:04.212301 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4112f-ed50-4fa5-907d-fcd249c5bd6c None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:04.218059 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701101ad-a06b-4fbf-b776-7dfbdccd8c05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:04.220024 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701101ad-a06b-4fbf-b776-7dfbdccd8c05 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:04.229574 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:04.243955 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-701101ad-a06b-4fbf-b776-7dfbdccd8c05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:04.243955 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:04.243955 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:04.243955 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:04.243955 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:04.243955 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:04.243955 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:04.243955 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:04.243955 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:04.243955 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:04.243955 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:04.243955 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:04.243955 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:04.243955 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:04.243955 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:04.245116 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:04.245116 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:04.245116 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:04.245116 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:04.245116 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:04.245116 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:04.245116 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:04.245116 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:04.245116 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:04.245116 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:04.245116 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:04.245116 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:04.245116 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:04.245116 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:04.245116 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:04.245116 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:04.245116 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:04.246079 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:04.246079 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:04.246079 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:04.246079 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:04.246079 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 300/590] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:04.246079 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701101ad-a06b-4fbf-b776-7dfbdccd8c05 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:04.335688 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:04.348765 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4112f-ed50-4fa5-907d-fcd249c5bd6c None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:04.362063 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701101ad-a06b-4fbf-b776-7dfbdccd8c05 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:04.405677 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980e4c8-737b-4c1f-80c5-b438379fca73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:04.406592 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d10679-16f9-4a58-b823-96740292e8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:04.407590 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980e4c8-737b-4c1f-80c5-b438379fca73 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:04.407881 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980e4c8-737b-4c1f-80c5-b438379fca73 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:04.408212 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980e4c8-737b-4c1f-80c5-b438379fca73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:04.409423 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d10679-16f9-4a58-b823-96740292e8bf None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:04.409712 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d10679-16f9-4a58-b823-96740292e8bf None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:04.409989 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d10679-16f9-4a58-b823-96740292e8bf None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:04.411182 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d10679-16f9-4a58-b823-96740292e8bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:04.411182 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d10679-16f9-4a58-b823-96740292e8bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:04.412422 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d10679-16f9-4a58-b823-96740292e8bf None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:04.425194 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 291/591] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:04.425370 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4980e4c8-737b-4c1f-80c5-b438379fca73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:04.426059 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d10679-16f9-4a58-b823-96740292e8bf None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:04.426685 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4980e4c8-737b-4c1f-80c5-b438379fca73 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:04.445403 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-4980e4c8-737b-4c1f-80c5-b438379fca73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:04.445403 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:04.445403 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:04.445403 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:04.445403 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:04.445403 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:04.445403 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:04.445403 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:04.445403 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:04.445403 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:04.445403 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:04.445403 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:04.445403 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:04.445403 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:04.445403 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:04.446393 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:04.446393 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:04.446393 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:04.446393 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:04.446393 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:04.446393 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:04.446393 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:04.446393 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:04.446393 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:04.446393 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:04.446393 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:04.446393 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:04.446393 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:04.446393 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:04.446393 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:04.446393 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:04.446393 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:04.447283 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:04.447283 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:04.447283 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:04.447283 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:04.447283 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 301/592] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:04.448070 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980e4c8-737b-4c1f-80c5-b438379fca73 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:04.510689 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:04.567655 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980e4c8-737b-4c1f-80c5-b438379fca73 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:04.570787 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d10679-16f9-4a58-b823-96740292e8bf None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:04.605223 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf9a9b-b027-4827-a07d-89f04283d76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:04.606034 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf9a9b-b027-4827-a07d-89f04283d76e None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:04.606320 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf9a9b-b027-4827-a07d-89f04283d76e None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:04.606598 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf9a9b-b027-4827-a07d-89f04283d76e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:04.615215 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf9a9b-b027-4827-a07d-89f04283d76e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:04.616971 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf9a9b-b027-4827-a07d-89f04283d76e None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:04.617472 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644b8cb-c201-4fc3-a44d-ff4f32cf044f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:04.618935 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644b8cb-c201-4fc3-a44d-ff4f32cf044f None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:04.619716 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644b8cb-c201-4fc3-a44d-ff4f32cf044f None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:04.620855 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644b8cb-c201-4fc3-a44d-ff4f32cf044f None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:04.621799 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0644b8cb-c201-4fc3-a44d-ff4f32cf044f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:04.622336 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0644b8cb-c201-4fc3-a44d-ff4f32cf044f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:04.624235 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0644b8cb-c201-4fc3-a44d-ff4f32cf044f None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:04.632745 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-2bbf9a9b-b027-4827-a07d-89f04283d76e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 20:48:04.632745 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:04.632745 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:04.632745 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:04.632745 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:04.632745 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:04.632745 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:04.632745 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:04.632745 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:04.632745 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:04.632745 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:04.632745 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:04.632745 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:48:04.632745 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:48:04.632745 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:48:04.632745 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:48:04.633735 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:04.633735 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:04.633735 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:48:04.633735 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:04.633735 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:48:04.633735 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:04.633735 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:04.633735 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:04.633735 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:04.633735 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:04.633735 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:04.633735 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:04.633735 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:04.633735 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:04.633735 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:04.633735 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:04.633735 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:04.633735 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:04.634690 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:04.634690 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:04.634690 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:48:04.634690 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:48:04.634690 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:48:04.634690 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:48:04.634690 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:48:04.634690 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:48:04.634690 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 20:48:04.634690 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:04.639056 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 302/593] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 11 20:48:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:04.639957 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf9a9b-b027-4827-a07d-89f04283d76e None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:04.642338 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 292/594] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:04.647246 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644b8cb-c201-4fc3-a44d-ff4f32cf044f None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:04.672096 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:04.771060 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf9a9b-b027-4827-a07d-89f04283d76e None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:04.780139 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644b8cb-c201-4fc3-a44d-ff4f32cf044f None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:04.782693 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:04.818047 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e81d4-c819-4dd4-ab65-74fa0fba2f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:04.819123 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e81d4-c819-4dd4-ab65-74fa0fba2f9e None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:04.819597 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e81d4-c819-4dd4-ab65-74fa0fba2f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:04.820089 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e81d4-c819-4dd4-ab65-74fa0fba2f9e None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:04.821672 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e81d4-c819-4dd4-ab65-74fa0fba2f9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:04.822173 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e81d4-c819-4dd4-ab65-74fa0fba2f9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:04.822349 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c08559-b62b-45ef-8f24-2d35c59029ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:04.823209 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c08559-b62b-45ef-8f24-2d35c59029ed None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:04.823565 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c08559-b62b-45ef-8f24-2d35c59029ed None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:04.823911 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c08559-b62b-45ef-8f24-2d35c59029ed None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:04.824534 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e81d4-c819-4dd4-ab65-74fa0fba2f9e None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:04.824904 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c08559-b62b-45ef-8f24-2d35c59029ed None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:04.825282 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c08559-b62b-45ef-8f24-2d35c59029ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:04.826754 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c08559-b62b-45ef-8f24-2d35c59029ed None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:04.840757 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 303/595] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:04.842398 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e81d4-c819-4dd4-ab65-74fa0fba2f9e None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:04.849489 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 293/596] 10.222.0.40 () {56 vars in 1139 bytes} [Mon Jul 11 20:48:04 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:04.850444 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c08559-b62b-45ef-8f24-2d35c59029ed None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:04.926116 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:04.965548 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c08559-b62b-45ef-8f24-2d35c59029ed None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:04.978955 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e81d4-c819-4dd4-ab65-74fa0fba2f9e None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:05.017430 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800afea-07ba-41fb-813a-b3663de3ea4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:05.017981 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878e7ea-0a3f-4fc2-8533-6a65a36d77e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:05.018784 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878e7ea-0a3f-4fc2-8533-6a65a36d77e7 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:05.019074 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878e7ea-0a3f-4fc2-8533-6a65a36d77e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:05.019180 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800afea-07ba-41fb-813a-b3663de3ea4e None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:05.019370 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878e7ea-0a3f-4fc2-8533-6a65a36d77e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:05.019925 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800afea-07ba-41fb-813a-b3663de3ea4e None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:05.020497 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800afea-07ba-41fb-813a-b3663de3ea4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:05.027991 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878e7ea-0a3f-4fc2-8533-6a65a36d77e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:05.029373 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878e7ea-0a3f-4fc2-8533-6a65a36d77e7 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:05.030742 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0800afea-07ba-41fb-813a-b3663de3ea4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:05.032868 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0800afea-07ba-41fb-813a-b3663de3ea4e None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:05.045677 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-a878e7ea-0a3f-4fc2-8533-6a65a36d77e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:05.045677 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:05.045677 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:05.045677 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:05.045677 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:05.045677 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:05.045677 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:05.045677 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:05.045677 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:05.045677 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:05.045677 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:05.045677 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:05.045677 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:48:05.045677 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:48:05.045677 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:48:05.046615 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:48:05.046615 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:05.046615 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:05.046615 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:05.046615 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:05.046615 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:05.046615 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:05.046615 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:05.046615 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:05.046615 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:05.046615 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:05.046615 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:05.046615 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:05.046615 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:05.046615 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:05.046615 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:05.046615 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:05.047524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:48:05.047524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:48:05.047524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:48:05.047524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:48:05.047524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:48:05.047524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:48:05.047524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:05.047524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:05.047524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 304/597] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:48:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:05.048069 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878e7ea-0a3f-4fc2-8533-6a65a36d77e7 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:05.058455 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-0800afea-07ba-41fb-813a-b3663de3ea4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:05.058455 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:05.058455 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:05.058455 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:05.058455 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:05.058455 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:05.058455 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:05.058455 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:05.058455 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:05.058455 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:05.058455 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:05.058455 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:05.058455 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:48:05.058455 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:48:05.058455 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:48:05.059413 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:48:05.059413 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:05.059413 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:05.059413 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:05.059413 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:05.059413 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:05.059413 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:05.059413 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:05.059413 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:05.059413 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:05.059413 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:05.059413 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:05.059413 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:05.059413 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:05.059413 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:05.059413 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:05.059413 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:05.060423 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:48:05.060423 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:48:05.060423 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:48:05.060423 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:48:05.060423 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:48:05.060423 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:48:05.060423 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:05.060423 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:05.060423 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 294/598] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:48:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:05.060912 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800afea-07ba-41fb-813a-b3663de3ea4e None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:05.095288 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:05.181326 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800afea-07ba-41fb-813a-b3663de3ea4e None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:05.186956 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878e7ea-0a3f-4fc2-8533-6a65a36d77e7 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:05.211120 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:05.218748 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fe758-e181-40c7-84dd-a62dad7c6e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:05.219524 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fe758-e181-40c7-84dd-a62dad7c6e89 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:05.219870 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fe758-e181-40c7-84dd-a62dad7c6e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:05.220268 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fe758-e181-40c7-84dd-a62dad7c6e89 None admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:05.221110 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837fe758-e181-40c7-84dd-a62dad7c6e89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:05.221538 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837fe758-e181-40c7-84dd-a62dad7c6e89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:05.223079 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837fe758-e181-40c7-84dd-a62dad7c6e89 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:05.234085 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8dcb2-96e0-4580-84cc-da353d6dcc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:05.235109 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8dcb2-96e0-4580-84cc-da353d6dcc41 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:05.235548 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8dcb2-96e0-4580-84cc-da353d6dcc41 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:05.236124 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8dcb2-96e0-4580-84cc-da353d6dcc41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:05.241271 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 295/599] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 11 20:48:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:05.241271 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fe758-e181-40c7-84dd-a62dad7c6e89 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:05.256405 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf8dcb2-96e0-4580-84cc-da353d6dcc41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:05.258248 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf8dcb2-96e0-4580-84cc-da353d6dcc41 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:05.283738 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-6bf8dcb2-96e0-4580-84cc-da353d6dcc41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:05.283738 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:05.283738 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:05.283738 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:05.283738 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:05.283738 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:05.283738 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:05.283738 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:05.283738 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:05.283738 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:05.283738 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:05.283738 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:05.283738 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:05.283738 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:05.283738 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:05.284897 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:05.284897 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:05.284897 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:05.284897 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:05.284897 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:05.284897 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:05.284897 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:05.284897 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:05.284897 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:05.284897 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:05.284897 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:05.284897 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:05.284897 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:05.284897 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:05.284897 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:05.284897 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:05.284897 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:05.286023 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:05.286023 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:05.286023 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:05.286023 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:05.287866 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 305/600] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:05.288781 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8dcb2-96e0-4580-84cc-da353d6dcc41 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:05.363224 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fe758-e181-40c7-84dd-a62dad7c6e89 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:05.389838 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:05.408231 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8dcb2-96e0-4580-84cc-da353d6dcc41 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:05.412864 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ef71b-93be-4fe9-a06d-6c821b1272bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:05.413828 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ef71b-93be-4fe9-a06d-6c821b1272bc None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:05.414272 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ef71b-93be-4fe9-a06d-6c821b1272bc None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:05.414737 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ef71b-93be-4fe9-a06d-6c821b1272bc None admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:05.417040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ef71b-93be-4fe9-a06d-6c821b1272bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:05.418167 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ef71b-93be-4fe9-a06d-6c821b1272bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:05.420241 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ef71b-93be-4fe9-a06d-6c821b1272bc None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:05.434994 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 296/601] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 11 20:48:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:05.440864 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ef71b-93be-4fe9-a06d-6c821b1272bc None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:05.456317 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f32441-1324-4dde-98cc-47b22c15883a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:05.457992 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f32441-1324-4dde-98cc-47b22c15883a None admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:05.458440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f32441-1324-4dde-98cc-47b22c15883a None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:05.459126 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f32441-1324-4dde-98cc-47b22c15883a None admin] PATH_INFO: `/v3/projects/eca3ef2561fa435e80ff451aeab14f3b/users/e4ae1169746141bc8993707b12cacd80/roles/17bc727d82f24074aba8b1185cb99739` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:05.480612 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f32441-1324-4dde-98cc-47b22c15883a None admin] RBAC: Authorizing `identity:create_grant(project_id=eca3ef2561fa435e80ff451aeab14f3b, user_id=e4ae1169746141bc8993707b12cacd80, role_id=17bc727d82f24074aba8b1185cb99739)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:05.482091 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f32441-1324-4dde-98cc-47b22c15883a None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:05.494460 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:05.553068 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ef71b-93be-4fe9-a06d-6c821b1272bc None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:05.553640 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 306/602] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 11 20:48:05 2022] PUT /identity/v3/projects/eca3ef2561fa435e80ff451aeab14f3b/users/e4ae1169746141bc8993707b12cacd80/roles/17bc727d82f24074aba8b1185cb99739 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:48:05.554848 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f32441-1324-4dde-98cc-47b22c15883a None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:05.589548 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56cb2a-47ac-4d57-8ddc-49465c35cdaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:05.590341 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56cb2a-47ac-4d57-8ddc-49465c35cdaa None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:05.590681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56cb2a-47ac-4d57-8ddc-49465c35cdaa None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:05.590966 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56cb2a-47ac-4d57-8ddc-49465c35cdaa None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:05.591997 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56cb2a-47ac-4d57-8ddc-49465c35cdaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:05.592105 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56cb2a-47ac-4d57-8ddc-49465c35cdaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:05.599996 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56cb2a-47ac-4d57-8ddc-49465c35cdaa None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:05.608836 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 297/603] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:05.610414 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74165352-2d95-46d8-a94c-482eb294dca1 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:05.610762 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74165352-2d95-46d8-a94c-482eb294dca1 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:05.611051 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74165352-2d95-46d8-a94c-482eb294dca1 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:05.617214 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 298/604] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:05.618243 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74165352-2d95-46d8-a94c-482eb294dca1 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:05.720243 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f32441-1324-4dde-98cc-47b22c15883a None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:05.753737 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74165352-2d95-46d8-a94c-482eb294dca1 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:05.757625 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:05.763428 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bbc93d-ef9e-4a3b-871c-55d5a46cc6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:05.766285 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbc93d-ef9e-4a3b-871c-55d5a46cc6d0 None admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:05.766285 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbc93d-ef9e-4a3b-871c-55d5a46cc6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:05.766285 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbc93d-ef9e-4a3b-871c-55d5a46cc6d0 None admin] PATH_INFO: `/v3/projects/eca3ef2561fa435e80ff451aeab14f3b/users/da488c75631e4e5992304ff6c0579aab/roles/17bc727d82f24074aba8b1185cb99739` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:05.774121 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:05.787408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bbc93d-ef9e-4a3b-871c-55d5a46cc6d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=eca3ef2561fa435e80ff451aeab14f3b, user_id=da488c75631e4e5992304ff6c0579aab, role_id=17bc727d82f24074aba8b1185cb99739)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:05.788436 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bbc93d-ef9e-4a3b-871c-55d5a46cc6d0 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:05.793019 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19fc703-7410-47e8-97a4-a02a94d18309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:05.793835 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fc703-7410-47e8-97a4-a02a94d18309 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:05.794123 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fc703-7410-47e8-97a4-a02a94d18309 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:05.794398 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fc703-7410-47e8-97a4-a02a94d18309 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:05.806267 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19fc703-7410-47e8-97a4-a02a94d18309 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:05.808350 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19fc703-7410-47e8-97a4-a02a94d18309 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:05.823002 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-a19fc703-7410-47e8-97a4-a02a94d18309 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:05.823002 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:05.823002 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:05.823002 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:05.823002 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:05.823002 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:05.823002 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:05.823002 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:05.823002 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:05.823002 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:05.823002 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:05.823002 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:05.823002 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:48:05.823002 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:48:05.823002 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:48:05.825210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:48:05.825210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:05.825210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:05.825210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:05.825210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:05.825210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:05.825210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:05.825210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:05.825210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:05.825210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:05.825210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:05.825210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:05.825210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:05.825210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:05.825210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:05.825210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:05.825210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:05.826113 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:48:05.826113 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:48:05.826113 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:48:05.826113 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:48:05.826113 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:48:05.826113 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:48:05.826113 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:05.826113 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:05.826113 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 299/605] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:48:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:05.826113 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0a153-54e0-4e24-bcdd-abd77c237df6 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:05.826113 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0a153-54e0-4e24-bcdd-abd77c237df6 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:05.826716 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0a153-54e0-4e24-bcdd-abd77c237df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:05.847370 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-94a0a153-54e0-4e24-bcdd-abd77c237df6 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:05.848662 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-94a0a153-54e0-4e24-bcdd-abd77c237df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:05.901117 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 307/606] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 11 20:48:05 2022] PUT /identity/v3/projects/eca3ef2561fa435e80ff451aeab14f3b/users/da488c75631e4e5992304ff6c0579aab/roles/17bc727d82f24074aba8b1185cb99739 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:48:05.901960 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bbc93d-ef9e-4a3b-871c-55d5a46cc6d0 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:05.934298 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 300/607] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:48:05.960331 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0a153-54e0-4e24-bcdd-abd77c237df6 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:06.090807 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:06.094933 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0a153-54e0-4e24-bcdd-abd77c237df6 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:06.140006 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224a297-6ecf-4538-83f0-cf26740b08b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:06.141409 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224a297-6ecf-4538-83f0-cf26740b08b8 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:06.141706 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224a297-6ecf-4538-83f0-cf26740b08b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:06.141993 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224a297-6ecf-4538-83f0-cf26740b08b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:06.155993 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2224a297-6ecf-4538-83f0-cf26740b08b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:48:06.164815 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bbc93d-ef9e-4a3b-871c-55d5a46cc6d0 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:06.173291 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-2224a297-6ecf-4538-83f0-cf26740b08b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:48:06.173291 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:06.173291 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:06.173291 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:06.173291 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:06.173291 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:06.173291 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:06.173291 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:06.173291 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:06.173291 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:06.173291 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:06.173291 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:06.173291 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:48:06.173291 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:48:06.173291 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:48:06.173291 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:48:06.174267 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:48:06.174267 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:48:06.174267 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:48:06.174267 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:48:06.174267 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:06.174267 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:06.174267 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:06.174267 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:06.174267 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:06.174267 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:06.174267 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:06.174267 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:06.174267 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:06.174267 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:06.174267 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:06.174267 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:06.175092 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:06.175092 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:06.175092 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:06.175092 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:06.175092 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:48:06.175092 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:48:06.175092 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:48:06.175092 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:48:06.175092 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:48:06.175092 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:48:06.175092 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:48:06.175092 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:06.175092 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 301/608] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 11 20:48:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:48:06.182733 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224a297-6ecf-4538-83f0-cf26740b08b8 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:06.204385 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16526c-4b99-4242-83f5-9b3bb6e3a6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:06.205060 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16526c-4b99-4242-83f5-9b3bb6e3a6f1 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:06.205346 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16526c-4b99-4242-83f5-9b3bb6e3a6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:06.205624 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16526c-4b99-4242-83f5-9b3bb6e3a6f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:06.206415 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16526c-4b99-4242-83f5-9b3bb6e3a6f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:06.206726 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16526c-4b99-4242-83f5-9b3bb6e3a6f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:06.208174 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16526c-4b99-4242-83f5-9b3bb6e3a6f1 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:06.222145 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 308/609] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 11 20:48:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:06.228658 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16526c-4b99-4242-83f5-9b3bb6e3a6f1 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:06.276679 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:06.324872 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224a297-6ecf-4538-83f0-cf26740b08b8 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:06.361181 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e902dff-2712-4599-be59-c7314f3090d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:06.361783 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e902dff-2712-4599-be59-c7314f3090d6 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:06.362074 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e902dff-2712-4599-be59-c7314f3090d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:06.362354 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e902dff-2712-4599-be59-c7314f3090d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:06.363108 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e902dff-2712-4599-be59-c7314f3090d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:06.363422 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e902dff-2712-4599-be59-c7314f3090d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:06.364865 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e902dff-2712-4599-be59-c7314f3090d6 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:06.373933 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 302/610] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jul 11 20:48:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:06.381027 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e902dff-2712-4599-be59-c7314f3090d6 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:06.394002 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16526c-4b99-4242-83f5-9b3bb6e3a6f1 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:06.432503 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:06.454882 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6170a7-fed6-4d2a-ae90-d1d11e2e8f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:06.456204 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6170a7-fed6-4d2a-ae90-d1d11e2e8f87 None admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:06.456498 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6170a7-fed6-4d2a-ae90-d1d11e2e8f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:06.456780 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6170a7-fed6-4d2a-ae90-d1d11e2e8f87 None admin] PATH_INFO: `/v3/projects/eca3ef2561fa435e80ff451aeab14f3b/users/29046b079f1a4f4ea2244e69cbbaa805/roles/17bc727d82f24074aba8b1185cb99739` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:06.481668 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6170a7-fed6-4d2a-ae90-d1d11e2e8f87 None admin] RBAC: Authorizing `identity:create_grant(project_id=eca3ef2561fa435e80ff451aeab14f3b, user_id=29046b079f1a4f4ea2244e69cbbaa805, role_id=17bc727d82f24074aba8b1185cb99739)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:06.482983 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6170a7-fed6-4d2a-ae90-d1d11e2e8f87 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:06.517939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e902dff-2712-4599-be59-c7314f3090d6 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:06.553572 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b09860-34db-4544-83c4-25ff069b1b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:06.554604 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b09860-34db-4544-83c4-25ff069b1b7a None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:06.555039 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b09860-34db-4544-83c4-25ff069b1b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:06.556000 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b09860-34db-4544-83c4-25ff069b1b7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:06.559234 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 309/611] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 11 20:48:06 2022] PUT /identity/v3/projects/eca3ef2561fa435e80ff451aeab14f3b/users/29046b079f1a4f4ea2244e69cbbaa805/roles/17bc727d82f24074aba8b1185cb99739 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:48:06.560877 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872deb3-1a5e-4acb-a0aa-0ac2ab0ee15b None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:06.561275 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872deb3-1a5e-4acb-a0aa-0ac2ab0ee15b None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:06.561656 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872deb3-1a5e-4acb-a0aa-0ac2ab0ee15b None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:06.564019 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 310/612] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:06.574973 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd932fb-9f2e-4d2a-ab79-d9c8796660e1 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:06.579695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd932fb-9f2e-4d2a-ab79-d9c8796660e1 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:06.579695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd932fb-9f2e-4d2a-ab79-d9c8796660e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:06.585755 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b09860-34db-4544-83c4-25ff069b1b7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:06.587779 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b09860-34db-4544-83c4-25ff069b1b7a None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:06.598195 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-0cd932fb-9f2e-4d2a-ab79-d9c8796660e1 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:06.599881 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-0cd932fb-9f2e-4d2a-ab79-d9c8796660e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:06.624040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-86b09860-34db-4544-83c4-25ff069b1b7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:06.624040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:06.624040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:06.624040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:06.624040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:06.624040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:06.624040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:06.624040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:06.624040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:06.624040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:06.624040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:06.624040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:06.624040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:06.624040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:06.624040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:06.625232 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:06.625232 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:06.625232 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:06.625232 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:06.625232 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:06.625232 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:06.625232 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:06.625232 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:06.625232 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:06.625232 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:06.625232 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:06.625232 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:06.625232 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:06.625232 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:06.625232 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:06.625232 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:06.625232 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:06.626147 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:06.626147 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:06.626147 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:06.626147 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:06.633623 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 303/613] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:06.639449 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b09860-34db-4544-83c4-25ff069b1b7a None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:06.688470 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 311/614] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:48:06.767642 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd932fb-9f2e-4d2a-ab79-d9c8796660e1 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:06.796916 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:06.801991 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:06.835679 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b09860-34db-4544-83c4-25ff069b1b7a None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:06.878411 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d03e3-e69b-4b96-912d-9ba1ec57f95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:06.879022 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d03e3-e69b-4b96-912d-9ba1ec57f95d None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:06.879407 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d03e3-e69b-4b96-912d-9ba1ec57f95d None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:06.879661 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d03e3-e69b-4b96-912d-9ba1ec57f95d None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:06.880432 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d03e3-e69b-4b96-912d-9ba1ec57f95d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:06.889829 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d03e3-e69b-4b96-912d-9ba1ec57f95d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:06.889829 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d03e3-e69b-4b96-912d-9ba1ec57f95d None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:06.896921 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 304/615] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:06.903453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d03e3-e69b-4b96-912d-9ba1ec57f95d None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:06.905042 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd932fb-9f2e-4d2a-ab79-d9c8796660e1 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:06.967295 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0213f29-8394-4635-9724-b8e376a967e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:06.968134 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0213f29-8394-4635-9724-b8e376a967e3 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:06.968425 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0213f29-8394-4635-9724-b8e376a967e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:06.968705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0213f29-8394-4635-9724-b8e376a967e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:06.990519 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0213f29-8394-4635-9724-b8e376a967e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:48:07.004705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-b0213f29-8394-4635-9724-b8e376a967e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:48:07.004705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:07.004705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:07.004705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:07.004705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:07.004705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:07.004705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:07.004705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:07.004705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:07.004705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:07.004705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:07.004705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:07.004705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:48:07.004705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:48:07.004705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:48:07.004705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:48:07.005678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:48:07.005678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:48:07.005678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:48:07.005678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:48:07.005678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:07.005678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:07.005678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:07.005678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:07.005678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:07.005678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:07.005678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:07.005678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:07.005678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:07.005678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:07.005678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:07.005678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:07.006552 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:07.006552 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:07.006552 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:07.006552 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:07.006552 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:48:07.006552 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:48:07.006552 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:48:07.006552 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:48:07.006552 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:48:07.006552 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:48:07.006552 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:48:07.006552 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:07.006552 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 312/616] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 11 20:48:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:07.014286 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0213f29-8394-4635-9724-b8e376a967e3 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:07.078585 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d03e3-e69b-4b96-912d-9ba1ec57f95d None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:07.120374 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c58292-db6d-4ee9-974e-e3c9bafcd9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:07.121230 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c58292-db6d-4ee9-974e-e3c9bafcd9b5 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:07.121517 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c58292-db6d-4ee9-974e-e3c9bafcd9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:07.121792 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c58292-db6d-4ee9-974e-e3c9bafcd9b5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:07.126594 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:07.145627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c58292-db6d-4ee9-974e-e3c9bafcd9b5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:07.145627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c58292-db6d-4ee9-974e-e3c9bafcd9b5 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:07.170061 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-21c58292-db6d-4ee9-974e-e3c9bafcd9b5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 20:48:07.170061 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:07.170061 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:07.170061 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:07.170061 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:07.170061 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:07.170061 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:07.170061 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:07.170061 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:07.170061 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:07.170061 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:07.170061 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:07.170061 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:48:07.170061 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:48:07.170061 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:48:07.170061 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:48:07.171044 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:07.171044 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:07.171044 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:48:07.171044 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:07.171044 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:48:07.171044 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:07.171044 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:07.171044 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:07.171044 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:07.171044 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:07.171044 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:07.171044 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:07.171044 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:07.171044 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:07.171044 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:07.171044 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:07.171044 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:07.171044 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:07.172031 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:07.172031 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:07.172031 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:48:07.172031 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:48:07.172031 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:48:07.172031 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:48:07.172031 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:48:07.172031 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:48:07.172031 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 20:48:07.172031 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:07.172031 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 305/617] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 11 20:48:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:48:07.182826 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c58292-db6d-4ee9-974e-e3c9bafcd9b5 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:07.199473 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:07.232057 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0213f29-8394-4635-9724-b8e376a967e3 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:07.321827 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c58292-db6d-4ee9-974e-e3c9bafcd9b5 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:07.337557 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07444d12-7883-4a4a-9a83-403995bc69f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:07.337978 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07444d12-7883-4a4a-9a83-403995bc69f2 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:07.338278 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07444d12-7883-4a4a-9a83-403995bc69f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:07.338559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07444d12-7883-4a4a-9a83-403995bc69f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:07.339324 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07444d12-7883-4a4a-9a83-403995bc69f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:07.339947 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07444d12-7883-4a4a-9a83-403995bc69f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:07.341137 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07444d12-7883-4a4a-9a83-403995bc69f2 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:07.361369 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c6a55c-a9c0-45a0-b711-d7bdc3f66570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:07.362417 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6a55c-a9c0-45a0-b711-d7bdc3f66570 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:07.362849 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6a55c-a9c0-45a0-b711-d7bdc3f66570 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:07.363270 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6a55c-a9c0-45a0-b711-d7bdc3f66570 None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:07.364315 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c6a55c-a9c0-45a0-b711-d7bdc3f66570 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:07.364798 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c6a55c-a9c0-45a0-b711-d7bdc3f66570 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:07.366363 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c6a55c-a9c0-45a0-b711-d7bdc3f66570 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:07.366482 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 313/618] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jul 11 20:48:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:07.385054 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07444d12-7883-4a4a-9a83-403995bc69f2 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:07.391293 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 306/619] 10.222.0.40 () {56 vars in 1135 bytes} [Mon Jul 11 20:48:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:07.396829 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c6a55c-a9c0-45a0-b711-d7bdc3f66570 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:07.456462 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:07.504938 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c6a55c-a9c0-45a0-b711-d7bdc3f66570 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:07.574574 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b804be-31a1-4c2b-9923-d256bd5b3c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:07.575671 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b804be-31a1-4c2b-9923-d256bd5b3c72 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:07.576195 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b804be-31a1-4c2b-9923-d256bd5b3c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:07.576624 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b804be-31a1-4c2b-9923-d256bd5b3c72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:07.593835 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b804be-31a1-4c2b-9923-d256bd5b3c72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:07.596212 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b804be-31a1-4c2b-9923-d256bd5b3c72 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:07.628140 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07444d12-7883-4a4a-9a83-403995bc69f2 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:07.634332 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-74b804be-31a1-4c2b-9923-d256bd5b3c72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:07.634332 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:07.634332 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:07.634332 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:07.634332 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:07.634332 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:07.634332 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:07.634332 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:07.634332 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:07.634332 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:07.634332 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:07.634332 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:07.634332 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:07.634332 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:07.634332 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:07.635411 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:07.635411 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:07.635411 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:07.635411 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:07.635411 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:07.635411 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:07.635411 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:07.635411 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:07.635411 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:07.635411 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:07.635411 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:07.635411 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:07.635411 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:07.635411 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:07.635411 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:07.635411 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:07.635411 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:07.636513 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:07.636513 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:07.636513 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:07.636513 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:07.638363 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 307/620] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:48:07.644128 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b804be-31a1-4c2b-9923-d256bd5b3c72 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:07.680218 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a066d4-faec-4dc4-b972-0c1d5ba12223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:07.681140 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a066d4-faec-4dc4-b972-0c1d5ba12223 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:07.681584 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a066d4-faec-4dc4-b972-0c1d5ba12223 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:07.681870 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a066d4-faec-4dc4-b972-0c1d5ba12223 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:07.705352 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a066d4-faec-4dc4-b972-0c1d5ba12223 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:07.706832 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a066d4-faec-4dc4-b972-0c1d5ba12223 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:07.725321 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:07.740162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-c4a066d4-faec-4dc4-b972-0c1d5ba12223 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:07.740162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:07.740162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:07.740162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:07.740162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:07.740162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:07.740162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:07.740162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:07.740162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:07.740162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:07.740162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:07.740162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:07.740162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:07.740162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:07.740162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:07.742509 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:07.742509 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:07.742509 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:07.742509 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:07.742509 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:07.742509 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:07.742509 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:07.742509 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:07.742509 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:07.742509 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:07.742509 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:07.742509 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:07.742509 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:07.742509 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:07.742509 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:07.742509 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:07.742509 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:07.744082 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:07.744082 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:07.744082 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:07.744082 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:07.744082 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 314/621] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:07.750595 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a066d4-faec-4dc4-b972-0c1d5ba12223 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:07.844310 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b804be-31a1-4c2b-9923-d256bd5b3c72 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:07.847232 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:07.886365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0788f4d-d6a4-4c3e-91cc-7cca3134ca80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:07.887236 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0788f4d-d6a4-4c3e-91cc-7cca3134ca80 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:07.887832 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0788f4d-d6a4-4c3e-91cc-7cca3134ca80 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:07.888227 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0788f4d-d6a4-4c3e-91cc-7cca3134ca80 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:07.889068 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0788f4d-d6a4-4c3e-91cc-7cca3134ca80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:07.889385 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0788f4d-d6a4-4c3e-91cc-7cca3134ca80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:07.890768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0788f4d-d6a4-4c3e-91cc-7cca3134ca80 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:07.896020 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a066d4-faec-4dc4-b972-0c1d5ba12223 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:07.911243 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 308/622] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:07.911243 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12c687-7ba4-4f7f-8a6b-6732f699da87 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:07.911243 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12c687-7ba4-4f7f-8a6b-6732f699da87 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:07.911243 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12c687-7ba4-4f7f-8a6b-6732f699da87 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:07.911243 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 309/623] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:07.911243 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12c687-7ba4-4f7f-8a6b-6732f699da87 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:07.954141 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02be5eb-5743-470e-a4e7-110197c04789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:07.954824 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02be5eb-5743-470e-a4e7-110197c04789 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:07.955111 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02be5eb-5743-470e-a4e7-110197c04789 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:07.955391 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02be5eb-5743-470e-a4e7-110197c04789 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:07.956155 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02be5eb-5743-470e-a4e7-110197c04789 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:07.956475 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02be5eb-5743-470e-a4e7-110197c04789 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:07.958414 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02be5eb-5743-470e-a4e7-110197c04789 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:07.979985 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 315/624] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:07.979985 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ccb7c-b294-4769-8462-344703f40177 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:07.979985 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ccb7c-b294-4769-8462-344703f40177 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:07.979985 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ccb7c-b294-4769-8462-344703f40177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:08.000408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-458ccb7c-b294-4769-8462-344703f40177 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:08.001670 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-458ccb7c-b294-4769-8462-344703f40177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:08.035472 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12c687-7ba4-4f7f-8a6b-6732f699da87 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:08.071728 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:08.073144 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e07299-0240-4dba-9c46-593ba29d5055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:08.074026 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e07299-0240-4dba-9c46-593ba29d5055 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:08.074312 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e07299-0240-4dba-9c46-593ba29d5055 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:08.074591 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e07299-0240-4dba-9c46-593ba29d5055 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:08.082230 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e07299-0240-4dba-9c46-593ba29d5055 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:08.085076 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e07299-0240-4dba-9c46-593ba29d5055 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:08.093564 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 316/625] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:48:08.094803 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ccb7c-b294-4769-8462-344703f40177 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:08.109222 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-97e07299-0240-4dba-9c46-593ba29d5055 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:08.109222 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:08.109222 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:08.109222 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:08.109222 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:08.109222 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:08.109222 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:08.109222 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:08.109222 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:08.109222 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:08.109222 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:08.109222 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:08.109222 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:48:08.109222 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:48:08.109222 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:48:08.110153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:48:08.110153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:08.110153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:08.110153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:08.110153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:08.110153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:08.110153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:08.110153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:08.110153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:08.110153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:08.110153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:08.110153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:08.110153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:08.110153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:08.110153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:08.110153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:08.110153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:08.111047 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:48:08.111047 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:48:08.111047 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:48:08.111047 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:48:08.111047 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:48:08.111047 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:48:08.111047 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:08.111047 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:08.111047 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 310/626] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:48:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:08.117236 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e07299-0240-4dba-9c46-593ba29d5055 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:08.158655 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:08.219936 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ccb7c-b294-4769-8462-344703f40177 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:08.243715 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e07299-0240-4dba-9c46-593ba29d5055 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:08.268490 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879380e6-5e04-42ba-a775-5f34bb135373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:08.270498 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879380e6-5e04-42ba-a775-5f34bb135373 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:08.271111 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879380e6-5e04-42ba-a775-5f34bb135373 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:08.271607 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879380e6-5e04-42ba-a775-5f34bb135373 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:08.281844 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aafe7fd-5fa2-40e1-bb14-f184f1861c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:08.282525 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aafe7fd-5fa2-40e1-bb14-f184f1861c6f None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:08.282814 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aafe7fd-5fa2-40e1-bb14-f184f1861c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:08.283226 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879380e6-5e04-42ba-a775-5f34bb135373 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:08.283334 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aafe7fd-5fa2-40e1-bb14-f184f1861c6f None admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:08.284177 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aafe7fd-5fa2-40e1-bb14-f184f1861c6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:08.284495 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aafe7fd-5fa2-40e1-bb14-f184f1861c6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:08.285469 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879380e6-5e04-42ba-a775-5f34bb135373 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:08.285978 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aafe7fd-5fa2-40e1-bb14-f184f1861c6f None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:08.303615 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-879380e6-5e04-42ba-a775-5f34bb135373 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 20:48:08.303615 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:08.303615 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:08.303615 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:08.303615 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:08.303615 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:08.303615 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:08.303615 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:08.303615 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:08.303615 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:08.303615 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:08.303615 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:08.303615 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:48:08.303615 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:48:08.303615 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:48:08.303615 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:48:08.304641 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:08.304641 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:08.304641 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:48:08.304641 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:08.304641 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:48:08.304641 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:08.304641 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:08.304641 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:08.304641 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:08.304641 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:08.304641 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:08.304641 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:08.304641 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:08.304641 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:08.304641 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:08.304641 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:08.304641 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:08.304641 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:08.306190 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:08.306190 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:08.306190 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:48:08.306190 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:48:08.306190 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:48:08.306190 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:48:08.306190 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:48:08.306190 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:48:08.306190 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 20:48:08.306190 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:08.306725 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 311/627] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 11 20:48:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:08.306725 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aafe7fd-5fa2-40e1-bb14-f184f1861c6f None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:08.314690 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 317/628] 10.222.0.40 () {56 vars in 1093 bytes} [Mon Jul 11 20:48:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:08.314690 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879380e6-5e04-42ba-a775-5f34bb135373 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:08.365394 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:08.416691 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:08.431729 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879380e6-5e04-42ba-a775-5f34bb135373 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:08.432275 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aafe7fd-5fa2-40e1-bb14-f184f1861c6f None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:08.469019 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014e660-4916-451f-a07b-ae6b277811e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:08.469830 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014e660-4916-451f-a07b-ae6b277811e4 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:08.470175 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014e660-4916-451f-a07b-ae6b277811e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:08.470400 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014e660-4916-451f-a07b-ae6b277811e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:08.470662 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a2692-559d-4ae1-a2f6-6b919965fa6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:08.471782 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a2692-559d-4ae1-a2f6-6b919965fa6c None admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:08.472379 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a2692-559d-4ae1-a2f6-6b919965fa6c None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:08.472993 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a2692-559d-4ae1-a2f6-6b919965fa6c None admin] PATH_INFO: `/v3/projects/eca3ef2561fa435e80ff451aeab14f3b/users/dc950dfb1d3b4308a33f3d430fe34c1c/roles/17bc727d82f24074aba8b1185cb99739` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:08.481617 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c014e660-4916-451f-a07b-ae6b277811e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:48:08.489241 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7a2692-559d-4ae1-a2f6-6b919965fa6c None admin] RBAC: Authorizing `identity:create_grant(project_id=eca3ef2561fa435e80ff451aeab14f3b, user_id=dc950dfb1d3b4308a33f3d430fe34c1c, role_id=17bc727d82f24074aba8b1185cb99739)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:08.489442 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-c014e660-4916-451f-a07b-ae6b277811e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:48:08.489442 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:08.489442 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:08.489442 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:08.489442 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:08.489442 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:08.489442 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:08.489442 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:08.489442 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:08.489442 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:08.489442 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:08.489442 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:08.489442 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:48:08.489442 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:48:08.489442 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:48:08.489442 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:48:08.490346 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:48:08.490346 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:48:08.490346 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:48:08.490346 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:48:08.490346 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:08.490346 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:08.490346 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:08.490346 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:08.490346 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:08.490346 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:08.490346 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:08.490346 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:08.490346 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:08.490346 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:08.490346 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:08.490346 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:08.491174 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:08.491174 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:08.491174 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:08.491174 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:08.491174 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:48:08.491174 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:48:08.491174 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:48:08.491174 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:48:08.491174 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:48:08.491174 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:48:08.491174 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:48:08.491174 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:08.491174 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 312/629] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 11 20:48:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:08.491887 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7a2692-559d-4ae1-a2f6-6b919965fa6c None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:08.496600 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014e660-4916-451f-a07b-ae6b277811e4 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:08.568007 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 318/630] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 11 20:48:08 2022] PUT /identity/v3/projects/eca3ef2561fa435e80ff451aeab14f3b/users/dc950dfb1d3b4308a33f3d430fe34c1c/roles/17bc727d82f24074aba8b1185cb99739 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:48:08.568007 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68a1da-f19a-4444-a77a-2588eb6b709c None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:08.568007 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68a1da-f19a-4444-a77a-2588eb6b709c None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:08.568007 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68a1da-f19a-4444-a77a-2588eb6b709c None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:08.568007 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 319/631] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:08.568007 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e68a1da-f19a-4444-a77a-2588eb6b709c None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:08.623692 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014e660-4916-451f-a07b-ae6b277811e4 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:08.670330 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c54552-20ab-4729-8da4-500d10549c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:08.671038 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c54552-20ab-4729-8da4-500d10549c90 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:08.671330 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c54552-20ab-4729-8da4-500d10549c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:08.671713 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c54552-20ab-4729-8da4-500d10549c90 None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:08.672630 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c54552-20ab-4729-8da4-500d10549c90 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:08.672952 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c54552-20ab-4729-8da4-500d10549c90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:08.674515 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c54552-20ab-4729-8da4-500d10549c90 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:08.692347 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:08.703390 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 313/632] 10.222.0.40 () {56 vars in 1133 bytes} [Mon Jul 11 20:48:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:08.703801 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e68a1da-f19a-4444-a77a-2588eb6b709c None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:08.705538 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da0aca-4419-4510-8fd6-602a702e2515 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:08.706087 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da0aca-4419-4510-8fd6-602a702e2515 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:08.706572 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da0aca-4419-4510-8fd6-602a702e2515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:08.712410 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:08.726442 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-76da0aca-4419-4510-8fd6-602a702e2515 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:08.728830 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-76da0aca-4419-4510-8fd6-602a702e2515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:08.752233 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5c4af-9c5d-4191-8a41-26e145479d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:08.752912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5c4af-9c5d-4191-8a41-26e145479d81 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:08.753204 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5c4af-9c5d-4191-8a41-26e145479d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:08.753487 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5c4af-9c5d-4191-8a41-26e145479d81 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:08.754247 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc5c4af-9c5d-4191-8a41-26e145479d81 None admin] RBAC: Adding query filter params (name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:08.754565 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc5c4af-9c5d-4191-8a41-26e145479d81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:08.756036 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc5c4af-9c5d-4191-8a41-26e145479d81 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:08.768278 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 320/633] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jul 11 20:48:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:08.769169 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5c4af-9c5d-4191-8a41-26e145479d81 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:08.823675 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 314/634] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:48:08.824913 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da0aca-4419-4510-8fd6-602a702e2515 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:08.911038 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5c4af-9c5d-4191-8a41-26e145479d81 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:08.944165 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da0aca-4419-4510-8fd6-602a702e2515 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:08.946434 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb086c3-669e-4200-a878-f1e24144d184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:08.948117 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb086c3-669e-4200-a878-f1e24144d184 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:08.948367 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb086c3-669e-4200-a878-f1e24144d184 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:08.948648 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb086c3-669e-4200-a878-f1e24144d184 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:08.975848 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:08.981716 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e0a44-2ec7-4145-8b88-93ffa14b2f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:08.982528 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e0a44-2ec7-4145-8b88-93ffa14b2f5e None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:08.982813 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e0a44-2ec7-4145-8b88-93ffa14b2f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:08.983093 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e0a44-2ec7-4145-8b88-93ffa14b2f5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:08.984125 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:08.994759 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e0a44-2ec7-4145-8b88-93ffa14b2f5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:08.996249 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e0a44-2ec7-4145-8b88-93ffa14b2f5e None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:09.015340 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-227e0a44-2ec7-4145-8b88-93ffa14b2f5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:09.015340 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:09.015340 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:09.015340 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:09.015340 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:09.015340 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:09.015340 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:09.015340 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:09.015340 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:09.015340 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:09.015340 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:09.015340 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:09.015340 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:09.015340 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:09.015340 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:09.016576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:09.016576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:09.016576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:09.016576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:09.016576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:09.016576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:09.016576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:09.016576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:09.016576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:09.016576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:09.016576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:09.016576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:09.016576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:09.016576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:09.016576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:09.016576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:09.016576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:09.017501 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:09.017501 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:09.017501 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:09.017501 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:09.017501 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 315/635] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:09.021924 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e0a44-2ec7-4145-8b88-93ffa14b2f5e None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:09.028433 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb086c3-669e-4200-a878-f1e24144d184 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:09.030239 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb086c3-669e-4200-a878-f1e24144d184 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:09.130908 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e0a44-2ec7-4145-8b88-93ffa14b2f5e None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:09.131804 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 321/636] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:48:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:48:09.133168 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08123990-018e-42d3-91ee-b75f96e6f03c None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:09.133487 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08123990-018e-42d3-91ee-b75f96e6f03c None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:09.134528 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08123990-018e-42d3-91ee-b75f96e6f03c None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:09.135997 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 322/637] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:09.136569 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08123990-018e-42d3-91ee-b75f96e6f03c None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:09.174957 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c2aa8-9c90-4d69-8533-97b04332abb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:09.175862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c2aa8-9c90-4d69-8533-97b04332abb3 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:09.176180 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c2aa8-9c90-4d69-8533-97b04332abb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:09.176457 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c2aa8-9c90-4d69-8533-97b04332abb3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:09.187667 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c2aa8-9c90-4d69-8533-97b04332abb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:48:09.196590 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-d22c2aa8-9c90-4d69-8533-97b04332abb3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:48:09.196590 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:09.196590 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:09.196590 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:09.196590 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:09.196590 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:09.196590 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:09.196590 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:09.196590 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:09.196590 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:09.196590 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:09.196590 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:09.196590 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:48:09.196590 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:48:09.196590 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:48:09.196590 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:48:09.197850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:48:09.197850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:48:09.197850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:48:09.197850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:48:09.197850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:09.197850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:09.197850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:09.197850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:09.197850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:09.197850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:09.197850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:09.197850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:09.197850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:09.197850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:09.197850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:09.197850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:09.198712 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:09.198712 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:09.198712 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:09.198712 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:09.198712 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:48:09.198712 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:48:09.198712 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:48:09.198712 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:48:09.198712 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:48:09.198712 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:48:09.198712 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:48:09.198712 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:09.198712 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 316/638] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 11 20:48:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:09.199776 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82dff9f-d241-4ffb-8b02-191c0008a0b7 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:09.199776 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82dff9f-d241-4ffb-8b02-191c0008a0b7 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:09.199776 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82dff9f-d241-4ffb-8b02-191c0008a0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:09.203931 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:09.217661 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-e82dff9f-d241-4ffb-8b02-191c0008a0b7 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:09.218943 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-e82dff9f-d241-4ffb-8b02-191c0008a0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:09.250156 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08123990-018e-42d3-91ee-b75f96e6f03c None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:09.264173 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:09.286232 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70152fc-acad-41a6-8fb5-915d1cfd89b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:09.286915 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70152fc-acad-41a6-8fb5-915d1cfd89b3 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:09.287208 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70152fc-acad-41a6-8fb5-915d1cfd89b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:09.287490 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70152fc-acad-41a6-8fb5-915d1cfd89b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:09.288262 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70152fc-acad-41a6-8fb5-915d1cfd89b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:09.288577 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70152fc-acad-41a6-8fb5-915d1cfd89b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:09.290710 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70152fc-acad-41a6-8fb5-915d1cfd89b3 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:09.294636 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 317/639] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:48:09.295621 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82dff9f-d241-4ffb-8b02-191c0008a0b7 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:09.312464 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 323/640] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:09.317461 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70152fc-acad-41a6-8fb5-915d1cfd89b3 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:09.411184 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82dff9f-d241-4ffb-8b02-191c0008a0b7 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:09.419339 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70152fc-acad-41a6-8fb5-915d1cfd89b3 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:09.435838 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:09.448324 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a067c8d-cb8a-49cc-bae4-ec0075623723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:09.449498 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a067c8d-cb8a-49cc-bae4-ec0075623723 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:09.449923 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a067c8d-cb8a-49cc-bae4-ec0075623723 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:09.450347 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a067c8d-cb8a-49cc-bae4-ec0075623723 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:09.452366 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b9d88-2a49-4ed2-b844-149272183a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:09.453039 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b9d88-2a49-4ed2-b844-149272183a96 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:09.453369 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b9d88-2a49-4ed2-b844-149272183a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:09.453646 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b9d88-2a49-4ed2-b844-149272183a96 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:09.454395 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b9d88-2a49-4ed2-b844-149272183a96 None admin] RBAC: Adding query filter params (name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:09.454707 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b9d88-2a49-4ed2-b844-149272183a96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:09.456133 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b9d88-2a49-4ed2-b844-149272183a96 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:09.462344 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a067c8d-cb8a-49cc-bae4-ec0075623723 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:09.464136 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a067c8d-cb8a-49cc-bae4-ec0075623723 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:09.470722 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 324/641] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jul 11 20:48:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:09.471715 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b9d88-2a49-4ed2-b844-149272183a96 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:09.482909 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-8a067c8d-cb8a-49cc-bae4-ec0075623723 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:09.482909 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:09.482909 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:09.482909 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:09.482909 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:09.482909 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:09.482909 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:09.482909 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:09.482909 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:09.482909 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:09.482909 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:09.482909 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:09.482909 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:09.482909 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:09.482909 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:09.483993 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:09.483993 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:09.483993 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:09.483993 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:09.483993 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:09.483993 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:09.483993 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:09.483993 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:09.483993 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:09.483993 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:09.483993 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:09.483993 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:09.483993 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:09.483993 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:09.483993 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:09.483993 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:09.483993 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:09.485118 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:09.485118 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:09.485118 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:09.485118 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:09.486643 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 318/642] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:09.487552 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a067c8d-cb8a-49cc-bae4-ec0075623723 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:09.518495 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:09.578983 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b9d88-2a49-4ed2-b844-149272183a96 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:09.592949 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a067c8d-cb8a-49cc-bae4-ec0075623723 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:09.614129 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e4ea1-b10b-4b75-a3b1-075f590836b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:09.614934 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e4ea1-b10b-4b75-a3b1-075f590836b3 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:09.615224 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e4ea1-b10b-4b75-a3b1-075f590836b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:09.615501 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e4ea1-b10b-4b75-a3b1-075f590836b3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:09.625176 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6e4ea1-b10b-4b75-a3b1-075f590836b3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:09.626620 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6e4ea1-b10b-4b75-a3b1-075f590836b3 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:09.628745 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9170a6-a8ac-47bb-8a66-2424fc6aa8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:09.629546 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9170a6-a8ac-47bb-8a66-2424fc6aa8f8 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:09.629830 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9170a6-a8ac-47bb-8a66-2424fc6aa8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:09.630103 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9170a6-a8ac-47bb-8a66-2424fc6aa8f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:09.640435 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9170a6-a8ac-47bb-8a66-2424fc6aa8f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:48:09.640901 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-5f6e4ea1-b10b-4b75-a3b1-075f590836b3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 20:48:09.640901 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:09.640901 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:09.640901 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:09.640901 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:09.640901 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:09.640901 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:09.640901 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:09.640901 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:09.640901 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:09.640901 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:09.640901 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:09.640901 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:48:09.640901 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:48:09.640901 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:48:09.640901 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:48:09.641861 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:09.641861 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:09.641861 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:48:09.641861 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:09.641861 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:48:09.641861 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:09.641861 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:09.641861 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:09.641861 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:09.641861 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:09.641861 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:09.641861 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:09.641861 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:09.641861 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:09.641861 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:09.641861 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:09.641861 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:09.641861 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:09.643349 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:09.643349 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:09.643349 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:48:09.643349 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:48:09.643349 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:48:09.643349 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:48:09.643349 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:48:09.643349 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:48:09.643349 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 20:48:09.643349 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:09.643349 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 325/643] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:48:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:09.643349 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e4ea1-b10b-4b75-a3b1-075f590836b3 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:09.653853 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-7a9170a6-a8ac-47bb-8a66-2424fc6aa8f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:48:09.653853 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:09.653853 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:09.653853 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:09.653853 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:09.653853 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:09.653853 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:09.653853 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:09.653853 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:09.653853 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:09.653853 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:09.653853 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:09.653853 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:48:09.653853 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:48:09.653853 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:48:09.653853 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:48:09.654848 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:48:09.654848 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:48:09.654848 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:48:09.654848 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:48:09.654848 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:09.654848 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:09.654848 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:09.654848 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:09.654848 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:09.654848 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:09.654848 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:09.654848 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:09.654848 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:09.654848 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:09.654848 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:09.654848 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:09.655770 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:09.655770 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:09.655770 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:09.655770 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:09.655770 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:48:09.655770 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:48:09.655770 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:48:09.655770 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:48:09.655770 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:48:09.655770 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:48:09.655770 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:48:09.655770 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:09.655770 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 319/644] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 11 20:48:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:09.656606 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9170a6-a8ac-47bb-8a66-2424fc6aa8f8 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:09.702536 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:09.757141 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:09.767125 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e4ea1-b10b-4b75-a3b1-075f590836b3 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:09.773750 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9170a6-a8ac-47bb-8a66-2424fc6aa8f8 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:09.806762 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbcbd12-9f1a-4213-982c-b55de2edfdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:09.807575 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcbd12-9f1a-4213-982c-b55de2edfdf7 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:09.807871 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcbd12-9f1a-4213-982c-b55de2edfdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:09.808204 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcbd12-9f1a-4213-982c-b55de2edfdf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:09.810191 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d22afc-f99c-423d-b131-abb6d9a8e4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:09.810866 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d22afc-f99c-423d-b131-abb6d9a8e4f8 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:09.811157 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d22afc-f99c-423d-b131-abb6d9a8e4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:09.811464 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d22afc-f99c-423d-b131-abb6d9a8e4f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:09.812264 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d22afc-f99c-423d-b131-abb6d9a8e4f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:09.812587 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d22afc-f99c-423d-b131-abb6d9a8e4f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:09.813963 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d22afc-f99c-423d-b131-abb6d9a8e4f8 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:09.819351 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbcbd12-9f1a-4213-982c-b55de2edfdf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:09.821835 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbcbd12-9f1a-4213-982c-b55de2edfdf7 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:09.831160 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 320/645] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:09.831160 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d22afc-f99c-423d-b131-abb6d9a8e4f8 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:09.839795 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-5dbcbd12-9f1a-4213-982c-b55de2edfdf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:09.839795 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:09.839795 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:09.839795 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:09.839795 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:09.839795 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:09.839795 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:09.839795 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:09.839795 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:09.839795 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:09.839795 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:09.839795 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:09.839795 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:09.839795 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:09.839795 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:09.841022 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:09.841022 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:09.841022 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:09.841022 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:09.841022 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:09.841022 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:09.841022 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:09.841022 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:09.841022 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:09.841022 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:09.841022 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:09.841022 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:09.841022 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:09.841022 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:09.841022 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:09.841022 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:09.841022 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:09.842135 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:09.842135 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:09.842135 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:09.842135 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:09.845632 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 326/646] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:09.846393 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbcbd12-9f1a-4213-982c-b55de2edfdf7 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:09.939862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d22afc-f99c-423d-b131-abb6d9a8e4f8 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:09.944735 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:09.953827 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbcbd12-9f1a-4213-982c-b55de2edfdf7 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:09.976316 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5b7d9-08bb-4be6-820d-5e6e4b5b0ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:09.977105 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5b7d9-08bb-4be6-820d-5e6e4b5b0ffa None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:09.977992 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5b7d9-08bb-4be6-820d-5e6e4b5b0ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:09.978270 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5b7d9-08bb-4be6-820d-5e6e4b5b0ffa None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:09.979110 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5b7d9-08bb-4be6-820d-5e6e4b5b0ffa None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:09.979429 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5b7d9-08bb-4be6-820d-5e6e4b5b0ffa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:09.980878 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5b7d9-08bb-4be6-820d-5e6e4b5b0ffa None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:09.989395 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463a9cd-bce5-4805-a338-83ae04850ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:09.990072 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463a9cd-bce5-4805-a338-83ae04850ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:09.990362 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463a9cd-bce5-4805-a338-83ae04850ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:09.990641 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463a9cd-bce5-4805-a338-83ae04850ee7 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:09.991387 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6463a9cd-bce5-4805-a338-83ae04850ee7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:09.991700 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6463a9cd-bce5-4805-a338-83ae04850ee7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:09.993195 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6463a9cd-bce5-4805-a338-83ae04850ee7 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:09.998368 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 321/647] 10.222.0.40 () {56 vars in 1137 bytes} [Mon Jul 11 20:48:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:09.999173 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5b7d9-08bb-4be6-820d-5e6e4b5b0ffa None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:10.003583 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:10.011542 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 327/648] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jul 11 20:48:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:10.011542 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463a9cd-bce5-4805-a338-83ae04850ee7 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:10.109500 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5b7d9-08bb-4be6-820d-5e6e4b5b0ffa None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:10.111879 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463a9cd-bce5-4805-a338-83ae04850ee7 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:10.144473 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34198d6-07f3-4b32-b832-4025b0880368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:10.145275 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34198d6-07f3-4b32-b832-4025b0880368 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:10.145564 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34198d6-07f3-4b32-b832-4025b0880368 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:10.145845 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34198d6-07f3-4b32-b832-4025b0880368 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:10.146111 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c016308-334b-4555-8890-758db59410e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:10.146777 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c016308-334b-4555-8890-758db59410e4 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:10.147069 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c016308-334b-4555-8890-758db59410e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:10.147358 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c016308-334b-4555-8890-758db59410e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:10.148104 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c016308-334b-4555-8890-758db59410e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:10.148449 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c016308-334b-4555-8890-758db59410e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:10.150411 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c016308-334b-4555-8890-758db59410e4 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:10.156736 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34198d6-07f3-4b32-b832-4025b0880368 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:10.158177 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34198d6-07f3-4b32-b832-4025b0880368 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:10.163369 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 328/649] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:10.164389 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c016308-334b-4555-8890-758db59410e4 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:10.172513 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-a34198d6-07f3-4b32-b832-4025b0880368 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:10.172513 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:10.172513 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:10.172513 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:10.172513 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:10.172513 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:10.172513 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:10.172513 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:10.172513 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:10.172513 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:10.172513 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:10.172513 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:10.172513 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:48:10.172513 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:48:10.172513 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:48:10.173627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:48:10.173627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:10.173627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:10.173627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:10.173627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:10.173627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:10.173627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:10.173627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:10.173627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:10.173627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:10.173627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:10.173627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:10.173627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:10.173627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:10.173627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:10.173627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:10.173627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:10.174705 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:48:10.174705 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:48:10.174705 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:48:10.174705 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:48:10.174705 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:48:10.174705 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:48:10.174705 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:10.174705 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:10.178259 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 322/650] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:48:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:10.179098 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34198d6-07f3-4b32-b832-4025b0880368 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:10.188302 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:10.249259 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:10.278039 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c016308-334b-4555-8890-758db59410e4 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:10.289281 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34198d6-07f3-4b32-b832-4025b0880368 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:10.315723 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c187c-95d7-4bf6-8dba-d10ef622c16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:10.316414 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c187c-95d7-4bf6-8dba-d10ef622c16a None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:10.316705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c187c-95d7-4bf6-8dba-d10ef622c16a None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:10.316986 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c187c-95d7-4bf6-8dba-d10ef622c16a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:10.326996 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21069cc-80ff-428c-a66f-1db62d18aa4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:10.327796 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21069cc-80ff-428c-a66f-1db62d18aa4d None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:10.328108 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21069cc-80ff-428c-a66f-1db62d18aa4d None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:10.328743 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21069cc-80ff-428c-a66f-1db62d18aa4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:10.340779 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21069cc-80ff-428c-a66f-1db62d18aa4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:10.342239 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21069cc-80ff-428c-a66f-1db62d18aa4d None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:10.360703 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-c21069cc-80ff-428c-a66f-1db62d18aa4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:10.360703 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:10.360703 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:10.360703 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:10.360703 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:10.360703 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:10.360703 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:10.360703 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:10.360703 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:10.360703 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:10.360703 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:10.360703 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:10.360703 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:10.360703 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:10.360703 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:10.361790 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:10.361790 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:10.361790 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:10.361790 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:10.361790 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:10.361790 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:10.361790 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:10.361790 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:10.361790 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:10.361790 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:10.361790 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:10.361790 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:10.361790 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:10.361790 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:10.361790 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:10.361790 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:10.361790 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:10.363132 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:10.363132 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:10.363132 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:10.363132 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:10.364040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 323/651] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:10.365027 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21069cc-80ff-428c-a66f-1db62d18aa4d None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:10.393851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c187c-95d7-4bf6-8dba-d10ef622c16a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:10.395451 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c187c-95d7-4bf6-8dba-d10ef622c16a None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:10.412246 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:10.474395 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21069cc-80ff-428c-a66f-1db62d18aa4d None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:10.491759 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:10.509654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 329/652] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:48:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:48:10.509654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c187c-95d7-4bf6-8dba-d10ef622c16a None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:10.515949 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd39db4-01e5-4c67-b478-e7203dc3cca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:10.516982 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd39db4-01e5-4c67-b478-e7203dc3cca5 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:10.517332 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd39db4-01e5-4c67-b478-e7203dc3cca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:10.517671 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd39db4-01e5-4c67-b478-e7203dc3cca5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:10.528102 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd39db4-01e5-4c67-b478-e7203dc3cca5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:10.529613 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd39db4-01e5-4c67-b478-e7203dc3cca5 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:10.545598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-5cd39db4-01e5-4c67-b478-e7203dc3cca5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 11 20:48:10.545598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:10.545598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:10.545598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:10.545598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:10.545598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:10.545598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:10.545598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:10.545598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:10.545598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:10.545598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:10.545598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:10.545598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:48:10.545598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:48:10.545598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:48:10.545598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:48:10.546601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:10.546601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:10.546601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:48:10.546601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:10.546601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:48:10.546601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:10.546601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:10.546601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:10.546601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:10.546601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:10.546601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:10.546601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:10.546601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:10.546601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:10.546601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:10.546601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:10.546601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:10.546601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:10.547833 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:10.547833 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:10.547833 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:48:10.547833 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:48:10.547833 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:48:10.547833 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:48:10.547833 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:48:10.547833 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:48:10.547833 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 11 20:48:10.547833 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:10.551636 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 324/653] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:48:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:10.552623 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd39db4-01e5-4c67-b478-e7203dc3cca5 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:10.617824 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c187c-95d7-4bf6-8dba-d10ef622c16a None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:10.634116 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:10.669245 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd39db4-01e5-4c67-b478-e7203dc3cca5 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:10.669813 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed3822-111d-4c4e-9746-fbf037e56132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:10.670580 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed3822-111d-4c4e-9746-fbf037e56132 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:10.671250 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed3822-111d-4c4e-9746-fbf037e56132 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:10.672733 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed3822-111d-4c4e-9746-fbf037e56132 None admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:10.673679 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ed3822-111d-4c4e-9746-fbf037e56132 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:10.674098 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ed3822-111d-4c4e-9746-fbf037e56132 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:10.675630 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ed3822-111d-4c4e-9746-fbf037e56132 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:10.689597 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 330/654] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 11 20:48:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:10.690554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed3822-111d-4c4e-9746-fbf037e56132 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:10.705655 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482c2f2-b60e-44dc-a46c-f84b492da2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:10.706331 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482c2f2-b60e-44dc-a46c-f84b492da2c2 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:10.706620 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482c2f2-b60e-44dc-a46c-f84b492da2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:10.706900 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482c2f2-b60e-44dc-a46c-f84b492da2c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:10.707629 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482c2f2-b60e-44dc-a46c-f84b492da2c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:10.707948 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482c2f2-b60e-44dc-a46c-f84b492da2c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:10.709343 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482c2f2-b60e-44dc-a46c-f84b492da2c2 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:10.721777 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 325/655] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:10.722571 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482c2f2-b60e-44dc-a46c-f84b492da2c2 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:10.756637 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:10.792092 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed3822-111d-4c4e-9746-fbf037e56132 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:10.819959 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482c2f2-b60e-44dc-a46c-f84b492da2c2 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:10.825808 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3320f5-6e97-4133-821f-e6de6913291f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:10.826608 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3320f5-6e97-4133-821f-e6de6913291f None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:10.826901 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3320f5-6e97-4133-821f-e6de6913291f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:10.827183 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3320f5-6e97-4133-821f-e6de6913291f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:10.837851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3320f5-6e97-4133-821f-e6de6913291f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:10.839836 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3320f5-6e97-4133-821f-e6de6913291f None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:10.856148 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4133c3f-2dd3-4a9a-873c-fb249419b981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:10.856819 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4133c3f-2dd3-4a9a-873c-fb249419b981 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:10.857010 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-4c3320f5-6e97-4133-821f-e6de6913291f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:10.857010 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:10.857010 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:10.857010 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:10.857010 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:10.857010 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:10.857010 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:10.857010 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:10.857010 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:10.857010 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:10.857010 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:10.857010 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:10.857010 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:10.857010 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:10.857010 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:10.858051 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:10.858051 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:10.858051 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:10.858051 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:10.858051 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:10.858051 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:10.858051 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:10.858051 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:10.858051 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:10.858051 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:10.858051 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:10.858051 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:10.858051 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:10.858051 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:10.858051 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:10.858051 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:10.858051 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:10.859303 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:10.859303 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:10.859303 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:10.859303 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:10.859532 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4133c3f-2dd3-4a9a-873c-fb249419b981 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:10.859532 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4133c3f-2dd3-4a9a-873c-fb249419b981 None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:10.859532 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4133c3f-2dd3-4a9a-873c-fb249419b981 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:10.859532 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4133c3f-2dd3-4a9a-873c-fb249419b981 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:10.859793 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 331/656] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:10.859862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4133c3f-2dd3-4a9a-873c-fb249419b981 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:10.859959 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13593864-2e51-4a7f-97ae-ac22489110b4 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:10.860272 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13593864-2e51-4a7f-97ae-ac22489110b4 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:10.860551 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13593864-2e51-4a7f-97ae-ac22489110b4 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:10.861798 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 332/657] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:10.862953 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13593864-2e51-4a7f-97ae-ac22489110b4 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:10.879007 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 326/658] 10.222.0.40 () {56 vars in 1137 bytes} [Mon Jul 11 20:48:10 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:10.879875 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4133c3f-2dd3-4a9a-873c-fb249419b981 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:10.892164 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:10.968040 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13593864-2e51-4a7f-97ae-ac22489110b4 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:10.973798 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:10.981010 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4133c3f-2dd3-4a9a-873c-fb249419b981 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:11.001435 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e2b73-8d81-48f3-8b91-b32194d78db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:11.002093 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e2b73-8d81-48f3-8b91-b32194d78db6 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:11.002376 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e2b73-8d81-48f3-8b91-b32194d78db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:11.002651 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e2b73-8d81-48f3-8b91-b32194d78db6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:11.003464 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e2b73-8d81-48f3-8b91-b32194d78db6 None admin] RBAC: Adding query filter params (role.id=17bc727d82f24074aba8b1185cb99739, scope.project.id=eca3ef2561fa435e80ff451aeab14f3b, user.id=8ac15411c75f4bd4a86f6753c9240a5b) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:11.003776 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e2b73-8d81-48f3-8b91-b32194d78db6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:11.005232 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e2b73-8d81-48f3-8b91-b32194d78db6 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:11.011140 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 333/659] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:48:10 2022] GET /identity/v3/role_assignments?user.id=8ac15411c75f4bd4a86f6753c9240a5b&scope.project.id=eca3ef2561fa435e80ff451aeab14f3b&role.id=17bc727d82f24074aba8b1185cb99739 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:11.011923 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e2b73-8d81-48f3-8b91-b32194d78db6 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:11.028802 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb8124-ff7f-470a-990d-68f8d1fedaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:11.029641 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb8124-ff7f-470a-990d-68f8d1fedaca None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:11.029925 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb8124-ff7f-470a-990d-68f8d1fedaca None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:11.030253 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb8124-ff7f-470a-990d-68f8d1fedaca None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:11.038479 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb8124-ff7f-470a-990d-68f8d1fedaca None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:11.040990 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb8124-ff7f-470a-990d-68f8d1fedaca None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:11.056085 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-9dcb8124-ff7f-470a-990d-68f8d1fedaca None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 20:48:11.056085 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:11.056085 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:11.056085 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:11.056085 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:11.056085 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:11.056085 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:11.056085 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:11.056085 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:11.056085 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:11.056085 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:11.056085 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:11.056085 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:48:11.056085 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:48:11.056085 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:48:11.056085 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:48:11.057138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:11.057138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:11.057138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:48:11.057138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:11.057138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:48:11.057138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:11.057138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:11.057138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:11.057138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:11.057138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:11.057138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:11.057138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:11.057138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:11.057138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:11.057138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:11.057138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:11.057138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:11.057138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:11.058117 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:11.058117 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:11.058117 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:48:11.058117 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:48:11.058117 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:48:11.058117 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:48:11.058117 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:48:11.058117 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:48:11.058117 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 20:48:11.058117 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:11.058117 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 327/660] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 11 20:48:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:11.059432 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d3ed6-1c28-4ce7-9ecd-cbb0b49f611d None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:11.059432 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d3ed6-1c28-4ce7-9ecd-cbb0b49f611d None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:11.059432 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d3ed6-1c28-4ce7-9ecd-cbb0b49f611d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:11.085193 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-f32d3ed6-1c28-4ce7-9ecd-cbb0b49f611d None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:11.086550 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-f32d3ed6-1c28-4ce7-9ecd-cbb0b49f611d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:11.121075 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:11.132402 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e2b73-8d81-48f3-8b91-b32194d78db6 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:11.171860 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 328/661] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:48:11.173613 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d3ed6-1c28-4ce7-9ecd-cbb0b49f611d None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:11.180947 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80df617-8fcc-47bc-85f5-ff8f5669639d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:11.181936 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80df617-8fcc-47bc-85f5-ff8f5669639d None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:11.182495 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80df617-8fcc-47bc-85f5-ff8f5669639d None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:11.182785 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80df617-8fcc-47bc-85f5-ff8f5669639d None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:11.183523 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80df617-8fcc-47bc-85f5-ff8f5669639d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:11.183840 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80df617-8fcc-47bc-85f5-ff8f5669639d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:11.185292 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80df617-8fcc-47bc-85f5-ff8f5669639d None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:11.197631 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 334/662] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:11.198323 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80df617-8fcc-47bc-85f5-ff8f5669639d None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:11.285491 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:11.301108 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d3ed6-1c28-4ce7-9ecd-cbb0b49f611d None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:11.316257 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80df617-8fcc-47bc-85f5-ff8f5669639d None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:11.339646 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450b3ad-8d45-4255-8e6f-d8ac32113709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:11.340348 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450b3ad-8d45-4255-8e6f-d8ac32113709 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:11.340643 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450b3ad-8d45-4255-8e6f-d8ac32113709 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:11.340923 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450b3ad-8d45-4255-8e6f-d8ac32113709 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:11.356052 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a017f860-899d-42d3-9cbf-ed97f8d3a210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:11.356893 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017f860-899d-42d3-9cbf-ed97f8d3a210 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:11.357539 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017f860-899d-42d3-9cbf-ed97f8d3a210 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:11.357832 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017f860-899d-42d3-9cbf-ed97f8d3a210 None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:11.358947 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a017f860-899d-42d3-9cbf-ed97f8d3a210 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:11.359263 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a017f860-899d-42d3-9cbf-ed97f8d3a210 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:11.361188 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a017f860-899d-42d3-9cbf-ed97f8d3a210 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:11.387918 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 335/663] 10.222.0.40 () {56 vars in 1139 bytes} [Mon Jul 11 20:48:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:11.387918 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a017f860-899d-42d3-9cbf-ed97f8d3a210 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:11.399593 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:11.414254 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450b3ad-8d45-4255-8e6f-d8ac32113709 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:11.416131 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450b3ad-8d45-4255-8e6f-d8ac32113709 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:11.496597 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a017f860-899d-42d3-9cbf-ed97f8d3a210 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:11.506031 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:11.523131 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 329/664] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:48:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:48:11.524886 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450b3ad-8d45-4255-8e6f-d8ac32113709 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:11.542182 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f04ed-0b00-43b7-afd8-28cba7c73ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:11.543056 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f04ed-0b00-43b7-afd8-28cba7c73ddb None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:11.543497 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f04ed-0b00-43b7-afd8-28cba7c73ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:11.543776 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f04ed-0b00-43b7-afd8-28cba7c73ddb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:11.552810 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f04ed-0b00-43b7-afd8-28cba7c73ddb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:11.554930 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f04ed-0b00-43b7-afd8-28cba7c73ddb None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:11.572790 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-cc2f04ed-0b00-43b7-afd8-28cba7c73ddb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:11.572790 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:11.572790 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:11.572790 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:11.572790 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:11.572790 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:11.572790 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:11.572790 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:11.572790 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:11.572790 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:11.572790 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:11.572790 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:11.572790 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:48:11.572790 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:48:11.572790 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:48:11.573991 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:48:11.573991 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:11.573991 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:11.573991 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:11.573991 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:11.573991 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:11.573991 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:11.573991 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:11.573991 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:11.573991 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:11.573991 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:11.573991 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:11.573991 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:11.573991 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:11.573991 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:11.573991 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:11.573991 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:11.574994 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:48:11.574994 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:48:11.574994 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:48:11.574994 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:48:11.574994 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:48:11.574994 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:48:11.574994 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:11.574994 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:11.574994 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 336/665] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:48:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:11.574994 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f04ed-0b00-43b7-afd8-28cba7c73ddb None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:11.637268 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450b3ad-8d45-4255-8e6f-d8ac32113709 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:11.643019 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:11.684204 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f04ed-0b00-43b7-afd8-28cba7c73ddb None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:11.685585 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595cc7c-e821-4c0d-b3a6-74255dd783c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:11.686496 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595cc7c-e821-4c0d-b3a6-74255dd783c0 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:11.686889 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595cc7c-e821-4c0d-b3a6-74255dd783c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:11.687279 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595cc7c-e821-4c0d-b3a6-74255dd783c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:11.698767 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9595cc7c-e821-4c0d-b3a6-74255dd783c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:48:11.706601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-9595cc7c-e821-4c0d-b3a6-74255dd783c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:48:11.706601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:11.706601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:11.706601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:11.706601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:11.706601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:11.706601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:11.706601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:11.706601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:11.706601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:11.706601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:11.706601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:11.706601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:48:11.706601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:48:11.706601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:48:11.706601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:48:11.707722 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:48:11.707722 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:48:11.707722 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:48:11.707722 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:48:11.707722 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:11.707722 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:11.707722 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:11.707722 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:11.707722 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:11.707722 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:11.707722 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:11.707722 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:11.707722 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:11.707722 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:11.707722 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:11.707722 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:11.708819 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:11.708819 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:11.708819 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:11.708819 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:11.708819 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:48:11.708819 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:48:11.708819 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:48:11.708819 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:48:11.708819 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:48:11.708819 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:48:11.708819 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:48:11.708819 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:11.709550 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 330/666] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 11 20:48:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:11.710189 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595cc7c-e821-4c0d-b3a6-74255dd783c0 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:11.728746 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e34f5-02fb-4cb5-90e0-d0e062d5ce92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:11.729418 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e34f5-02fb-4cb5-90e0-d0e062d5ce92 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:11.729715 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e34f5-02fb-4cb5-90e0-d0e062d5ce92 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:11.729995 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e34f5-02fb-4cb5-90e0-d0e062d5ce92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:11.761345 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:11.805499 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032e34f5-02fb-4cb5-90e0-d0e062d5ce92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:11.807277 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032e34f5-02fb-4cb5-90e0-d0e062d5ce92 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:11.824659 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595cc7c-e821-4c0d-b3a6-74255dd783c0 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:11.862834 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3ac94a-d3f4-4758-8007-c542488c5fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:11.863906 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ac94a-d3f4-4758-8007-c542488c5fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:11.864477 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ac94a-d3f4-4758-8007-c542488c5fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:11.864783 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ac94a-d3f4-4758-8007-c542488c5fa4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:11.877045 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3ac94a-d3f4-4758-8007-c542488c5fa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:11.878487 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3ac94a-d3f4-4758-8007-c542488c5fa4 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:11.879293 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:11.898370 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-3d3ac94a-d3f4-4758-8007-c542488c5fa4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:11.898370 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:11.898370 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:11.898370 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:11.898370 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:11.898370 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:11.898370 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:11.898370 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:11.898370 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:11.898370 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:11.898370 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:11.898370 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:11.898370 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:11.898370 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:11.898370 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:11.900407 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:11.900407 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:11.900407 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:11.900407 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:11.900407 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:11.900407 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:11.900407 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:11.900407 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:11.900407 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:11.900407 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:11.900407 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:11.900407 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:11.900407 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:11.900407 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:11.900407 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:11.900407 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:11.900407 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:11.901527 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:11.901527 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:11.901527 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:11.901527 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:11.904929 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 331/667] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:11.905766 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3ac94a-d3f4-4758-8007-c542488c5fa4 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:11.921666 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 337/668] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:48:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:48:11.921666 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e34f5-02fb-4cb5-90e0-d0e062d5ce92 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:12.004097 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:12.010219 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3ac94a-d3f4-4758-8007-c542488c5fa4 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:12.043585 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e34f5-02fb-4cb5-90e0-d0e062d5ce92 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:12.048400 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ed462-ac33-4114-a8e0-8cca4e509818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:12.049080 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ed462-ac33-4114-a8e0-8cca4e509818 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:12.049369 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ed462-ac33-4114-a8e0-8cca4e509818 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:12.049650 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ed462-ac33-4114-a8e0-8cca4e509818 None admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:12.050445 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ed462-ac33-4114-a8e0-8cca4e509818 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:12.050767 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ed462-ac33-4114-a8e0-8cca4e509818 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:12.052221 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ed462-ac33-4114-a8e0-8cca4e509818 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:12.064826 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 332/669] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 11 20:48:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:12.069859 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ed462-ac33-4114-a8e0-8cca4e509818 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:12.092394 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c6e51-3f0a-4513-9dc3-0b6a5ef9fd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:12.093346 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c6e51-3f0a-4513-9dc3-0b6a5ef9fd4c None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:12.093653 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c6e51-3f0a-4513-9dc3-0b6a5ef9fd4c None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:12.093936 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c6e51-3f0a-4513-9dc3-0b6a5ef9fd4c None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:12.095079 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c6e51-3f0a-4513-9dc3-0b6a5ef9fd4c None admin] RBAC: Adding query filter params (name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:12.095917 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c6e51-3f0a-4513-9dc3-0b6a5ef9fd4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:12.098872 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c6e51-3f0a-4513-9dc3-0b6a5ef9fd4c None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:12.113813 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 338/670] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jul 11 20:48:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:12.113813 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c6e51-3f0a-4513-9dc3-0b6a5ef9fd4c None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:12.143514 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:12.177018 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ed462-ac33-4114-a8e0-8cca4e509818 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:12.214903 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541cbc0-5169-4b67-9299-3854233f21a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:12.215766 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541cbc0-5169-4b67-9299-3854233f21a9 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:12.216180 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541cbc0-5169-4b67-9299-3854233f21a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:12.216296 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c6e51-3f0a-4513-9dc3-0b6a5ef9fd4c None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:12.216651 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541cbc0-5169-4b67-9299-3854233f21a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:12.217472 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3541cbc0-5169-4b67-9299-3854233f21a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:12.217948 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3541cbc0-5169-4b67-9299-3854233f21a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:12.219407 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3541cbc0-5169-4b67-9299-3854233f21a9 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:12.235479 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 333/671] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:12.235479 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541cbc0-5169-4b67-9299-3854233f21a9 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:12.250928 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:12.259353 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73adb6ff-ff82-4288-a2a1-7b4fdbf336a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:12.260419 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73adb6ff-ff82-4288-a2a1-7b4fdbf336a4 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:12.267017 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73adb6ff-ff82-4288-a2a1-7b4fdbf336a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:12.267017 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73adb6ff-ff82-4288-a2a1-7b4fdbf336a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:12.271638 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73adb6ff-ff82-4288-a2a1-7b4fdbf336a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:12.273135 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73adb6ff-ff82-4288-a2a1-7b4fdbf336a4 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:12.292328 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-73adb6ff-ff82-4288-a2a1-7b4fdbf336a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:12.292328 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:12.292328 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:12.292328 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:12.292328 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:12.292328 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:12.292328 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:12.292328 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:12.292328 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:12.292328 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:12.292328 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:12.292328 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:12.292328 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:12.292328 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:12.292328 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:12.293408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:12.293408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:12.293408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:12.293408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:12.293408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:12.293408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:12.293408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:12.293408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:12.293408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:12.293408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:12.293408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:12.293408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:12.293408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:12.293408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:12.293408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:12.293408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:12.293408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:12.294490 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:12.294490 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:12.294490 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:12.294490 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:12.295738 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 339/672] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:12.296612 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73adb6ff-ff82-4288-a2a1-7b4fdbf336a4 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:12.349087 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541cbc0-5169-4b67-9299-3854233f21a9 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:12.382706 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:12.387929 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e13e90-2e76-4f81-b43d-262a0f987ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:12.388799 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e13e90-2e76-4f81-b43d-262a0f987ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:12.389087 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e13e90-2e76-4f81-b43d-262a0f987ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:12.389368 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e13e90-2e76-4f81-b43d-262a0f987ea1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:12.390197 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e13e90-2e76-4f81-b43d-262a0f987ea1 None admin] RBAC: Adding query filter params (role.id=17bc727d82f24074aba8b1185cb99739, scope.project.id=eca3ef2561fa435e80ff451aeab14f3b, user.id=e4ae1169746141bc8993707b12cacd80) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:12.390511 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e13e90-2e76-4f81-b43d-262a0f987ea1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:12.391920 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e13e90-2e76-4f81-b43d-262a0f987ea1 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:12.408327 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 334/673] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:48:12 2022] GET /identity/v3/role_assignments?user.id=e4ae1169746141bc8993707b12cacd80&scope.project.id=eca3ef2561fa435e80ff451aeab14f3b&role.id=17bc727d82f24074aba8b1185cb99739 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:12.408327 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e13e90-2e76-4f81-b43d-262a0f987ea1 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:12.414150 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73adb6ff-ff82-4288-a2a1-7b4fdbf336a4 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:12.464997 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c0726-74cb-4e49-8b6b-101375f46805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:12.466535 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c0726-74cb-4e49-8b6b-101375f46805 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:12.466827 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c0726-74cb-4e49-8b6b-101375f46805 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:12.467109 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c0726-74cb-4e49-8b6b-101375f46805 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:12.481842 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8c0726-74cb-4e49-8b6b-101375f46805 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:12.485519 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8c0726-74cb-4e49-8b6b-101375f46805 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:12.495177 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:12.514532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-6c8c0726-74cb-4e49-8b6b-101375f46805 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:12.514532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:12.514532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:12.514532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:12.514532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:12.514532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:12.514532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:12.514532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:12.514532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:12.514532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:12.514532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:12.514532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:12.514532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:12.514532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:12.514532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:12.515669 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:12.515669 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:12.515669 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:12.515669 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:12.515669 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:12.515669 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:12.515669 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:12.515669 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:12.515669 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:12.515669 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:12.515669 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:12.515669 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:12.515669 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:12.515669 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:12.515669 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:12.515669 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:12.515669 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:12.516792 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:12.516792 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:12.516792 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:12.516792 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:12.519426 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 340/674] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:12.520528 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c0726-74cb-4e49-8b6b-101375f46805 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:12.520732 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e13e90-2e76-4f81-b43d-262a0f987ea1 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:12.564335 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d8e5f-0404-44f6-bdd6-048b59b481d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:12.565148 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d8e5f-0404-44f6-bdd6-048b59b481d0 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:12.565441 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d8e5f-0404-44f6-bdd6-048b59b481d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:12.565726 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d8e5f-0404-44f6-bdd6-048b59b481d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:12.574684 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d8e5f-0404-44f6-bdd6-048b59b481d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:12.576277 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d8e5f-0404-44f6-bdd6-048b59b481d0 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:12.595084 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-8f7d8e5f-0404-44f6-bdd6-048b59b481d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:12.595084 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:12.595084 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:12.595084 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:12.595084 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:12.595084 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:12.595084 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:12.595084 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:12.595084 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:12.595084 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:12.595084 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:12.595084 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:12.595084 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:48:12.595084 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:48:12.595084 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:48:12.596059 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:48:12.596059 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:12.596059 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:12.596059 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:12.596059 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:12.596059 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:12.596059 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:12.596059 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:12.596059 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:12.596059 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:12.596059 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:12.596059 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:12.596059 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:12.596059 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:12.596059 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:12.596059 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:12.596059 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:12.597436 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:48:12.597436 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:48:12.597436 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:48:12.597436 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:48:12.597436 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:48:12.597436 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:48:12.597436 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:12.597436 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:12.597436 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 335/675] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:48:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:12.597436 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d8e5f-0404-44f6-bdd6-048b59b481d0 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:12.679993 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c0726-74cb-4e49-8b6b-101375f46805 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:12.710785 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d763d-c7c6-4df7-ba01-b48907005044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:12.711478 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d763d-c7c6-4df7-ba01-b48907005044 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:12.711843 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d763d-c7c6-4df7-ba01-b48907005044 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:12.712212 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d763d-c7c6-4df7-ba01-b48907005044 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:12.713209 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d763d-c7c6-4df7-ba01-b48907005044 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:12.713650 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d763d-c7c6-4df7-ba01-b48907005044 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:12.715319 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d763d-c7c6-4df7-ba01-b48907005044 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:12.724327 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:12.728644 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 341/676] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:12.729673 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d763d-c7c6-4df7-ba01-b48907005044 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:12.734632 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d8e5f-0404-44f6-bdd6-048b59b481d0 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:12.778938 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f2cf9-e9b4-408b-ae0a-dbe4c6a92fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:12.779868 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f2cf9-e9b4-408b-ae0a-dbe4c6a92fcd None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:12.780307 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f2cf9-e9b4-408b-ae0a-dbe4c6a92fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:12.780702 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f2cf9-e9b4-408b-ae0a-dbe4c6a92fcd None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:12.781538 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301f2cf9-e9b4-408b-ae0a-dbe4c6a92fcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:12.782036 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301f2cf9-e9b4-408b-ae0a-dbe4c6a92fcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:12.783619 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301f2cf9-e9b4-408b-ae0a-dbe4c6a92fcd None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:12.793689 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:12.798077 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 336/677] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:12.798984 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f2cf9-e9b4-408b-ae0a-dbe4c6a92fcd None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:12.861370 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d763d-c7c6-4df7-ba01-b48907005044 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:12.910988 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e36159-bae9-4c26-9528-d6a039a60f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:12.912105 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e36159-bae9-4c26-9528-d6a039a60f75 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:12.912526 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e36159-bae9-4c26-9528-d6a039a60f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:12.913612 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e36159-bae9-4c26-9528-d6a039a60f75 None admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:12.914559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e36159-bae9-4c26-9528-d6a039a60f75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:12.916329 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e36159-bae9-4c26-9528-d6a039a60f75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:12.918043 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e36159-bae9-4c26-9528-d6a039a60f75 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:12.920022 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f2cf9-e9b4-408b-ae0a-dbe4c6a92fcd None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:12.937321 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 342/678] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 11 20:48:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:12.938392 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e36159-bae9-4c26-9528-d6a039a60f75 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:12.966032 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda8957-b28a-4cc6-92fc-dba2062f3c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:12.966761 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda8957-b28a-4cc6-92fc-dba2062f3c5a None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:12.967044 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda8957-b28a-4cc6-92fc-dba2062f3c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:12.967321 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda8957-b28a-4cc6-92fc-dba2062f3c5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:12.974722 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda8957-b28a-4cc6-92fc-dba2062f3c5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:12.976182 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda8957-b28a-4cc6-92fc-dba2062f3c5a None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:12.990929 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-0dda8957-b28a-4cc6-92fc-dba2062f3c5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:12.990929 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:12.990929 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:12.990929 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:12.990929 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:12.990929 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:12.990929 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:12.990929 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:12.990929 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:12.990929 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:12.990929 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:12.990929 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:12.990929 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:48:12.990929 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:48:12.990929 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:48:12.992080 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:48:12.992080 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:12.992080 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:12.992080 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:12.992080 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:12.992080 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:12.992080 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:12.992080 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:12.992080 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:12.992080 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:12.992080 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:12.992080 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:12.992080 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:12.992080 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:12.992080 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:12.992080 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:12.992080 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:12.993619 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:48:12.993619 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:48:12.993619 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:48:12.993619 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:48:12.993619 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:48:12.993619 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:48:12.993619 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:12.993619 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:12.993619 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 337/679] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:48:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:12.993619 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda8957-b28a-4cc6-92fc-dba2062f3c5a None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:13.032409 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:13.055312 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:13.060261 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e36159-bae9-4c26-9528-d6a039a60f75 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:13.097160 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619c433-6de6-4ad8-8425-eae9779d889a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:13.102858 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda8957-b28a-4cc6-92fc-dba2062f3c5a None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:13.102993 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619c433-6de6-4ad8-8425-eae9779d889a None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:13.102993 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619c433-6de6-4ad8-8425-eae9779d889a None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:13.102993 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619c433-6de6-4ad8-8425-eae9779d889a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:13.106987 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f619c433-6de6-4ad8-8425-eae9779d889a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:13.108492 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f619c433-6de6-4ad8-8425-eae9779d889a None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:13.126980 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-f619c433-6de6-4ad8-8425-eae9779d889a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 20:48:13.126980 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:13.126980 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:13.126980 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:13.126980 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:13.126980 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:13.126980 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:13.126980 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:13.126980 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:13.126980 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:13.126980 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:13.126980 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:13.126980 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:48:13.126980 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:48:13.126980 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:48:13.126980 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:48:13.128257 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:13.128257 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:13.128257 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:48:13.128257 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:13.128257 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:48:13.128257 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:13.128257 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:13.128257 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:13.128257 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:13.128257 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:13.128257 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:13.128257 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:13.128257 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:13.128257 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:13.128257 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:13.128257 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:13.128257 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:13.128257 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:13.129683 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:13.129683 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:13.129683 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:48:13.129683 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:48:13.129683 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:48:13.129683 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:48:13.129683 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:48:13.129683 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:48:13.129683 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 20:48:13.129683 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:13.129683 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 343/680] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 11 20:48:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:13.129683 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619c433-6de6-4ad8-8425-eae9779d889a None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:13.136920 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11d099-4023-4649-aba1-70998e6385fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:13.137596 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11d099-4023-4649-aba1-70998e6385fd None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:13.137880 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11d099-4023-4649-aba1-70998e6385fd None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:13.138158 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11d099-4023-4649-aba1-70998e6385fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:13.138994 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11d099-4023-4649-aba1-70998e6385fd None admin] RBAC: Adding query filter params (role.id=17bc727d82f24074aba8b1185cb99739, scope.project.id=eca3ef2561fa435e80ff451aeab14f3b, user.id=da488c75631e4e5992304ff6c0579aab) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:13.139310 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11d099-4023-4649-aba1-70998e6385fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:13.140753 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11d099-4023-4649-aba1-70998e6385fd None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:13.152109 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 338/681] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:48:12 2022] GET /identity/v3/role_assignments?user.id=da488c75631e4e5992304ff6c0579aab&scope.project.id=eca3ef2561fa435e80ff451aeab14f3b&role.id=17bc727d82f24074aba8b1185cb99739 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:13.153076 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11d099-4023-4649-aba1-70998e6385fd None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:13.264723 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619c433-6de6-4ad8-8425-eae9779d889a None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:13.288391 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:13.288597 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11d099-4023-4649-aba1-70998e6385fd None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:13.317100 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:13.319021 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a214b2a-4621-4b59-b9f4-8ea27b01c22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:13.328940 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a214b2a-4621-4b59-b9f4-8ea27b01c22b None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:13.328940 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a214b2a-4621-4b59-b9f4-8ea27b01c22b None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:13.328940 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a214b2a-4621-4b59-b9f4-8ea27b01c22b None admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:13.328940 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a214b2a-4621-4b59-b9f4-8ea27b01c22b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:13.328940 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a214b2a-4621-4b59-b9f4-8ea27b01c22b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:13.328940 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a214b2a-4621-4b59-b9f4-8ea27b01c22b None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:13.329373 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160d8b6-a25b-483d-95d8-5535b43cdc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:13.330028 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160d8b6-a25b-483d-95d8-5535b43cdc30 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:13.330313 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160d8b6-a25b-483d-95d8-5535b43cdc30 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:13.330589 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160d8b6-a25b-483d-95d8-5535b43cdc30 None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:13.331430 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160d8b6-a25b-483d-95d8-5535b43cdc30 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:13.331739 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160d8b6-a25b-483d-95d8-5535b43cdc30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:13.335312 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160d8b6-a25b-483d-95d8-5535b43cdc30 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:13.342678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 344/682] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 11 20:48:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:13.342678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ee455-0424-46fa-ac5e-76a550ed62a8 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:13.342678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ee455-0424-46fa-ac5e-76a550ed62a8 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:13.342678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ee455-0424-46fa-ac5e-76a550ed62a8 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:13.343866 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 345/683] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:13.348575 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ee455-0424-46fa-ac5e-76a550ed62a8 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:13.356760 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 339/684] 10.222.0.40 () {56 vars in 1135 bytes} [Mon Jul 11 20:48:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:13.358133 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a71363-8849-4bcf-86d0-47ca280c6545 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:13.358497 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a71363-8849-4bcf-86d0-47ca280c6545 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:13.358848 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a71363-8849-4bcf-86d0-47ca280c6545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:13.377164 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-20a71363-8849-4bcf-86d0-47ca280c6545 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:13.378631 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-20a71363-8849-4bcf-86d0-47ca280c6545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:13.465744 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 340/685] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:48:13.467037 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a71363-8849-4bcf-86d0-47ca280c6545 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:13.477259 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ee455-0424-46fa-ac5e-76a550ed62a8 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:13.518798 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf5232-cd48-4535-bd55-ced2c8b397df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:13.519523 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf5232-cd48-4535-bd55-ced2c8b397df None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:13.519803 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf5232-cd48-4535-bd55-ced2c8b397df None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:13.520153 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf5232-cd48-4535-bd55-ced2c8b397df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:13.521653 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf5232-cd48-4535-bd55-ced2c8b397df None admin] RBAC: Adding query filter params (role.id=17bc727d82f24074aba8b1185cb99739, scope.project.id=eca3ef2561fa435e80ff451aeab14f3b, user.id=29046b079f1a4f4ea2244e69cbbaa805) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:13.521653 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf5232-cd48-4535-bd55-ced2c8b397df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:13.522894 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf5232-cd48-4535-bd55-ced2c8b397df None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:13.530420 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 346/686] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:48:13 2022] GET /identity/v3/role_assignments?user.id=29046b079f1a4f4ea2244e69cbbaa805&scope.project.id=eca3ef2561fa435e80ff451aeab14f3b&role.id=17bc727d82f24074aba8b1185cb99739 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:13.531235 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf5232-cd48-4535-bd55-ced2c8b397df None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:13.607606 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a71363-8849-4bcf-86d0-47ca280c6545 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:13.620018 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:13.627778 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:13.658202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d9fc9-277f-4c8e-9686-417348a04fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:13.659281 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d9fc9-277f-4c8e-9686-417348a04fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:13.659790 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d9fc9-277f-4c8e-9686-417348a04fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:13.660324 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d9fc9-277f-4c8e-9686-417348a04fc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:13.749189 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d9fc9-277f-4c8e-9686-417348a04fc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:13.751784 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d9fc9-277f-4c8e-9686-417348a04fc5 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:13.805571 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf5232-cd48-4535-bd55-ced2c8b397df None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:13.849223 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b236805-a4b8-408b-b00a-9038e73480b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:13.850034 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b236805-a4b8-408b-b00a-9038e73480b7 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:13.850324 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b236805-a4b8-408b-b00a-9038e73480b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:13.850602 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b236805-a4b8-408b-b00a-9038e73480b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:13.866022 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b236805-a4b8-408b-b00a-9038e73480b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:48:13.877672 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-1b236805-a4b8-408b-b00a-9038e73480b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:48:13.877672 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:13.877672 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:13.877672 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:13.877672 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:13.877672 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:13.877672 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:13.877672 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:13.877672 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:13.877672 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:13.877672 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:13.877672 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:13.877672 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:48:13.877672 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:48:13.877672 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:48:13.877672 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:48:13.878636 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:48:13.878636 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:48:13.878636 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:48:13.878636 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:48:13.878636 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:13.878636 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:13.878636 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:13.878636 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:13.878636 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:13.878636 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:13.878636 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:13.878636 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:13.878636 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:13.878636 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:13.878636 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:13.878636 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:13.879483 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:13.879483 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:13.879483 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:13.879483 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:13.879483 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:48:13.879483 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:48:13.879483 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:48:13.879483 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:48:13.879483 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:48:13.879483 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:48:13.879483 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:48:13.879483 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:13.879483 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 347/687] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 11 20:48:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:13.885715 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b236805-a4b8-408b-b00a-9038e73480b7 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:13.887688 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 341/688] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:48:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 20:48:13.893866 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d9fc9-277f-4c8e-9686-417348a04fc5 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:13.917191 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:14.015514 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d9fc9-277f-4c8e-9686-417348a04fc5 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:14.027513 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:14.033236 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b236805-a4b8-408b-b00a-9038e73480b7 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:14.064927 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b2d62-e0f2-4dcc-981a-b89924709a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:14.066373 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b2d62-e0f2-4dcc-981a-b89924709a0a None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:14.066890 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b2d62-e0f2-4dcc-981a-b89924709a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:14.067554 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b2d62-e0f2-4dcc-981a-b89924709a0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:14.091093 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b2d62-e0f2-4dcc-981a-b89924709a0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:14.092591 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b2d62-e0f2-4dcc-981a-b89924709a0a None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:14.097006 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e649b-1399-40c6-b917-92c56328d730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:14.097753 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e649b-1399-40c6-b917-92c56328d730 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:14.098173 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e649b-1399-40c6-b917-92c56328d730 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:14.098596 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e649b-1399-40c6-b917-92c56328d730 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:14.101586 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e649b-1399-40c6-b917-92c56328d730 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:14.101586 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e649b-1399-40c6-b917-92c56328d730 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:14.104188 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e649b-1399-40c6-b917-92c56328d730 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:14.125686 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-f88b2d62-e0f2-4dcc-981a-b89924709a0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:14.125686 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:14.125686 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:14.125686 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:14.125686 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:14.125686 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:14.125686 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:14.125686 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:14.125686 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:14.125686 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:14.125686 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:14.125686 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:14.125686 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:14.125686 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:14.125686 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:14.126665 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:14.126665 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:14.126665 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:14.126665 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:14.126665 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:14.126665 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:14.126665 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:14.126665 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:14.126665 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:14.126665 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:14.126665 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:14.126665 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:14.126665 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:14.126665 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:14.126665 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:14.126665 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:14.126665 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:14.127587 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:14.127587 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:14.127587 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:14.127587 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:14.127587 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 342/689] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:14.129117 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 348/690] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:48:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:14.135100 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e649b-1399-40c6-b917-92c56328d730 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:14.136104 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b2d62-e0f2-4dcc-981a-b89924709a0a None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:14.291958 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e649b-1399-40c6-b917-92c56328d730 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:14.295205 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:14.341488 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b05249-e2e9-4c8f-a88b-2ff2b781b8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:14.342084 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b05249-e2e9-4c8f-a88b-2ff2b781b8e7 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:14.342372 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b05249-e2e9-4c8f-a88b-2ff2b781b8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:14.342654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b05249-e2e9-4c8f-a88b-2ff2b781b8e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:14.343379 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b05249-e2e9-4c8f-a88b-2ff2b781b8e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:14.343692 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b05249-e2e9-4c8f-a88b-2ff2b781b8e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:14.345095 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b05249-e2e9-4c8f-a88b-2ff2b781b8e7 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:14.369768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b2d62-e0f2-4dcc-981a-b89924709a0a None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:14.375522 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 349/691] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:14.380999 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b05249-e2e9-4c8f-a88b-2ff2b781b8e7 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:14.410176 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:14.439537 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb801bd-1a3a-464a-99d4-3f3a41b866b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:14.440751 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb801bd-1a3a-464a-99d4-3f3a41b866b8 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:14.441250 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb801bd-1a3a-464a-99d4-3f3a41b866b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:14.441754 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb801bd-1a3a-464a-99d4-3f3a41b866b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:14.463603 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb801bd-1a3a-464a-99d4-3f3a41b866b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:14.465437 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb801bd-1a3a-464a-99d4-3f3a41b866b8 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:14.500075 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b05249-e2e9-4c8f-a88b-2ff2b781b8e7 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:14.504494 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-ceb801bd-1a3a-464a-99d4-3f3a41b866b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:14.504494 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:14.504494 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:14.504494 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:14.504494 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:14.504494 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:14.504494 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:14.504494 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:14.504494 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:14.504494 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:14.504494 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:14.504494 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:14.504494 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:14.504494 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:14.504494 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:14.505382 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:14.505382 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:14.505382 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:14.505382 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:14.505382 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:14.505382 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:14.505382 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:14.505382 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:14.505382 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:14.505382 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:14.505382 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:14.505382 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:14.505382 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:14.505382 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:14.505382 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:14.505382 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:14.505382 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:14.506383 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:14.506383 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:14.506383 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:14.506383 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:14.509549 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 343/692] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:14.514331 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb801bd-1a3a-464a-99d4-3f3a41b866b8 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:14.539504 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ac5fd-3515-4287-ae4e-ab3ae5daab2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:14.543085 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ac5fd-3515-4287-ae4e-ab3ae5daab2d None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:14.544354 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ac5fd-3515-4287-ae4e-ab3ae5daab2d None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:14.545054 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ac5fd-3515-4287-ae4e-ab3ae5daab2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:14.560933 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ac5fd-3515-4287-ae4e-ab3ae5daab2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:14.563663 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ac5fd-3515-4287-ae4e-ab3ae5daab2d None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:14.582964 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-c02ac5fd-3515-4287-ae4e-ab3ae5daab2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:14.582964 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:14.582964 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:14.582964 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:14.582964 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:14.582964 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:14.582964 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:14.582964 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:14.582964 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:14.582964 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:14.582964 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:14.582964 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:14.582964 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:48:14.582964 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:48:14.582964 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:48:14.583912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:48:14.583912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:14.583912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:14.583912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:14.583912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:14.583912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:14.583912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:14.583912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:14.583912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:14.583912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:14.583912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:14.583912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:14.583912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:14.583912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:14.583912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:14.583912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:14.583912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:14.584836 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:48:14.584836 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:48:14.584836 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:48:14.584836 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:48:14.584836 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:48:14.584836 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:48:14.584836 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:14.584836 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:14.587958 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 350/693] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:48:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:48:14.593365 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ac5fd-3515-4287-ae4e-ab3ae5daab2d None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:14.679237 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb801bd-1a3a-464a-99d4-3f3a41b866b8 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:14.703747 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:14.714276 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:14.733189 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155dde61-293d-49cb-b2ee-439b3d68271d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:14.733792 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155dde61-293d-49cb-b2ee-439b3d68271d None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:14.734079 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155dde61-293d-49cb-b2ee-439b3d68271d None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:14.734357 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155dde61-293d-49cb-b2ee-439b3d68271d None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:14.735083 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155dde61-293d-49cb-b2ee-439b3d68271d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:14.735394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155dde61-293d-49cb-b2ee-439b3d68271d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:14.736946 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155dde61-293d-49cb-b2ee-439b3d68271d None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:14.741635 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ac5fd-3515-4287-ae4e-ab3ae5daab2d None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:14.750762 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 344/694] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:14.752262 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f45ff-4622-4e2d-bc41-b5e7d0243343 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:14.752556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f45ff-4622-4e2d-bc41-b5e7d0243343 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:14.760097 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f45ff-4622-4e2d-bc41-b5e7d0243343 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:14.760097 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 345/695] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:14.760097 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f45ff-4622-4e2d-bc41-b5e7d0243343 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:14.792148 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c178c0-591c-4e32-8eef-99ea9fb9d3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:14.793406 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c178c0-591c-4e32-8eef-99ea9fb9d3a6 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:14.793885 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c178c0-591c-4e32-8eef-99ea9fb9d3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:14.794567 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c178c0-591c-4e32-8eef-99ea9fb9d3a6 None admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:14.796248 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c178c0-591c-4e32-8eef-99ea9fb9d3a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:14.796856 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c178c0-591c-4e32-8eef-99ea9fb9d3a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:14.798802 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c178c0-591c-4e32-8eef-99ea9fb9d3a6 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:14.817163 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 351/696] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 11 20:48:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:14.818707 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5db820-66c9-46bf-9393-cbad1a15c9fc None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:14.819171 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5db820-66c9-46bf-9393-cbad1a15c9fc None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:14.819619 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5db820-66c9-46bf-9393-cbad1a15c9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:14.843202 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-8b5db820-66c9-46bf-9393-cbad1a15c9fc None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:14.845266 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-8b5db820-66c9-46bf-9393-cbad1a15c9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:14.883094 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f45ff-4622-4e2d-bc41-b5e7d0243343 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:14.921462 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ffdf5-bff8-4ee3-a5fb-be464acbe59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:14.922390 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ffdf5-bff8-4ee3-a5fb-be464acbe59f None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:14.922819 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ffdf5-bff8-4ee3-a5fb-be464acbe59f None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:14.923160 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ffdf5-bff8-4ee3-a5fb-be464acbe59f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:14.932857 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ffdf5-bff8-4ee3-a5fb-be464acbe59f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:14.934449 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ffdf5-bff8-4ee3-a5fb-be464acbe59f None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:14.937902 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 352/697] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:48:14.938948 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5db820-66c9-46bf-9393-cbad1a15c9fc None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:14.960204 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-d69ffdf5-bff8-4ee3-a5fb-be464acbe59f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 20:48:14.960204 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:14.960204 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:14.960204 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:14.960204 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:14.960204 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:14.960204 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:14.960204 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:14.960204 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:14.960204 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:14.960204 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:14.960204 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:14.960204 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:48:14.960204 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:48:14.960204 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:48:14.960204 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:48:14.961202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:14.961202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:14.961202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:48:14.961202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:14.961202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:48:14.961202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:14.961202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:14.961202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:14.961202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:14.961202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:14.961202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:14.961202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:14.961202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:14.961202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:14.961202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:14.961202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:14.961202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:14.961202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:14.962863 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:14.962863 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:14.962863 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:48:14.962863 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:48:14.962863 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:48:14.962863 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:48:14.962863 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:48:14.962863 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:48:14.962863 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 20:48:14.962863 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:14.965670 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 346/698] 10.222.0.40 () {56 vars in 1093 bytes} [Mon Jul 11 20:48:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:14.966755 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ffdf5-bff8-4ee3-a5fb-be464acbe59f None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:15.006356 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:15.041121 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:15.083727 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5db820-66c9-46bf-9393-cbad1a15c9fc None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:15.090635 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ffdf5-bff8-4ee3-a5fb-be464acbe59f None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:15.128095 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960128f-5b23-4099-abed-e748fdb3e735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:15.129076 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960128f-5b23-4099-abed-e748fdb3e735 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:15.129334 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960128f-5b23-4099-abed-e748fdb3e735 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:15.129715 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960128f-5b23-4099-abed-e748fdb3e735 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:15.130672 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b960128f-5b23-4099-abed-e748fdb3e735 None admin] RBAC: Adding query filter params (role.id=17bc727d82f24074aba8b1185cb99739, scope.project.id=eca3ef2561fa435e80ff451aeab14f3b, user.id=dc950dfb1d3b4308a33f3d430fe34c1c) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:15.131095 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b960128f-5b23-4099-abed-e748fdb3e735 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:15.132830 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b960128f-5b23-4099-abed-e748fdb3e735 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:15.138384 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83edae9c-5028-47a6-9711-c4ba35fadb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:15.139395 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edae9c-5028-47a6-9711-c4ba35fadb45 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:15.139840 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edae9c-5028-47a6-9711-c4ba35fadb45 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:15.140276 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edae9c-5028-47a6-9711-c4ba35fadb45 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:15.141089 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83edae9c-5028-47a6-9711-c4ba35fadb45 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:15.142589 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83edae9c-5028-47a6-9711-c4ba35fadb45 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:15.144218 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 353/699] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:48:14 2022] GET /identity/v3/role_assignments?user.id=dc950dfb1d3b4308a33f3d430fe34c1c&scope.project.id=eca3ef2561fa435e80ff451aeab14f3b&role.id=17bc727d82f24074aba8b1185cb99739 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:15.145384 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960128f-5b23-4099-abed-e748fdb3e735 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:15.159523 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-83edae9c-5028-47a6-9711-c4ba35fadb45 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 20:48:15.159523 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:15.159523 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:48:15.159523 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:48:15.159523 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:48:15.159523 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:48:15.159523 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:48:15.159523 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:15.159523 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 20:48:15.159523 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:15.159523 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:48:15.159523 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:15.159523 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:15.159523 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:15.159523 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:15.159523 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:15.160821 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:15.160821 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:15.160821 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:15.160821 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:15.160821 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:15.160821 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:15.160821 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:15.160821 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:48:15.160821 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:48:15.160821 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:48:15.160821 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:48:15.160821 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:15.160821 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:15.160821 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:15.160821 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:15.160821 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:15.161698 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:15.161698 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:15.161698 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:15.161698 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:15.161698 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:15.161698 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:15.161698 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:15.161698 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:15.161698 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:15.161698 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:15.161698 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:15.161698 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:48:15.161698 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:15.161698 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 20:48:15.161698 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:15.165744 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 347/700] 10.222.0.40 () {56 vars in 1129 bytes} [Mon Jul 11 20:48:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:15.171824 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83edae9c-5028-47a6-9711-c4ba35fadb45 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:15.285779 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83edae9c-5028-47a6-9711-c4ba35fadb45 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:15.290637 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:15.326244 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac2a1b-9d12-4978-a544-84001fc18142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:15.327412 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac2a1b-9d12-4978-a544-84001fc18142 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:15.327912 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac2a1b-9d12-4978-a544-84001fc18142 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:15.328446 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac2a1b-9d12-4978-a544-84001fc18142 None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:15.329377 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac2a1b-9d12-4978-a544-84001fc18142 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:15.329899 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac2a1b-9d12-4978-a544-84001fc18142 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:15.331508 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac2a1b-9d12-4978-a544-84001fc18142 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:15.338612 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 348/701] 10.222.0.40 () {56 vars in 1124 bytes} [Mon Jul 11 20:48:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:15.344431 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960128f-5b23-4099-abed-e748fdb3e735 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:15.344956 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac2a1b-9d12-4978-a544-84001fc18142 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:15.407033 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ff6b3-3866-4be5-985d-0c450a12fa02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:15.407797 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ff6b3-3866-4be5-985d-0c450a12fa02 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:15.408046 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ff6b3-3866-4be5-985d-0c450a12fa02 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:15.408330 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ff6b3-3866-4be5-985d-0c450a12fa02 None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:15.409204 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ff6b3-3866-4be5-985d-0c450a12fa02 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:15.409485 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ff6b3-3866-4be5-985d-0c450a12fa02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:15.411118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ff6b3-3866-4be5-985d-0c450a12fa02 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:15.413106 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:15.445782 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 354/702] 10.222.0.40 () {56 vars in 1133 bytes} [Mon Jul 11 20:48:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:15.451124 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ff6b3-3866-4be5-985d-0c450a12fa02 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:15.458637 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac2a1b-9d12-4978-a544-84001fc18142 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:15.497178 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80bbd6b-4a7f-4be9-b8df-f4da3da9ff40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:15.498233 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bbd6b-4a7f-4be9-b8df-f4da3da9ff40 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:15.498729 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bbd6b-4a7f-4be9-b8df-f4da3da9ff40 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:15.499242 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bbd6b-4a7f-4be9-b8df-f4da3da9ff40 None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:15.500497 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80bbd6b-4a7f-4be9-b8df-f4da3da9ff40 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:15.501029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80bbd6b-4a7f-4be9-b8df-f4da3da9ff40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:15.502655 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80bbd6b-4a7f-4be9-b8df-f4da3da9ff40 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:15.509747 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 349/703] 10.222.0.40 () {56 vars in 1124 bytes} [Mon Jul 11 20:48:15 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:15.516002 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a48cb-eac2-4246-960a-0801bd63026a None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:15.518302 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a48cb-eac2-4246-960a-0801bd63026a None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:15.518814 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a48cb-eac2-4246-960a-0801bd63026a None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:15.520882 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 350/704] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:15 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:15.526963 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23729b6-b376-4f8a-a5c0-9da31a8fe56c None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:15.527656 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23729b6-b376-4f8a-a5c0-9da31a8fe56c None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:15.528196 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23729b6-b376-4f8a-a5c0-9da31a8fe56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:15.558606 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-c23729b6-b376-4f8a-a5c0-9da31a8fe56c None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:15.559859 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c23729b6-b376-4f8a-a5c0-9da31a8fe56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:15.593176 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:15.599069 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ff6b3-3866-4be5-985d-0c450a12fa02 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:15.650575 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b22d4d-eac2-44c6-8f11-5163f4232ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:15.651274 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b22d4d-eac2-44c6-8f11-5163f4232ebf None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:15.651596 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b22d4d-eac2-44c6-8f11-5163f4232ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:15.652462 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b22d4d-eac2-44c6-8f11-5163f4232ebf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:15.654776 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 351/705] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:48:15.687068 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23729b6-b376-4f8a-a5c0-9da31a8fe56c None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:15.753064 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:15.767420 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b22d4d-eac2-44c6-8f11-5163f4232ebf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:15.770392 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b22d4d-eac2-44c6-8f11-5163f4232ebf None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:15.821785 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23729b6-b376-4f8a-a5c0-9da31a8fe56c None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:15.863357 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef598eb4-0c73-4782-976f-79e26084d3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:15.864621 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef598eb4-0c73-4782-976f-79e26084d3f2 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:15.865106 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef598eb4-0c73-4782-976f-79e26084d3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:15.865619 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef598eb4-0c73-4782-976f-79e26084d3f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:15.877750 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef598eb4-0c73-4782-976f-79e26084d3f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:15.879627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef598eb4-0c73-4782-976f-79e26084d3f2 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:15.900435 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 355/706] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:48:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 20:48:15.901453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-ef598eb4-0c73-4782-976f-79e26084d3f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:15.901453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:15.901453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:15.901453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:15.901453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:15.901453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:15.901453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:15.901453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:15.901453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:15.901453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:15.901453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:15.901453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:15.901453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:15.901453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:15.901453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:15.902373 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:15.902373 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:15.902373 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:15.902373 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:15.902373 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:15.902373 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:15.902373 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:15.902373 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:15.902373 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:15.902373 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:15.902373 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:15.902373 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:15.902373 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:15.902373 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:15.902373 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:15.902373 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:15.902373 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:15.903300 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:15.903300 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:15.903300 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:15.903300 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:15.909789 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 352/707] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:48:15.910558 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b22d4d-eac2-44c6-8f11-5163f4232ebf None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:15.935958 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef598eb4-0c73-4782-976f-79e26084d3f2 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:15.950318 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:16.051265 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef598eb4-0c73-4782-976f-79e26084d3f2 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:16.068962 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:16.079933 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b22d4d-eac2-44c6-8f11-5163f4232ebf None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:16.090442 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee97cb-06b6-4ae9-bb65-9cef9841ee30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:16.091438 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee97cb-06b6-4ae9-bb65-9cef9841ee30 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:16.091939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee97cb-06b6-4ae9-bb65-9cef9841ee30 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:16.092531 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee97cb-06b6-4ae9-bb65-9cef9841ee30 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:16.093586 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee97cb-06b6-4ae9-bb65-9cef9841ee30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:16.094157 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee97cb-06b6-4ae9-bb65-9cef9841ee30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:16.095793 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee97cb-06b6-4ae9-bb65-9cef9841ee30 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:16.109173 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 353/708] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:16.114905 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee97cb-06b6-4ae9-bb65-9cef9841ee30 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:16.149943 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda6d88-272e-449a-ab92-20f00a884bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:16.150628 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda6d88-272e-449a-ab92-20f00a884bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:16.150917 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda6d88-272e-449a-ab92-20f00a884bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:16.151198 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda6d88-272e-449a-ab92-20f00a884bb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:16.174054 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda6d88-272e-449a-ab92-20f00a884bb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:16.175485 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda6d88-272e-449a-ab92-20f00a884bb1 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:16.209123 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-4cda6d88-272e-449a-ab92-20f00a884bb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:16.209123 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:16.209123 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:16.209123 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:16.209123 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:16.209123 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:16.209123 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:16.209123 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:16.209123 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:16.209123 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:16.209123 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:16.209123 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:16.209123 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:16.209123 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:16.209123 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:16.210089 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:16.210089 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:16.210089 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:16.210089 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:16.210089 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:16.210089 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:16.210089 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:16.210089 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:16.210089 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:16.210089 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:16.210089 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:16.210089 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:16.210089 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:16.210089 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:16.210089 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:16.210089 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:16.210089 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:16.210976 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:16.210976 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:16.210976 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:16.210976 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:16.210976 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 356/709] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:16.217773 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:16.219435 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a1f4f-5b01-4759-acdf-ab59e96ef63c None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:16.220438 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a1f4f-5b01-4759-acdf-ab59e96ef63c None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:16.220716 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a1f4f-5b01-4759-acdf-ab59e96ef63c None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:16.222223 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 357/710] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:16.226380 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a1f4f-5b01-4759-acdf-ab59e96ef63c None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:16.261322 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee97cb-06b6-4ae9-bb65-9cef9841ee30 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:16.301813 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ed2ec-9b34-46ee-b512-76c36b811566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:16.302840 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ed2ec-9b34-46ee-b512-76c36b811566 None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:16.303455 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ed2ec-9b34-46ee-b512-76c36b811566 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:16.303944 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ed2ec-9b34-46ee-b512-76c36b811566 None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:16.305091 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996ed2ec-9b34-46ee-b512-76c36b811566 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:16.307294 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996ed2ec-9b34-46ee-b512-76c36b811566 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:16.348317 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a1f4f-5b01-4759-acdf-ab59e96ef63c None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:16.385612 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7983bc-5f73-4669-a278-f59061bcc007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:16.386286 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7983bc-5f73-4669-a278-f59061bcc007 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:16.386588 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7983bc-5f73-4669-a278-f59061bcc007 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:16.386852 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7983bc-5f73-4669-a278-f59061bcc007 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:16.387567 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7983bc-5f73-4669-a278-f59061bcc007 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:16.387881 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7983bc-5f73-4669-a278-f59061bcc007 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:16.389280 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7983bc-5f73-4669-a278-f59061bcc007 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:16.400313 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 354/711] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jul 11 20:48:16 2022] POST /identity/v3/users => generated 254 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 20:48:16.401890 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 358/712] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:16.402196 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff19a7-cd1d-462c-8169-ac97f527f500 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:16.402504 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff19a7-cd1d-462c-8169-ac97f527f500 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:16.402851 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff19a7-cd1d-462c-8169-ac97f527f500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:16.417818 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7983bc-5f73-4669-a278-f59061bcc007 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:16.423660 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-06ff19a7-cd1d-462c-8169-ac97f527f500 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:16.426172 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:16.427510 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-06ff19a7-cd1d-462c-8169-ac97f527f500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:16.526566 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 355/713] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:48:16.556414 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff19a7-cd1d-462c-8169-ac97f527f500 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:16.605585 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7983bc-5f73-4669-a278-f59061bcc007 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:16.636442 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:16.642766 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e69140-35d6-404f-9369-8abc5dd8b307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:16.643516 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e69140-35d6-404f-9369-8abc5dd8b307 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:16.643764 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e69140-35d6-404f-9369-8abc5dd8b307 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:16.644085 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e69140-35d6-404f-9369-8abc5dd8b307 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:16.653119 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e69140-35d6-404f-9369-8abc5dd8b307 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:16.654578 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e69140-35d6-404f-9369-8abc5dd8b307 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:16.670382 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-c3e69140-35d6-404f-9369-8abc5dd8b307 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:16.670382 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:16.670382 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:16.670382 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:16.670382 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:16.670382 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:16.670382 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:16.670382 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:16.670382 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:16.670382 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:16.670382 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:16.670382 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:16.670382 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:48:16.670382 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:48:16.670382 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:48:16.671259 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:48:16.671259 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:16.671259 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:16.671259 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:16.671259 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:16.671259 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:16.671259 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:16.671259 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:16.671259 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:16.671259 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:16.671259 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:16.671259 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:16.671259 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:16.671259 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:16.671259 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:16.671259 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:16.671259 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:16.672323 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:48:16.672323 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:48:16.672323 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:48:16.672323 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:48:16.672323 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:48:16.672323 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:48:16.672323 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:16.672323 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:16.672763 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 359/714] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:48:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:48:16.677719 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e69140-35d6-404f-9369-8abc5dd8b307 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:16.706428 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff19a7-cd1d-462c-8169-ac97f527f500 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:16.752656 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:16.757367 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c6457-da57-4020-b98b-f5d3f746ad01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:16.759594 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c6457-da57-4020-b98b-f5d3f746ad01 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:16.760218 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c6457-da57-4020-b98b-f5d3f746ad01 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:16.760673 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c6457-da57-4020-b98b-f5d3f746ad01 None admin] PATH_INFO: `/v3/services/network` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:16.761697 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c6457-da57-4020-b98b-f5d3f746ad01 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:16.764084 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c6457-da57-4020-b98b-f5d3f746ad01 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:16.780687 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-9b9c6457-da57-4020-b98b-f5d3f746ad01 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 20:48:16.780687 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:16.780687 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:48:16.780687 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:48:16.780687 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:48:16.780687 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:48:16.780687 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:48:16.780687 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:16.780687 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 20:48:16.780687 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:16.780687 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:48:16.780687 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:16.780687 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:16.780687 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:16.780687 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:16.780687 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:16.780687 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:16.781731 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:16.781731 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:16.781731 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:16.781731 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:16.781731 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:16.781731 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:16.781731 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:48:16.781731 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:48:16.781731 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:48:16.781731 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:48:16.781731 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:16.781731 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:16.781731 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:16.781731 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:16.781731 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:16.781731 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:16.782578 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:16.782578 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:16.782578 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:16.782578 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:16.782578 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:16.782578 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:16.782578 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:16.782578 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:16.782578 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:16.782578 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:16.782578 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:48:16.782578 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:16.782578 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 20:48:16.782578 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:16.785538 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 356/715] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:48:16 2022] GET /identity/v3/services/network => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:16.791723 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c6457-da57-4020-b98b-f5d3f746ad01 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:16.813764 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e69140-35d6-404f-9369-8abc5dd8b307 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:16.861628 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe639622-de13-47fd-a14a-2907f95b079d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:16.862685 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe639622-de13-47fd-a14a-2907f95b079d None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:16.863462 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe639622-de13-47fd-a14a-2907f95b079d None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:16.863962 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe639622-de13-47fd-a14a-2907f95b079d None admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:16.865640 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe639622-de13-47fd-a14a-2907f95b079d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:16.866441 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe639622-de13-47fd-a14a-2907f95b079d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:16.869271 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe639622-de13-47fd-a14a-2907f95b079d None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:16.887506 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 360/716] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 11 20:48:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:16.893115 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe639622-de13-47fd-a14a-2907f95b079d None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:16.922120 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c6457-da57-4020-b98b-f5d3f746ad01 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:16.948044 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:16.982110 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659d4bb-7c1f-44fb-bdda-ac16274bf67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:16.983039 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659d4bb-7c1f-44fb-bdda-ac16274bf67d None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:16.984520 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659d4bb-7c1f-44fb-bdda-ac16274bf67d None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:16.985394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659d4bb-7c1f-44fb-bdda-ac16274bf67d None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:16.987946 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659d4bb-7c1f-44fb-bdda-ac16274bf67d None admin] RBAC: Adding query filter params (name=network) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:16.988450 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659d4bb-7c1f-44fb-bdda-ac16274bf67d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:16.989971 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659d4bb-7c1f-44fb-bdda-ac16274bf67d None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:17.002747 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 357/717] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Jul 11 20:48:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:17.008328 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659d4bb-7c1f-44fb-bdda-ac16274bf67d None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:17.064935 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe639622-de13-47fd-a14a-2907f95b079d None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:17.091658 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:17.113427 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c698935-8b0f-4ce3-9648-e77ce4380eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:17.114107 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c698935-8b0f-4ce3-9648-e77ce4380eda None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:17.114394 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c698935-8b0f-4ce3-9648-e77ce4380eda None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:17.114674 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c698935-8b0f-4ce3-9648-e77ce4380eda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:17.115511 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c698935-8b0f-4ce3-9648-e77ce4380eda None admin] RBAC: Adding query filter params (role.id=86273ff072f3438d822e870272491768, scope.project.id=eca3ef2561fa435e80ff451aeab14f3b, user.id=8ac15411c75f4bd4a86f6753c9240a5b) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:17.115829 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c698935-8b0f-4ce3-9648-e77ce4380eda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:17.117318 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c698935-8b0f-4ce3-9648-e77ce4380eda None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:17.138888 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 361/718] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:48:16 2022] GET /identity/v3/role_assignments?user.id=8ac15411c75f4bd4a86f6753c9240a5b&scope.project.id=eca3ef2561fa435e80ff451aeab14f3b&role.id=86273ff072f3438d822e870272491768 => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:17.168798 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659d4bb-7c1f-44fb-bdda-ac16274bf67d None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:17.226774 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f46b25-f169-4605-b9ed-5a31529b5dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:17.227655 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f46b25-f169-4605-b9ed-5a31529b5dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:17.228333 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f46b25-f169-4605-b9ed-5a31529b5dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:17.228333 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f46b25-f169-4605-b9ed-5a31529b5dd9 None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:17.229049 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f46b25-f169-4605-b9ed-5a31529b5dd9 None admin] RBAC: Adding query filter params (type=network) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:17.229367 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f46b25-f169-4605-b9ed-5a31529b5dd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:17.230778 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f46b25-f169-4605-b9ed-5a31529b5dd9 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:17.236231 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 358/719] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Jul 11 20:48:17 2022] GET /identity/v3/services?type=network => generated 124 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:17.951252 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a052b-7763-4297-a6c9-770898683dfb None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:17.951750 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a052b-7763-4297-a6c9-770898683dfb None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:17.951827 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a052b-7763-4297-a6c9-770898683dfb None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:17.953440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 362/720] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:17.958353 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044428ea-a6dc-470f-bafe-f98c7959646b None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:17.958741 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044428ea-a6dc-470f-bafe-f98c7959646b None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:17.958904 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044428ea-a6dc-470f-bafe-f98c7959646b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:17.980459 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-044428ea-a6dc-470f-bafe-f98c7959646b None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:17.981651 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-044428ea-a6dc-470f-bafe-f98c7959646b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:17.984309 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e3df3-eb0e-485b-a962-d9b5dfafc1e9 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:17.984611 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e3df3-eb0e-485b-a962-d9b5dfafc1e9 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:17.984899 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e3df3-eb0e-485b-a962-d9b5dfafc1e9 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:17.986492 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 363/721] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:17.991657 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33418c1-2b10-4b1d-9445-a3bc217cf003 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:17.991953 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33418c1-2b10-4b1d-9445-a3bc217cf003 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:17.992267 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33418c1-2b10-4b1d-9445-a3bc217cf003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:18.017006 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-e33418c1-2b10-4b1d-9445-a3bc217cf003 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:18.018207 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-e33418c1-2b10-4b1d-9445-a3bc217cf003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:18.060352 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:18.104801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 359/722] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:48:18.126655 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 364/723] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 20:48:18.152255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044428ea-a6dc-470f-bafe-f98c7959646b None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:18.155685 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33418c1-2b10-4b1d-9445-a3bc217cf003 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:18.279391 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33418c1-2b10-4b1d-9445-a3bc217cf003 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:18.298216 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:18.316348 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00e5a0-be2b-4a36-97c9-4a51533f4af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:18.317034 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00e5a0-be2b-4a36-97c9-4a51533f4af5 None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:18.317327 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00e5a0-be2b-4a36-97c9-4a51533f4af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:18.317611 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00e5a0-be2b-4a36-97c9-4a51533f4af5 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:18.318345 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de00e5a0-be2b-4a36-97c9-4a51533f4af5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:18.319726 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de00e5a0-be2b-4a36-97c9-4a51533f4af5 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:18.354479 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044428ea-a6dc-470f-bafe-f98c7959646b None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:18.392821 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed5ae7-627b-49fe-8cf4-c586089b5eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:18.393668 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed5ae7-627b-49fe-8cf4-c586089b5eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:18.393958 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed5ae7-627b-49fe-8cf4-c586089b5eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:18.394239 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed5ae7-627b-49fe-8cf4-c586089b5eb1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:18.406637 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed5ae7-627b-49fe-8cf4-c586089b5eb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:48:18.420683 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 365/724] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Jul 11 20:48:18 2022] POST /identity/v3/services => generated 251 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:48:18.423040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-5aed5ae7-627b-49fe-8cf4-c586089b5eb1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:48:18.423040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:18.423040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:18.423040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:18.423040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:18.423040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:18.423040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:18.423040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:18.423040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:18.423040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:18.423040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:18.423040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:18.423040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:48:18.423040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:48:18.423040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:48:18.423040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:48:18.424374 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:48:18.424374 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:48:18.424374 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:48:18.424374 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:48:18.424374 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:18.424374 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:18.424374 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:18.424374 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:18.424374 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:18.424374 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:18.424374 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:18.424374 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:18.424374 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:18.424374 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:18.424374 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:18.424374 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:18.425579 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:18.425579 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:18.425579 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:18.425579 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:18.425579 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:48:18.425579 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:48:18.425579 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:48:18.425579 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:48:18.425579 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:48:18.425579 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:48:18.425579 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:48:18.425579 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:18.425579 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 360/725] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 11 20:48:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:18.431470 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00e5a0-be2b-4a36-97c9-4a51533f4af5 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:18.568876 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00e5a0-be2b-4a36-97c9-4a51533f4af5 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:18.614720 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55554441-9b57-47f2-b74a-0054057588f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:18.615440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55554441-9b57-47f2-b74a-0054057588f3 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:18.615730 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55554441-9b57-47f2-b74a-0054057588f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:18.616035 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55554441-9b57-47f2-b74a-0054057588f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:18.616835 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55554441-9b57-47f2-b74a-0054057588f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:18.617215 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55554441-9b57-47f2-b74a-0054057588f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:18.618840 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55554441-9b57-47f2-b74a-0054057588f3 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:18.633027 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 366/726] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:48:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:18.638942 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed5ae7-627b-49fe-8cf4-c586089b5eb1 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:18.694135 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:18.757555 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed5ae7-627b-49fe-8cf4-c586089b5eb1 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:18.793628 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b233878-b2db-42c6-99ae-c3400ab51af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:18.794500 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b233878-b2db-42c6-99ae-c3400ab51af2 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:18.794787 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b233878-b2db-42c6-99ae-c3400ab51af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:18.795067 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b233878-b2db-42c6-99ae-c3400ab51af2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:18.806326 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b233878-b2db-42c6-99ae-c3400ab51af2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:18.807772 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b233878-b2db-42c6-99ae-c3400ab51af2 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:18.825935 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-1b233878-b2db-42c6-99ae-c3400ab51af2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:18.825935 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:18.825935 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:18.825935 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:18.825935 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:18.825935 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:18.825935 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:18.825935 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:18.825935 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:18.825935 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:18.825935 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:18.825935 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:18.825935 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:18.825935 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:18.825935 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:18.826832 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:18.826832 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:18.826832 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:18.826832 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:18.826832 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:18.826832 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:18.826832 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:18.826832 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:18.826832 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:18.826832 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:18.826832 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:18.826832 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:18.826832 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:18.826832 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:18.826832 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:18.826832 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:18.826832 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:18.827727 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:18.827727 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:18.827727 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:18.827727 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:18.827727 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 361/727] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:18.832946 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55554441-9b57-47f2-b74a-0054057588f3 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:18.871771 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:18.945286 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55554441-9b57-47f2-b74a-0054057588f3 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:18.985663 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b203a-8ba3-48cf-b22b-e73465ea1acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:18.986415 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b203a-8ba3-48cf-b22b-e73465ea1acf None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:18.986612 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b203a-8ba3-48cf-b22b-e73465ea1acf None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:18.986895 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b203a-8ba3-48cf-b22b-e73465ea1acf None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:18.987620 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b203a-8ba3-48cf-b22b-e73465ea1acf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:18.987944 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b203a-8ba3-48cf-b22b-e73465ea1acf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:18.989337 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b203a-8ba3-48cf-b22b-e73465ea1acf None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:19.006258 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 367/728] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:19.012233 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b233878-b2db-42c6-99ae-c3400ab51af2 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:19.089424 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12416673-f23c-4195-8eb4-0421d0ecd643 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:19.089734 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12416673-f23c-4195-8eb4-0421d0ecd643 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:19.089922 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12416673-f23c-4195-8eb4-0421d0ecd643 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:19.091420 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 368/729] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:48:19.105866 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18f927-594a-4f28-9f82-077d35a6fb45 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:19.106168 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18f927-594a-4f28-9f82-077d35a6fb45 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:19.106434 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18f927-594a-4f28-9f82-077d35a6fb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:19.128341 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:19.134692 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-5d18f927-594a-4f28-9f82-077d35a6fb45 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:19.135923 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-5d18f927-594a-4f28-9f82-077d35a6fb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:19.146532 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b233878-b2db-42c6-99ae-c3400ab51af2 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:19.210811 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7581ab4e-7231-4451-b53f-e04db4cdcbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:19.212195 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581ab4e-7231-4451-b53f-e04db4cdcbef None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:19.212489 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581ab4e-7231-4451-b53f-e04db4cdcbef None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:19.212766 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581ab4e-7231-4451-b53f-e04db4cdcbef None admin] PATH_INFO: `/v3/users/swift` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:19.226512 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7581ab4e-7231-4451-b53f-e04db4cdcbef None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:19.229705 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7581ab4e-7231-4451-b53f-e04db4cdcbef None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:19.246856 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-7581ab4e-7231-4451-b53f-e04db4cdcbef None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 20:48:19.246856 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:19.246856 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:19.246856 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:19.246856 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:19.246856 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:19.246856 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:19.246856 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:19.246856 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:19.246856 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:19.246856 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:19.246856 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:19.246856 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:48:19.246856 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:48:19.246856 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:48:19.246856 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:48:19.247862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:19.247862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:19.247862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:48:19.247862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:19.247862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:48:19.247862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:19.247862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:19.247862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:19.247862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:19.247862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:19.247862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:19.247862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:19.247862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:19.247862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:19.247862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:19.247862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:19.247862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:19.247862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:19.248876 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:19.248876 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:19.248876 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:48:19.248876 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:48:19.248876 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:48:19.248876 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:48:19.248876 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:48:19.248876 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:48:19.248876 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 20:48:19.248876 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:19.248876 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 362/730] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 11 20:48:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:19.254420 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7581ab4e-7231-4451-b53f-e04db4cdcbef None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:19.281873 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 369/731] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:19 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:48:19.329012 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d18f927-594a-4f28-9f82-077d35a6fb45 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:19.361576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7581ab4e-7231-4451-b53f-e04db4cdcbef None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:19.385765 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:19.399710 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb3e31-64d3-477c-9c54-48fe5ab8b01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:19.400848 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb3e31-64d3-477c-9c54-48fe5ab8b01d None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:19.401287 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb3e31-64d3-477c-9c54-48fe5ab8b01d None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:19.401717 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb3e31-64d3-477c-9c54-48fe5ab8b01d None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:19.402711 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddb3e31-64d3-477c-9c54-48fe5ab8b01d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:19.403203 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddb3e31-64d3-477c-9c54-48fe5ab8b01d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:19.404923 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddb3e31-64d3-477c-9c54-48fe5ab8b01d None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:19.424917 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 363/732] 10.222.0.40 () {56 vars in 1135 bytes} [Mon Jul 11 20:48:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:19.434254 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb3e31-64d3-477c-9c54-48fe5ab8b01d None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:19.452323 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:19.520291 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d18f927-594a-4f28-9f82-077d35a6fb45 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:19.567813 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e63c8b-62fd-4daf-b583-f5c2c0358d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:19.569044 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e63c8b-62fd-4daf-b583-f5c2c0358d3b None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:19.571386 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e63c8b-62fd-4daf-b583-f5c2c0358d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:19.571900 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e63c8b-62fd-4daf-b583-f5c2c0358d3b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:19.572922 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb3e31-64d3-477c-9c54-48fe5ab8b01d None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:19.596349 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e63c8b-62fd-4daf-b583-f5c2c0358d3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:48:19.605306 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-08e63c8b-62fd-4daf-b583-f5c2c0358d3b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:48:19.605306 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:19.605306 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:19.605306 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:19.605306 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:19.605306 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:19.605306 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:19.605306 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:19.605306 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:19.605306 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:19.605306 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:19.605306 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:19.605306 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:48:19.605306 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:48:19.605306 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:48:19.605306 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:48:19.606273 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:48:19.606273 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:48:19.606273 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:48:19.606273 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:48:19.606273 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:19.606273 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:19.606273 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:19.606273 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:19.606273 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:19.606273 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:19.606273 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:19.606273 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:19.606273 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:19.606273 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:19.606273 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:19.606273 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:19.607118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:19.607118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:19.607118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:19.607118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:19.607118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:48:19.607118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:48:19.607118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:48:19.607118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:48:19.607118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:48:19.607118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:48:19.607118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:48:19.607118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:19.618141 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 370/733] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 11 20:48:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:48:19.623278 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e63c8b-62fd-4daf-b583-f5c2c0358d3b None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:19.634007 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aeacd5-8f5a-4aeb-b227-0711188ef385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:19.635158 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aeacd5-8f5a-4aeb-b227-0711188ef385 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:19.635792 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aeacd5-8f5a-4aeb-b227-0711188ef385 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:19.636325 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aeacd5-8f5a-4aeb-b227-0711188ef385 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:19.711770 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aeacd5-8f5a-4aeb-b227-0711188ef385 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:19.713646 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aeacd5-8f5a-4aeb-b227-0711188ef385 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:19.740353 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:19.748672 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:19.764446 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e63c8b-62fd-4daf-b583-f5c2c0358d3b None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:19.799029 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0c70c-9a61-44cf-9150-57be30be8416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:19.800009 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0c70c-9a61-44cf-9150-57be30be8416 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:19.800514 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0c70c-9a61-44cf-9150-57be30be8416 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:19.801011 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0c70c-9a61-44cf-9150-57be30be8416 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:19.801976 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d0c70c-9a61-44cf-9150-57be30be8416 None admin] RBAC: Adding query filter params (name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:19.802530 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d0c70c-9a61-44cf-9150-57be30be8416 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:19.804294 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d0c70c-9a61-44cf-9150-57be30be8416 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:19.813615 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 371/734] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jul 11 20:48:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:19.815294 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269376f-600d-4a33-bb85-3f33f7737908 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:19.816385 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269376f-600d-4a33-bb85-3f33f7737908 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:19.816385 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269376f-600d-4a33-bb85-3f33f7737908 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:19.822299 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 364/736] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:48:19 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 20:48:19.822562 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 372/736] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:19.823260 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aeacd5-8f5a-4aeb-b227-0711188ef385 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:19.824822 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eff53f-53ae-4b67-a364-c48782bf71c3 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:19.825324 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eff53f-53ae-4b67-a364-c48782bf71c3 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:19.825826 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eff53f-53ae-4b67-a364-c48782bf71c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:19.843097 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-50eff53f-53ae-4b67-a364-c48782bf71c3 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:19.844668 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-50eff53f-53ae-4b67-a364-c48782bf71c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:19.920143 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 373/737] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:19 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:48:19.921339 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eff53f-53ae-4b67-a364-c48782bf71c3 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:19.936378 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aeacd5-8f5a-4aeb-b227-0711188ef385 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:19.956345 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:19.970859 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6be921-e458-44c2-801c-51bcf4050193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:19.971900 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6be921-e458-44c2-801c-51bcf4050193 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:19.972333 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6be921-e458-44c2-801c-51bcf4050193 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:19.972738 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6be921-e458-44c2-801c-51bcf4050193 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:19.984142 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6be921-e458-44c2-801c-51bcf4050193 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:19.985799 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6be921-e458-44c2-801c-51bcf4050193 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:20.005829 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-8b6be921-e458-44c2-801c-51bcf4050193 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:20.005829 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:20.005829 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:20.005829 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:20.005829 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:20.005829 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:20.005829 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:20.005829 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:20.005829 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:20.005829 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:20.005829 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:20.005829 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:20.005829 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:20.005829 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:20.005829 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:20.006861 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:20.006861 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:20.006861 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:20.006861 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:20.006861 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:20.006861 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:20.006861 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:20.006861 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:20.006861 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:20.006861 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:20.006861 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:20.006861 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:20.006861 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:20.006861 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:20.006861 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:20.006861 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:20.006861 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:20.007740 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:20.007740 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:20.007740 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:20.007740 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:20.007740 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 365/738] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:20.008507 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6be921-e458-44c2-801c-51bcf4050193 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:20.026185 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:20.048991 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eff53f-53ae-4b67-a364-c48782bf71c3 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:20.085578 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22504147-ad2b-4b00-b4c7-473a545f1493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:20.086421 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22504147-ad2b-4b00-b4c7-473a545f1493 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:20.087413 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22504147-ad2b-4b00-b4c7-473a545f1493 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:20.087701 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22504147-ad2b-4b00-b4c7-473a545f1493 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:20.098983 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22504147-ad2b-4b00-b4c7-473a545f1493 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:20.100547 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22504147-ad2b-4b00-b4c7-473a545f1493 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:20.121801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6be921-e458-44c2-801c-51bcf4050193 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:20.122507 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-22504147-ad2b-4b00-b4c7-473a545f1493 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:20.122507 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:20.122507 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:20.122507 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:20.122507 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:20.122507 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:20.122507 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:20.122507 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:20.122507 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:20.122507 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:20.122507 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:20.122507 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:20.122507 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:20.122507 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:20.122507 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:20.123405 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:20.123405 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:20.123405 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:20.123405 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:20.123405 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:20.123405 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:20.123405 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:20.123405 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:20.123405 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:20.123405 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:20.123405 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:20.123405 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:20.123405 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:20.123405 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:20.123405 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:20.123405 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:20.123405 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:20.124357 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:20.124357 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:20.124357 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:20.124357 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:20.125503 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 374/739] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:20.126770 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a8c99-6328-42b2-b719-b91848d4617d None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:20.127060 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a8c99-6328-42b2-b719-b91848d4617d None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:20.127340 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a8c99-6328-42b2-b719-b91848d4617d None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:20.128999 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 375/740] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:20.129707 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a8c99-6328-42b2-b719-b91848d4617d None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:20.164304 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942fb14-0ab0-4ad4-983f-43fd7365965b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:20.165675 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942fb14-0ab0-4ad4-983f-43fd7365965b None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:20.165954 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942fb14-0ab0-4ad4-983f-43fd7365965b None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:20.166229 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942fb14-0ab0-4ad4-983f-43fd7365965b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:20.176331 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a942fb14-0ab0-4ad4-983f-43fd7365965b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:48:20.183713 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-a942fb14-0ab0-4ad4-983f-43fd7365965b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:48:20.183713 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:20.183713 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:20.183713 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:20.183713 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:20.183713 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:20.183713 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:20.183713 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:20.183713 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:20.183713 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:20.183713 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:20.183713 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:20.183713 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:48:20.183713 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:48:20.183713 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:48:20.183713 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:48:20.184803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:48:20.184803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:48:20.184803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:48:20.184803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:48:20.184803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:20.184803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:20.184803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:20.184803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:20.184803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:20.184803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:20.184803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:20.184803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:20.184803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:20.184803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:20.184803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:20.184803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:20.185802 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:20.185802 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:20.185802 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:20.185802 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:20.185802 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:48:20.185802 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:48:20.185802 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:48:20.185802 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:48:20.185802 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:48:20.185802 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:48:20.185802 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:48:20.185802 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:20.185802 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 366/741] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 11 20:48:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:20.190327 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942fb14-0ab0-4ad4-983f-43fd7365965b None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:20.212556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:20.248346 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a8c99-6328-42b2-b719-b91848d4617d None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:20.278155 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:20.284898 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b8276-e315-48c6-a4a2-6c1352dc78e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:20.285581 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b8276-e315-48c6-a4a2-6c1352dc78e6 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:20.285856 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b8276-e315-48c6-a4a2-6c1352dc78e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:20.286135 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b8276-e315-48c6-a4a2-6c1352dc78e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:20.286853 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b8276-e315-48c6-a4a2-6c1352dc78e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:20.287163 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b8276-e315-48c6-a4a2-6c1352dc78e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:20.288564 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b8276-e315-48c6-a4a2-6c1352dc78e6 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:20.291835 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942fb14-0ab0-4ad4-983f-43fd7365965b None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:20.304563 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 376/742] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:20.306669 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7cba64-8c53-4e1e-a3a2-e6f9fe07c695 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:20.307362 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7cba64-8c53-4e1e-a3a2-e6f9fe07c695 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:20.307917 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7cba64-8c53-4e1e-a3a2-e6f9fe07c695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:20.323662 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-df7cba64-8c53-4e1e-a3a2-e6f9fe07c695 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:20.324864 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-df7cba64-8c53-4e1e-a3a2-e6f9fe07c695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:20.329498 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2465d-d30f-4ea8-8be3-83ffd0564a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:20.330163 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2465d-d30f-4ea8-8be3-83ffd0564a00 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:20.330445 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2465d-d30f-4ea8-8be3-83ffd0564a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:20.330718 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2465d-d30f-4ea8-8be3-83ffd0564a00 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:20.331436 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf2465d-d30f-4ea8-8be3-83ffd0564a00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:20.331744 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf2465d-d30f-4ea8-8be3-83ffd0564a00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:20.333216 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf2465d-d30f-4ea8-8be3-83ffd0564a00 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:20.345237 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 367/743] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:20.346044 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2465d-d30f-4ea8-8be3-83ffd0564a00 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:20.403438 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 377/744] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:20 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 20:48:20.404797 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7cba64-8c53-4e1e-a3a2-e6f9fe07c695 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:20.446678 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:20.467534 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2465d-d30f-4ea8-8be3-83ffd0564a00 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:20.503305 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949cb22-1023-4fd9-8116-fe27e8fd9241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:20.503999 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949cb22-1023-4fd9-8116-fe27e8fd9241 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:20.504293 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949cb22-1023-4fd9-8116-fe27e8fd9241 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:20.504570 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949cb22-1023-4fd9-8116-fe27e8fd9241 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:20.505436 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6949cb22-1023-4fd9-8116-fe27e8fd9241 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:20.505866 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6949cb22-1023-4fd9-8116-fe27e8fd9241 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:20.507217 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6949cb22-1023-4fd9-8116-fe27e8fd9241 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:20.516910 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 368/745] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:48:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:20.517380 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7cba64-8c53-4e1e-a3a2-e6f9fe07c695 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:20.517723 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949cb22-1023-4fd9-8116-fe27e8fd9241 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:20.543350 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:20.558217 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa2fb6-b47c-4eb3-812d-42c6a07611f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:20.559037 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa2fb6-b47c-4eb3-812d-42c6a07611f9 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:20.559350 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa2fb6-b47c-4eb3-812d-42c6a07611f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:20.559712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa2fb6-b47c-4eb3-812d-42c6a07611f9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:20.567524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa2fb6-b47c-4eb3-812d-42c6a07611f9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:20.569110 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa2fb6-b47c-4eb3-812d-42c6a07611f9 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:20.586125 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-25fa2fb6-b47c-4eb3-812d-42c6a07611f9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 20:48:20.586125 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:20.586125 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:20.586125 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:20.586125 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:20.586125 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:20.586125 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:20.586125 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:20.586125 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:20.586125 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:20.586125 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:20.586125 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:20.586125 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:48:20.586125 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:48:20.586125 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:48:20.586125 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:48:20.587217 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:20.587217 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:20.587217 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:48:20.587217 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:20.587217 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:48:20.587217 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:20.587217 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:20.587217 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:20.587217 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:20.587217 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:20.587217 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:20.587217 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:20.587217 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:20.587217 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:20.587217 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:20.587217 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:20.587217 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:20.587217 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:20.588691 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:20.588691 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:20.588691 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:48:20.588691 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:48:20.588691 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:48:20.588691 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:48:20.588691 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:48:20.588691 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:48:20.588691 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 20:48:20.588691 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:20.588691 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 378/746] 10.222.0.40 () {56 vars in 1117 bytes} [Mon Jul 11 20:48:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:20.588691 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa2fb6-b47c-4eb3-812d-42c6a07611f9 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:20.633080 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949cb22-1023-4fd9-8116-fe27e8fd9241 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:20.672246 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea1086-5c63-491b-8faf-db77f0545df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:20.673160 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea1086-5c63-491b-8faf-db77f0545df3 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:20.673577 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea1086-5c63-491b-8faf-db77f0545df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:20.673858 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea1086-5c63-491b-8faf-db77f0545df3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:20.681287 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea1086-5c63-491b-8faf-db77f0545df3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:20.682815 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea1086-5c63-491b-8faf-db77f0545df3 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:20.698143 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-95ea1086-5c63-491b-8faf-db77f0545df3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:20.698143 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:20.698143 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:20.698143 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:20.698143 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:20.698143 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:20.698143 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:20.698143 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:20.698143 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:20.698143 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:20.698143 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:20.698143 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:20.698143 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:48:20.698143 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:48:20.698143 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:48:20.699029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:48:20.699029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:20.699029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:20.699029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:20.699029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:20.699029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:20.699029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:20.699029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:20.699029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:20.699029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:20.699029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:20.699029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:20.699029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:20.699029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:20.699029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:20.699029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:20.699029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:20.700019 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:48:20.700019 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:48:20.700019 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:48:20.700019 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:48:20.700019 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:48:20.700019 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:48:20.700019 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:20.700019 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:20.700019 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 369/747] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:48:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:20.700518 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea1086-5c63-491b-8faf-db77f0545df3 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:20.706730 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:20.710793 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa2fb6-b47c-4eb3-812d-42c6a07611f9 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:20.755356 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf845d5-e51e-4960-90cc-1be1657d3aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:20.756051 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf845d5-e51e-4960-90cc-1be1657d3aae None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:20.756339 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf845d5-e51e-4960-90cc-1be1657d3aae None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:20.756616 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf845d5-e51e-4960-90cc-1be1657d3aae None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:20.757757 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf845d5-e51e-4960-90cc-1be1657d3aae None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:20.759457 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf845d5-e51e-4960-90cc-1be1657d3aae None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:20.804156 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea1086-5c63-491b-8faf-db77f0545df3 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:20.831165 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 379/748] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Jul 11 20:48:20 2022] POST /identity/v3/services => generated 240 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:48:20.832128 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf845d5-e51e-4960-90cc-1be1657d3aae None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:20.870629 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e868e92-d134-492e-9252-af881ee8ad1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:20.871760 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e868e92-d134-492e-9252-af881ee8ad1c None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:20.872535 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e868e92-d134-492e-9252-af881ee8ad1c None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:20.873510 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e868e92-d134-492e-9252-af881ee8ad1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:20.888491 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e868e92-d134-492e-9252-af881ee8ad1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:20.890971 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e868e92-d134-492e-9252-af881ee8ad1c None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:20.892527 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:20.920912 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-6e868e92-d134-492e-9252-af881ee8ad1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:20.920912 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:20.920912 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:20.920912 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:20.920912 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:20.920912 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:20.920912 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:20.920912 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:20.920912 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:20.920912 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:20.920912 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:20.920912 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:20.920912 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:20.920912 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:20.920912 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:20.923508 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:20.923508 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:20.923508 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:20.923508 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:20.923508 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:20.923508 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:20.923508 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:20.923508 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:20.923508 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:20.923508 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:20.923508 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:20.923508 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:20.923508 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:20.923508 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:20.923508 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:20.923508 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:20.923508 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:20.924688 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:20.924688 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:20.924688 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:20.924688 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:20.931764 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 370/749] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:20.931764 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e868e92-d134-492e-9252-af881ee8ad1c None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:20.982321 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf845d5-e51e-4960-90cc-1be1657d3aae None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:21.007500 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:21.027258 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e25606-f52b-40ba-9003-1f272e27f839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:21.027947 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e25606-f52b-40ba-9003-1f272e27f839 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:21.028259 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e25606-f52b-40ba-9003-1f272e27f839 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:21.028540 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e25606-f52b-40ba-9003-1f272e27f839 None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:21.029382 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e25606-f52b-40ba-9003-1f272e27f839 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:21.029694 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e25606-f52b-40ba-9003-1f272e27f839 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:21.031162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e25606-f52b-40ba-9003-1f272e27f839 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:21.050993 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 380/750] 10.222.0.40 () {56 vars in 1149 bytes} [Mon Jul 11 20:48:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:21.052008 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e25606-f52b-40ba-9003-1f272e27f839 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:21.070508 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e868e92-d134-492e-9252-af881ee8ad1c None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:21.106657 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0644896-1d68-4953-b6a6-8e7329c34df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:21.107448 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0644896-1d68-4953-b6a6-8e7329c34df6 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:21.107720 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0644896-1d68-4953-b6a6-8e7329c34df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:21.108009 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0644896-1d68-4953-b6a6-8e7329c34df6 None admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:21.108880 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0644896-1d68-4953-b6a6-8e7329c34df6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:21.109115 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0644896-1d68-4953-b6a6-8e7329c34df6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:21.110518 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0644896-1d68-4953-b6a6-8e7329c34df6 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:21.128427 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 371/751] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 11 20:48:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:21.128427 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6fc5c-7766-4390-b4a6-896243495d6b None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:21.128427 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6fc5c-7766-4390-b4a6-896243495d6b None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:21.128427 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6fc5c-7766-4390-b4a6-896243495d6b None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:21.128427 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 372/752] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:21.128427 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f6fc5c-7766-4390-b4a6-896243495d6b None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:21.160795 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:21.165705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e25606-f52b-40ba-9003-1f272e27f839 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:21.201499 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61987594-ab64-4d53-9adc-dabe35f82025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:21.202372 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61987594-ab64-4d53-9adc-dabe35f82025 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:21.202667 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61987594-ab64-4d53-9adc-dabe35f82025 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:21.203433 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61987594-ab64-4d53-9adc-dabe35f82025 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:21.204416 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61987594-ab64-4d53-9adc-dabe35f82025 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:21.204879 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61987594-ab64-4d53-9adc-dabe35f82025 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:21.206429 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61987594-ab64-4d53-9adc-dabe35f82025 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:21.226376 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 381/753] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:21.226376 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61987594-ab64-4d53-9adc-dabe35f82025 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:21.238770 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f6fc5c-7766-4390-b4a6-896243495d6b None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:21.250962 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:21.275712 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5341e917-6ae8-4793-a610-b3785647ab2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:21.276566 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341e917-6ae8-4793-a610-b3785647ab2b None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:21.276953 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341e917-6ae8-4793-a610-b3785647ab2b None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:21.277343 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5341e917-6ae8-4793-a610-b3785647ab2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:21.337194 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61987594-ab64-4d53-9adc-dabe35f82025 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:21.351050 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5341e917-6ae8-4793-a610-b3785647ab2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:21.353423 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5341e917-6ae8-4793-a610-b3785647ab2b None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:21.372907 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760257e3-9e58-4a93-93dd-aa13a77c515c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:21.373568 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760257e3-9e58-4a93-93dd-aa13a77c515c None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:21.373853 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760257e3-9e58-4a93-93dd-aa13a77c515c None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:21.374131 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760257e3-9e58-4a93-93dd-aa13a77c515c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:21.375202 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760257e3-9e58-4a93-93dd-aa13a77c515c None admin] RBAC: Adding query filter params (role.id=86273ff072f3438d822e870272491768, scope.project.id=eca3ef2561fa435e80ff451aeab14f3b, user.id=dc950dfb1d3b4308a33f3d430fe34c1c) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:21.375517 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760257e3-9e58-4a93-93dd-aa13a77c515c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:21.376952 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760257e3-9e58-4a93-93dd-aa13a77c515c None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:21.391994 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 382/754] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:48:21 2022] GET /identity/v3/role_assignments?user.id=dc950dfb1d3b4308a33f3d430fe34c1c&scope.project.id=eca3ef2561fa435e80ff451aeab14f3b&role.id=86273ff072f3438d822e870272491768 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:21.391994 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d9866-9104-4ddf-8751-e767455af5dd None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:21.391994 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d9866-9104-4ddf-8751-e767455af5dd None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:21.391994 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d9866-9104-4ddf-8751-e767455af5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:21.409588 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-b33d9866-9104-4ddf-8751-e767455af5dd None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:21.411027 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-b33d9866-9104-4ddf-8751-e767455af5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:21.432508 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:21.495430 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 373/755] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:48:21 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 20:48:21.496722 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5341e917-6ae8-4793-a610-b3785647ab2b None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:21.500394 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 383/756] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:48:21.502337 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d9866-9104-4ddf-8751-e767455af5dd None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:21.511048 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:21.627037 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5341e917-6ae8-4793-a610-b3785647ab2b None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:21.632531 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d9866-9104-4ddf-8751-e767455af5dd None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:21.669837 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d068698-50a7-43d1-975d-cc06176a1335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:21.670862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d068698-50a7-43d1-975d-cc06176a1335 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:21.671327 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d068698-50a7-43d1-975d-cc06176a1335 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:21.671479 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31118c0-c4a2-406c-9930-dd815b87300a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:21.671985 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d068698-50a7-43d1-975d-cc06176a1335 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:21.672498 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31118c0-c4a2-406c-9930-dd815b87300a None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:21.672867 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31118c0-c4a2-406c-9930-dd815b87300a None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:21.673211 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31118c0-c4a2-406c-9930-dd815b87300a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:21.680814 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d068698-50a7-43d1-975d-cc06176a1335 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:21.682520 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d068698-50a7-43d1-975d-cc06176a1335 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:21.684680 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31118c0-c4a2-406c-9930-dd815b87300a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:21.686578 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31118c0-c4a2-406c-9930-dd815b87300a None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:21.698298 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-7d068698-50a7-43d1-975d-cc06176a1335 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 20:48:21.698298 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:21.698298 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:21.698298 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:21.698298 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:21.698298 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:21.698298 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:21.698298 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:21.698298 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:21.698298 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:21.698298 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:21.698298 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:21.698298 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:48:21.698298 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:48:21.698298 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:48:21.698298 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:48:21.699261 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:21.699261 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:21.699261 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:48:21.699261 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:21.699261 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:48:21.699261 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:21.699261 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:21.699261 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:21.699261 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:21.699261 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:21.699261 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:21.699261 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:21.699261 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:21.699261 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:21.699261 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:21.699261 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:21.699261 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:21.699261 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:21.700214 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:21.700214 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:21.700214 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:48:21.700214 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:48:21.700214 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:48:21.700214 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:48:21.700214 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:48:21.700214 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:48:21.700214 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 20:48:21.700214 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:21.702837 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 374/757] 10.222.0.40 () {56 vars in 1093 bytes} [Mon Jul 11 20:48:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:21.703868 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d068698-50a7-43d1-975d-cc06176a1335 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:21.709708 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-e31118c0-c4a2-406c-9930-dd815b87300a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:21.709708 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:21.709708 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:21.709708 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:21.709708 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:21.709708 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:21.709708 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:21.709708 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:21.709708 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:21.709708 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:21.709708 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:21.709708 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:21.709708 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:21.709708 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:21.709708 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:21.710577 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:21.710577 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:21.710577 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:21.710577 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:21.710577 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:21.710577 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:21.710577 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:21.710577 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:21.710577 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:21.710577 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:21.710577 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:21.710577 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:21.710577 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:21.710577 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:21.710577 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:21.710577 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:21.710577 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:21.712102 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:21.712102 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:21.712102 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:21.712102 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:21.712102 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 384/758] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:21.713933 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31118c0-c4a2-406c-9930-dd815b87300a None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:21.717024 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:21.786371 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:21.818744 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31118c0-c4a2-406c-9930-dd815b87300a None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:21.822070 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d068698-50a7-43d1-975d-cc06176a1335 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:21.855662 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980aa38-b3bd-4f11-8584-aef3734f54cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:21.856387 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980aa38-b3bd-4f11-8584-aef3734f54cc None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:21.856719 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980aa38-b3bd-4f11-8584-aef3734f54cc None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:21.857005 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980aa38-b3bd-4f11-8584-aef3734f54cc None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:21.857842 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980aa38-b3bd-4f11-8584-aef3734f54cc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:21.858155 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980aa38-b3bd-4f11-8584-aef3734f54cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:21.859868 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980aa38-b3bd-4f11-8584-aef3734f54cc None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:21.860326 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d20bf-ef38-4330-847f-82ac130c1e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:21.861456 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d20bf-ef38-4330-847f-82ac130c1e81 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:21.861957 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d20bf-ef38-4330-847f-82ac130c1e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:21.862544 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d20bf-ef38-4330-847f-82ac130c1e81 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:21.863452 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d20bf-ef38-4330-847f-82ac130c1e81 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:21.865036 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d20bf-ef38-4330-847f-82ac130c1e81 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:21.878367 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-551d20bf-ef38-4330-847f-82ac130c1e81 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 20:48:21.878367 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:21.878367 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:48:21.878367 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:48:21.878367 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:48:21.878367 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:48:21.878367 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:48:21.878367 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:21.878367 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 20:48:21.878367 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:21.878367 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:48:21.878367 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:21.878367 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:21.878367 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:21.878367 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:21.878367 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:21.879370 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:21.879370 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:21.879370 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:21.879370 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:21.879370 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:21.879370 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:21.879370 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:21.879370 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:48:21.879370 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:48:21.879370 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:48:21.879370 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:48:21.879370 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:21.879370 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:21.879370 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:21.879370 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:21.879370 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:21.880219 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:21.880219 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:21.880219 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:21.880219 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:21.880219 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:21.880219 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:21.880219 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:21.880219 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:21.880219 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:21.880219 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:21.880219 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:21.880219 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:48:21.880219 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:21.880219 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 20:48:21.880219 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:21.888474 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 375/759] 10.222.0.40 () {56 vars in 1129 bytes} [Mon Jul 11 20:48:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:21.888474 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d20bf-ef38-4330-847f-82ac130c1e81 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:22.000619 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 385/760] 10.222.0.40 () {56 vars in 1133 bytes} [Mon Jul 11 20:48:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:22.001386 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d20bf-ef38-4330-847f-82ac130c1e81 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:22.001515 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980aa38-b3bd-4f11-8584-aef3734f54cc None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:22.038503 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317ef34-8a1c-4d54-9ae4-7656c197d605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:22.039112 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317ef34-8a1c-4d54-9ae4-7656c197d605 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:22.039406 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317ef34-8a1c-4d54-9ae4-7656c197d605 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:22.040425 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317ef34-8a1c-4d54-9ae4-7656c197d605 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:22.041393 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317ef34-8a1c-4d54-9ae4-7656c197d605 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:22.041719 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317ef34-8a1c-4d54-9ae4-7656c197d605 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:22.043148 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317ef34-8a1c-4d54-9ae4-7656c197d605 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:22.045128 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:22.063182 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 376/761] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:22.064509 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317ef34-8a1c-4d54-9ae4-7656c197d605 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:22.082350 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:22.131392 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980aa38-b3bd-4f11-8584-aef3734f54cc None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:22.174777 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c689700-cc11-4aac-ab7d-af8b725d7fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:22.175752 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c689700-cc11-4aac-ab7d-af8b725d7fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:22.176069 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c689700-cc11-4aac-ab7d-af8b725d7fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:22.176487 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c689700-cc11-4aac-ab7d-af8b725d7fe5 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:22.177346 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c689700-cc11-4aac-ab7d-af8b725d7fe5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:22.177661 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c689700-cc11-4aac-ab7d-af8b725d7fe5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:22.178920 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317ef34-8a1c-4d54-9ae4-7656c197d605 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:22.179360 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c689700-cc11-4aac-ab7d-af8b725d7fe5 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:22.185351 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 386/762] 10.222.0.40 () {56 vars in 1124 bytes} [Mon Jul 11 20:48:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:22.186273 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c689700-cc11-4aac-ab7d-af8b725d7fe5 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:22.219085 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181235d0-4d0e-4b49-8b51-20b4e9f2e42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:22.220271 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181235d0-4d0e-4b49-8b51-20b4e9f2e42b None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:22.220805 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181235d0-4d0e-4b49-8b51-20b4e9f2e42b None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:22.221265 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181235d0-4d0e-4b49-8b51-20b4e9f2e42b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:22.233204 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181235d0-4d0e-4b49-8b51-20b4e9f2e42b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:22.236499 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181235d0-4d0e-4b49-8b51-20b4e9f2e42b None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:22.254696 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-181235d0-4d0e-4b49-8b51-20b4e9f2e42b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:22.254696 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:22.254696 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:22.254696 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:22.254696 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:22.254696 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:22.254696 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:22.254696 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:22.254696 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:22.254696 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:22.254696 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:22.254696 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:22.254696 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:22.254696 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:22.254696 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:22.255801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:22.255801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:22.255801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:22.255801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:22.255801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:22.255801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:22.255801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:22.255801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:22.255801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:22.255801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:22.255801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:22.255801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:22.255801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:22.255801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:22.255801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:22.255801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:22.255801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:22.256781 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:22.256781 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:22.256781 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:22.256781 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:22.258981 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 377/763] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:22.259888 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181235d0-4d0e-4b49-8b51-20b4e9f2e42b None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:22.332006 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:22.353952 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c689700-cc11-4aac-ab7d-af8b725d7fe5 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:22.382613 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:22.387299 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181235d0-4d0e-4b49-8b51-20b4e9f2e42b None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:22.392728 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52445bd-2837-4770-ba1d-b95f2a13c738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:22.393857 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52445bd-2837-4770-ba1d-b95f2a13c738 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:22.394345 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52445bd-2837-4770-ba1d-b95f2a13c738 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:22.395021 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52445bd-2837-4770-ba1d-b95f2a13c738 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:22.403465 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52445bd-2837-4770-ba1d-b95f2a13c738 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:22.405458 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52445bd-2837-4770-ba1d-b95f2a13c738 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:22.422539 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-a52445bd-2837-4770-ba1d-b95f2a13c738 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:22.422539 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:22.422539 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:22.422539 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:22.422539 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:22.422539 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:22.422539 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:22.422539 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:22.422539 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:22.422539 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:22.422539 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:22.422539 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:22.422539 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:48:22.422539 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:48:22.422539 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:48:22.423467 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:48:22.423467 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:22.423467 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:22.423467 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:22.423467 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:22.423467 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:22.423467 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:22.423467 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:22.423467 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:22.423467 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:22.423467 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:22.423467 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:22.423467 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:22.423467 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:22.423467 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:22.423467 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:22.423467 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:22.424723 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:48:22.424723 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:48:22.424723 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:48:22.424723 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:48:22.424723 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:48:22.424723 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:48:22.424723 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:22.424723 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:22.425159 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854fb6f2-6abe-4697-9b56-3a619d8e9e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:22.425159 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fb6f2-6abe-4697-9b56-3a619d8e9e45 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:22.425159 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fb6f2-6abe-4697-9b56-3a619d8e9e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:22.425159 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fb6f2-6abe-4697-9b56-3a619d8e9e45 None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:22.425664 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854fb6f2-6abe-4697-9b56-3a619d8e9e45 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:22.425757 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854fb6f2-6abe-4697-9b56-3a619d8e9e45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:22.427215 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854fb6f2-6abe-4697-9b56-3a619d8e9e45 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:22.427690 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 387/764] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:48:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:22.428704 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52445bd-2837-4770-ba1d-b95f2a13c738 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:22.437207 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 378/765] 10.222.0.40 () {56 vars in 1124 bytes} [Mon Jul 11 20:48:22 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:22.438049 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854fb6f2-6abe-4697-9b56-3a619d8e9e45 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:22.541052 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854fb6f2-6abe-4697-9b56-3a619d8e9e45 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:22.547365 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52445bd-2837-4770-ba1d-b95f2a13c738 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:22.553327 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:22.578997 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d66bba-5959-4c9a-9abf-6077341ff9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:22.579701 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d66bba-5959-4c9a-9abf-6077341ff9e3 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:22.580000 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d66bba-5959-4c9a-9abf-6077341ff9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:22.580302 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d66bba-5959-4c9a-9abf-6077341ff9e3 None admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:22.581092 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d66bba-5959-4c9a-9abf-6077341ff9e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:22.581403 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d66bba-5959-4c9a-9abf-6077341ff9e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:22.582921 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d66bba-5959-4c9a-9abf-6077341ff9e3 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:22.592542 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c8205-c362-4f37-80af-ea5a9e334145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:22.593552 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c8205-c362-4f37-80af-ea5a9e334145 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:22.594072 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c8205-c362-4f37-80af-ea5a9e334145 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:22.594554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c8205-c362-4f37-80af-ea5a9e334145 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:22.595561 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c8205-c362-4f37-80af-ea5a9e334145 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:22.595759 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 379/766] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 11 20:48:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:22.596353 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c8205-c362-4f37-80af-ea5a9e334145 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:22.598106 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c8205-c362-4f37-80af-ea5a9e334145 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:22.600735 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d66bba-5959-4c9a-9abf-6077341ff9e3 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:22.613037 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 388/767] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:22.614458 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c8205-c362-4f37-80af-ea5a9e334145 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:22.684356 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:22.713312 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d66bba-5959-4c9a-9abf-6077341ff9e3 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:22.732344 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c8205-c362-4f37-80af-ea5a9e334145 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:22.747533 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ce769-cb6c-4b0c-b53c-54996bf68ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:22.748166 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ce769-cb6c-4b0c-b53c-54996bf68ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:22.748453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ce769-cb6c-4b0c-b53c-54996bf68ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:22.748727 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ce769-cb6c-4b0c-b53c-54996bf68ba9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:22.749607 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073ce769-cb6c-4b0c-b53c-54996bf68ba9 None admin] RBAC: Adding query filter params (interface=public, service_id=c2ab3e7c6a734bcb8ed82a886814ae23, region_id=RegionOne) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:22.750070 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073ce769-cb6c-4b0c-b53c-54996bf68ba9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:22.751429 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073ce769-cb6c-4b0c-b53c-54996bf68ba9 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:22.760468 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 380/768] 10.222.0.40 () {56 vars in 1251 bytes} [Mon Jul 11 20:48:22 2022] GET /identity/v3/endpoints?service_id=c2ab3e7c6a734bcb8ed82a886814ae23&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:22.761278 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ce769-cb6c-4b0c-b53c-54996bf68ba9 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:22.773243 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce75467-d03e-4764-b1f6-4166e517ae46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:22.775397 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce75467-d03e-4764-b1f6-4166e517ae46 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:22.775905 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce75467-d03e-4764-b1f6-4166e517ae46 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:22.776470 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce75467-d03e-4764-b1f6-4166e517ae46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:22.777607 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce75467-d03e-4764-b1f6-4166e517ae46 None admin] RBAC: Adding query filter params (role.id=17bc727d82f24074aba8b1185cb99739, scope.project.id=eca3ef2561fa435e80ff451aeab14f3b, user.id=90ea5d52fd6d4068b7837d363eebb94f) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:22.778231 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce75467-d03e-4764-b1f6-4166e517ae46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:22.779863 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce75467-d03e-4764-b1f6-4166e517ae46 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:22.787030 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 389/769] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:48:22 2022] GET /identity/v3/role_assignments?user.id=90ea5d52fd6d4068b7837d363eebb94f&scope.project.id=eca3ef2561fa435e80ff451aeab14f3b&role.id=17bc727d82f24074aba8b1185cb99739 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:22.788615 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce75467-d03e-4764-b1f6-4166e517ae46 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:22.807709 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:22.934150 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ce769-cb6c-4b0c-b53c-54996bf68ba9 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:22.975515 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8877ea-56c2-4467-9297-7717e749a473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:22.976936 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8877ea-56c2-4467-9297-7717e749a473 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:22.977739 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8877ea-56c2-4467-9297-7717e749a473 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:22.978479 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8877ea-56c2-4467-9297-7717e749a473 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:22.986889 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8877ea-56c2-4467-9297-7717e749a473 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:22.989410 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8877ea-56c2-4467-9297-7717e749a473 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:23.009498 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce75467-d03e-4764-b1f6-4166e517ae46 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:23.011408 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-0b8877ea-56c2-4467-9297-7717e749a473 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:23.011408 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:23.011408 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:23.011408 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:23.011408 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:23.011408 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:23.011408 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:23.011408 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:23.011408 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:23.011408 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:23.011408 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:23.011408 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:23.011408 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:48:23.011408 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:48:23.011408 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:48:23.012299 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:48:23.012299 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:23.012299 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:23.012299 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:23.012299 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:23.012299 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:23.012299 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:23.012299 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:23.012299 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:23.012299 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:23.012299 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:23.012299 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:23.012299 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:23.012299 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:23.012299 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:23.012299 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:23.012299 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:23.013216 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:48:23.013216 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:48:23.013216 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:48:23.013216 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:48:23.013216 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:48:23.013216 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:48:23.013216 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:23.013216 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:23.015027 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 381/770] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:48:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:23.015027 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4f39a-fdef-4b68-be22-bd7befca2749 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:23.015027 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4f39a-fdef-4b68-be22-bd7befca2749 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:23.015222 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4f39a-fdef-4b68-be22-bd7befca2749 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:23.016655 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 382/771] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:23.018654 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4f39a-fdef-4b68-be22-bd7befca2749 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:23.030064 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:23.057329 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4282d1-0784-4b14-a7f9-f2b2fb449bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:23.058111 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4282d1-0784-4b14-a7f9-f2b2fb449bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:23.058408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4282d1-0784-4b14-a7f9-f2b2fb449bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:23.059621 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4282d1-0784-4b14-a7f9-f2b2fb449bc8 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:23.060377 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4282d1-0784-4b14-a7f9-f2b2fb449bc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:23.061772 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4282d1-0784-4b14-a7f9-f2b2fb449bc8 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:23.072378 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 390/772] 10.222.0.40 () {56 vars in 1087 bytes} [Mon Jul 11 20:48:22 2022] GET /identity/v3/services => generated 772 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:23.074052 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13ce7b-0eee-4ac0-933c-ed3e8ed634fb None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:23.074357 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13ce7b-0eee-4ac0-933c-ed3e8ed634fb None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:23.074644 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13ce7b-0eee-4ac0-933c-ed3e8ed634fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:23.113224 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-0a13ce7b-0eee-4ac0-933c-ed3e8ed634fb None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:23.114555 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-0a13ce7b-0eee-4ac0-933c-ed3e8ed634fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:23.128373 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:23.131946 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4f39a-fdef-4b68-be22-bd7befca2749 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:23.177774 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613854a-f713-4f1c-9064-2825d266fab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:23.178470 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613854a-f713-4f1c-9064-2825d266fab1 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:23.178757 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613854a-f713-4f1c-9064-2825d266fab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:23.179036 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613854a-f713-4f1c-9064-2825d266fab1 None admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:23.179846 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7613854a-f713-4f1c-9064-2825d266fab1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:23.180967 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7613854a-f713-4f1c-9064-2825d266fab1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:23.182454 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7613854a-f713-4f1c-9064-2825d266fab1 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:23.215362 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 383/773] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 11 20:48:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:23.216747 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613854a-f713-4f1c-9064-2825d266fab1 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:23.276730 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 391/774] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:48:23.300162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a13ce7b-0eee-4ac0-933c-ed3e8ed634fb None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:23.377568 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613854a-f713-4f1c-9064-2825d266fab1 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:23.419203 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3342400d-bdad-4d4e-8f3e-db4a933f25c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:23.420184 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342400d-bdad-4d4e-8f3e-db4a933f25c8 None admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:23.420470 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342400d-bdad-4d4e-8f3e-db4a933f25c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:23.420746 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342400d-bdad-4d4e-8f3e-db4a933f25c8 None admin] PATH_INFO: `/v3/projects/eca3ef2561fa435e80ff451aeab14f3b/users/8ac15411c75f4bd4a86f6753c9240a5b/roles/86273ff072f3438d822e870272491768` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:23.422724 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3342400d-bdad-4d4e-8f3e-db4a933f25c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=eca3ef2561fa435e80ff451aeab14f3b, user_id=8ac15411c75f4bd4a86f6753c9240a5b, role_id=86273ff072f3438d822e870272491768)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:23.424296 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3342400d-bdad-4d4e-8f3e-db4a933f25c8 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:23.446982 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a13ce7b-0eee-4ac0-933c-ed3e8ed634fb None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:23.450262 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:23.486202 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78071d3c-f30a-4a0b-bfc7-15e982afedf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:23.487404 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78071d3c-f30a-4a0b-bfc7-15e982afedf5 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:23.488054 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78071d3c-f30a-4a0b-bfc7-15e982afedf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:23.488545 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78071d3c-f30a-4a0b-bfc7-15e982afedf5 None admin] PATH_INFO: `/v3/services/network` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:23.489529 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78071d3c-f30a-4a0b-bfc7-15e982afedf5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:23.491357 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78071d3c-f30a-4a0b-bfc7-15e982afedf5 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:23.506979 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-78071d3c-f30a-4a0b-bfc7-15e982afedf5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 20:48:23.506979 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:23.506979 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:48:23.506979 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:48:23.506979 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:48:23.506979 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:48:23.506979 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:48:23.506979 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:23.506979 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 20:48:23.506979 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:23.506979 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:48:23.506979 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:23.506979 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:23.506979 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:23.506979 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:23.506979 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:23.506979 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:23.508062 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:23.508062 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:23.508062 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:23.508062 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:23.508062 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:23.508062 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:23.508062 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:48:23.508062 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:48:23.508062 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:48:23.508062 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:48:23.508062 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:23.508062 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:23.508062 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:23.508062 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:23.508062 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:23.508062 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:23.509834 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:23.509834 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:23.509834 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:23.509834 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:23.509834 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:23.509834 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:23.509834 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:23.509834 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:23.509834 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:23.509834 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:23.509834 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:48:23.509834 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:23.509834 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 20:48:23.509834 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:23.511162 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 384/775] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 11 20:48:23 2022] PUT /identity/v3/projects/eca3ef2561fa435e80ff451aeab14f3b/users/8ac15411c75f4bd4a86f6753c9240a5b/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:48:23.513193 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 392/776] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:48:23 2022] GET /identity/v3/services/network => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:48:23.526982 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3342400d-bdad-4d4e-8f3e-db4a933f25c8 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:23.561944 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:23.571652 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9532941-6649-4489-888c-d31eeefdc98a None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:23.572027 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9532941-6649-4489-888c-d31eeefdc98a None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:23.572287 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9532941-6649-4489-888c-d31eeefdc98a None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:23.574942 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 393/777] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:23.581470 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32697593-08c2-4c79-a4ce-f34691a51ee6 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:23.581857 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32697593-08c2-4c79-a4ce-f34691a51ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:23.582213 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32697593-08c2-4c79-a4ce-f34691a51ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:23.617148 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-32697593-08c2-4c79-a4ce-f34691a51ee6 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:23.619674 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-32697593-08c2-4c79-a4ce-f34691a51ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:23.703389 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 394/778] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 20:48:23.742098 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3342400d-bdad-4d4e-8f3e-db4a933f25c8 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:23.752568 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32697593-08c2-4c79-a4ce-f34691a51ee6 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:23.795914 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0604f0-34b2-4635-87f9-3df0c8e52d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:23.796622 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0604f0-34b2-4635-87f9-3df0c8e52d63 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:23.796910 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0604f0-34b2-4635-87f9-3df0c8e52d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:23.797188 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0604f0-34b2-4635-87f9-3df0c8e52d63 None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:23.797904 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0604f0-34b2-4635-87f9-3df0c8e52d63 None admin] RBAC: Adding query filter params (name=network) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:23.798215 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0604f0-34b2-4635-87f9-3df0c8e52d63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:23.799812 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0604f0-34b2-4635-87f9-3df0c8e52d63 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:23.806500 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 385/779] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Jul 11 20:48:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:23.813728 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0604f0-34b2-4635-87f9-3df0c8e52d63 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:23.880836 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:23.884723 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32697593-08c2-4c79-a4ce-f34691a51ee6 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:23.917982 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:23.923792 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c075f15-27f6-42aa-8110-25f29c7fa41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:23.924730 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c075f15-27f6-42aa-8110-25f29c7fa41a None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:23.925074 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c075f15-27f6-42aa-8110-25f29c7fa41a None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:23.925411 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c075f15-27f6-42aa-8110-25f29c7fa41a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:23.945010 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c075f15-27f6-42aa-8110-25f29c7fa41a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:48:23.953841 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-7c075f15-27f6-42aa-8110-25f29c7fa41a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:48:23.953841 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:23.953841 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:23.953841 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:23.953841 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:23.953841 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:23.953841 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:23.953841 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:23.953841 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:23.953841 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:23.953841 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:23.953841 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:23.953841 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:48:23.953841 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:48:23.953841 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:48:23.953841 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:48:23.955082 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:48:23.955082 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:48:23.955082 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:48:23.955082 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:48:23.955082 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:23.955082 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:23.955082 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:23.955082 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:23.955082 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:23.955082 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:23.955082 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:23.955082 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:23.955082 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:23.955082 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:23.955082 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:23.955082 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:23.956176 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:23.956176 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:23.956176 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:23.956176 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:23.956176 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:48:23.956176 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:48:23.956176 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:48:23.956176 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:48:23.956176 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:48:23.956176 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:48:23.956176 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:48:23.956176 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:23.958464 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 395/780] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 11 20:48:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:48:23.963833 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c075f15-27f6-42aa-8110-25f29c7fa41a None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:23.964374 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0604f0-34b2-4635-87f9-3df0c8e52d63 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:24.003042 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009d149-96a1-4f81-b7b8-a553ac6ccac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:24.003989 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009d149-96a1-4f81-b7b8-a553ac6ccac7 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:24.004304 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009d149-96a1-4f81-b7b8-a553ac6ccac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:24.004585 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009d149-96a1-4f81-b7b8-a553ac6ccac7 None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:24.005800 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009d149-96a1-4f81-b7b8-a553ac6ccac7 None admin] RBAC: Adding query filter params (type=network) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:24.006262 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009d149-96a1-4f81-b7b8-a553ac6ccac7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:24.007641 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009d149-96a1-4f81-b7b8-a553ac6ccac7 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:24.013851 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 386/781] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Jul 11 20:48:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:24.019879 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009d149-96a1-4f81-b7b8-a553ac6ccac7 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:24.190677 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c075f15-27f6-42aa-8110-25f29c7fa41a None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:24.193231 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009d149-96a1-4f81-b7b8-a553ac6ccac7 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:24.254369 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b443f9-8dfa-4c0e-975b-9e7038aaea5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:24.255854 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b443f9-8dfa-4c0e-975b-9e7038aaea5e None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:24.257666 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b443f9-8dfa-4c0e-975b-9e7038aaea5e None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:24.258185 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b443f9-8dfa-4c0e-975b-9e7038aaea5e None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:24.259064 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028f505-588c-446c-9968-36ef0f127712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:24.260094 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b443f9-8dfa-4c0e-975b-9e7038aaea5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:24.260966 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028f505-588c-446c-9968-36ef0f127712 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:24.261519 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b443f9-8dfa-4c0e-975b-9e7038aaea5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:24.262006 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028f505-588c-446c-9968-36ef0f127712 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:24.263647 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b443f9-8dfa-4c0e-975b-9e7038aaea5e None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:24.264202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028f505-588c-446c-9968-36ef0f127712 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:24.265260 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028f505-588c-446c-9968-36ef0f127712 None admin] RBAC: Adding query filter params (interface=public, service_id=fb0e21869273431884f10790ba820583, region_id=RegionOne) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:24.265799 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028f505-588c-446c-9968-36ef0f127712 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:24.268632 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028f505-588c-446c-9968-36ef0f127712 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:24.280605 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 387/782] 10.222.0.40 () {56 vars in 1251 bytes} [Mon Jul 11 20:48:24 2022] GET /identity/v3/endpoints?service_id=fb0e21869273431884f10790ba820583&interface=public®ion_id=RegionOne => generated 194 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:24.282205 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 396/783] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:48:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:24.284776 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028f505-588c-446c-9968-36ef0f127712 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:24.288618 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b443f9-8dfa-4c0e-975b-9e7038aaea5e None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:24.299295 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:24.337480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:24.457021 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028f505-588c-446c-9968-36ef0f127712 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:24.476906 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b443f9-8dfa-4c0e-975b-9e7038aaea5e None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:24.523685 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60106ef-cd19-404d-88cf-a697d394cd1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:24.526996 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60106ef-cd19-404d-88cf-a697d394cd1e None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:24.527481 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60106ef-cd19-404d-88cf-a697d394cd1e None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:24.529279 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60106ef-cd19-404d-88cf-a697d394cd1e None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:24.530168 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60106ef-cd19-404d-88cf-a697d394cd1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:24.531752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60106ef-cd19-404d-88cf-a697d394cd1e None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:24.542907 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 388/784] 10.222.0.40 () {56 vars in 1087 bytes} [Mon Jul 11 20:48:24 2022] GET /identity/v3/services => generated 772 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:24.550583 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204cdce-324d-47d8-ac71-b3af35a2cece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:24.551799 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204cdce-324d-47d8-ac71-b3af35a2cece None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:24.552381 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204cdce-324d-47d8-ac71-b3af35a2cece None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:24.552863 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204cdce-324d-47d8-ac71-b3af35a2cece None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:24.565693 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1204cdce-324d-47d8-ac71-b3af35a2cece None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:24.567505 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1204cdce-324d-47d8-ac71-b3af35a2cece None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:24.587730 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-1204cdce-324d-47d8-ac71-b3af35a2cece None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:24.587730 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:24.587730 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:24.587730 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:24.587730 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:24.587730 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:24.587730 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:24.587730 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:24.587730 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:24.587730 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:24.587730 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:24.587730 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:24.587730 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:24.587730 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:24.587730 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:24.588757 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:24.588757 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:24.588757 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:24.588757 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:24.588757 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:24.588757 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:24.588757 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:24.588757 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:24.588757 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:24.588757 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:24.588757 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:24.588757 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:24.588757 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:24.588757 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:24.588757 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:24.588757 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:24.588757 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:24.589680 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:24.589680 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:24.589680 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:24.589680 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:24.591778 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 397/785] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:24.596918 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60106ef-cd19-404d-88cf-a697d394cd1e None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:24.717985 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:24.753191 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60106ef-cd19-404d-88cf-a697d394cd1e None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:24.793188 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413745c-b381-42ed-bbca-53adce85036d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:24.793805 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413745c-b381-42ed-bbca-53adce85036d None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:24.794095 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413745c-b381-42ed-bbca-53adce85036d None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:24.794377 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413745c-b381-42ed-bbca-53adce85036d None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:24.795112 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413745c-b381-42ed-bbca-53adce85036d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:24.795425 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413745c-b381-42ed-bbca-53adce85036d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:24.796826 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413745c-b381-42ed-bbca-53adce85036d None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:24.809618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 389/786] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:24.814901 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204cdce-324d-47d8-ac71-b3af35a2cece None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:24.919565 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:24.962816 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204cdce-324d-47d8-ac71-b3af35a2cece None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:25.010516 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdfcc0-b275-4f4e-a4c0-c3705d570427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:25.011324 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdfcc0-b275-4f4e-a4c0-c3705d570427 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:25.011611 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdfcc0-b275-4f4e-a4c0-c3705d570427 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:25.011889 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdfcc0-b275-4f4e-a4c0-c3705d570427 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:25.026433 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cdfcc0-b275-4f4e-a4c0-c3705d570427 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:25.027879 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cdfcc0-b275-4f4e-a4c0-c3705d570427 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:25.047496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-16cdfcc0-b275-4f4e-a4c0-c3705d570427 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 20:48:25.047496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:25.047496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:25.047496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:25.047496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:25.047496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:25.047496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:25.047496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:25.047496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:25.047496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:25.047496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:25.047496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:25.047496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:48:25.047496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:48:25.047496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:48:25.047496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:48:25.048720 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:25.048720 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:25.048720 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:48:25.048720 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:25.048720 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:48:25.048720 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:25.048720 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:25.048720 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:25.048720 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:25.048720 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:25.048720 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:25.048720 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:25.048720 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:25.048720 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:25.048720 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:25.048720 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:25.048720 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:25.048720 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:25.050046 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:25.050046 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:25.050046 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:48:25.050046 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:48:25.050046 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:48:25.050046 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:48:25.050046 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:48:25.050046 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:48:25.050046 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 20:48:25.050046 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:25.050046 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 398/787] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 11 20:48:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:25.054887 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413745c-b381-42ed-bbca-53adce85036d None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:25.210726 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413745c-b381-42ed-bbca-53adce85036d None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:25.240860 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:25.246989 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829cb080-446b-48a1-970f-c7618e80b129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:25.247723 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829cb080-446b-48a1-970f-c7618e80b129 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:25.248059 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829cb080-446b-48a1-970f-c7618e80b129 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:25.248223 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c06b5-eb2c-43ad-a628-13375ba2700d None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:25.248634 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829cb080-446b-48a1-970f-c7618e80b129 None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:25.248709 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c06b5-eb2c-43ad-a628-13375ba2700d None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:25.248778 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c06b5-eb2c-43ad-a628-13375ba2700d None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:25.249196 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829cb080-446b-48a1-970f-c7618e80b129 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:25.249506 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829cb080-446b-48a1-970f-c7618e80b129 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:25.250845 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 399/788] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:25.251265 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829cb080-446b-48a1-970f-c7618e80b129 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:25.265415 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a18a83-b10d-4a03-abc6-bb27eb7c2de4 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:25.265831 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a18a83-b10d-4a03-abc6-bb27eb7c2de4 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:25.266215 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a18a83-b10d-4a03-abc6-bb27eb7c2de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:25.274413 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 390/789] 10.222.0.40 () {56 vars in 1135 bytes} [Mon Jul 11 20:48:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:25.276933 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829cb080-446b-48a1-970f-c7618e80b129 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:25.289597 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-a8a18a83-b10d-4a03-abc6-bb27eb7c2de4 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:25.291019 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a8a18a83-b10d-4a03-abc6-bb27eb7c2de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:25.404242 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 400/790] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:48:25.467868 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829cb080-446b-48a1-970f-c7618e80b129 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:25.483016 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a18a83-b10d-4a03-abc6-bb27eb7c2de4 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:25.510891 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9afbba-5151-4ea6-9c2b-55e7890a5b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:25.511961 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9afbba-5151-4ea6-9c2b-55e7890a5b31 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:25.511961 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9afbba-5151-4ea6-9c2b-55e7890a5b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:25.512256 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9afbba-5151-4ea6-9c2b-55e7890a5b31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:25.529103 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9afbba-5151-4ea6-9c2b-55e7890a5b31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:25.530551 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9afbba-5151-4ea6-9c2b-55e7890a5b31 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:25.559501 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-9a9afbba-5151-4ea6-9c2b-55e7890a5b31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:25.559501 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:25.559501 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:25.559501 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:25.559501 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:25.559501 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:25.559501 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:25.559501 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:25.559501 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:25.559501 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:25.559501 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:25.559501 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:25.559501 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:25.559501 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:25.559501 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:25.560568 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:25.560568 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:25.560568 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:25.560568 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:25.560568 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:25.560568 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:25.560568 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:25.560568 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:25.560568 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:25.560568 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:25.560568 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:25.560568 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:25.560568 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:25.560568 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:25.560568 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:25.560568 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:25.560568 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:25.561458 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:25.561458 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:25.561458 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:25.561458 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:25.567122 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:25.569301 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 391/791] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:25.576221 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9afbba-5151-4ea6-9c2b-55e7890a5b31 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:25.612599 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a18a83-b10d-4a03-abc6-bb27eb7c2de4 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:25.626269 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:25.650258 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37968a4d-a6c8-46a1-9ea7-a9ff5c4e92ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:25.651062 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37968a4d-a6c8-46a1-9ea7-a9ff5c4e92ae None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:25.651366 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37968a4d-a6c8-46a1-9ea7-a9ff5c4e92ae None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:25.652458 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37968a4d-a6c8-46a1-9ea7-a9ff5c4e92ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:25.662790 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37968a4d-a6c8-46a1-9ea7-a9ff5c4e92ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:48:25.671054 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-37968a4d-a6c8-46a1-9ea7-a9ff5c4e92ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:48:25.671054 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:25.671054 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:25.671054 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:25.671054 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:25.671054 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:25.671054 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:25.671054 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:25.671054 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:25.671054 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:25.671054 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:25.671054 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:25.671054 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:48:25.671054 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:48:25.671054 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:48:25.671054 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:48:25.672026 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:48:25.672026 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:48:25.672026 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:48:25.672026 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:48:25.672026 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:25.672026 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:25.672026 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:25.672026 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:25.672026 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:25.672026 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:25.672026 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:25.672026 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:25.672026 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:25.672026 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:25.672026 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:25.672026 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:25.672866 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:25.672866 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:25.672866 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:25.672866 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:25.672866 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:48:25.672866 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:48:25.672866 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:48:25.672866 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:48:25.672866 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:48:25.672866 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:48:25.672866 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:48:25.672866 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:25.672866 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 401/792] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 11 20:48:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:48:25.673969 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc3346-a931-491a-ab69-52dabe875198 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:25.674269 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc3346-a931-491a-ab69-52dabe875198 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:25.674552 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc3346-a931-491a-ab69-52dabe875198 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:25.679835 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 402/793] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:25.680780 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc3346-a931-491a-ab69-52dabe875198 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:25.703675 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9afbba-5151-4ea6-9c2b-55e7890a5b31 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:25.741131 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b3959-98b0-4ea5-93b9-d7cce861d2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:25.742198 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b3959-98b0-4ea5-93b9-d7cce861d2b9 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:25.742786 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b3959-98b0-4ea5-93b9-d7cce861d2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:25.743251 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b3959-98b0-4ea5-93b9-d7cce861d2b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:25.744183 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b3959-98b0-4ea5-93b9-d7cce861d2b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:25.744789 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b3959-98b0-4ea5-93b9-d7cce861d2b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:25.746455 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b3959-98b0-4ea5-93b9-d7cce861d2b9 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:25.760212 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 392/794] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:25.761799 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b3630-b198-44b1-aefc-a73df9653bc3 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:25.762306 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b3630-b198-44b1-aefc-a73df9653bc3 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:25.762869 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b3630-b198-44b1-aefc-a73df9653bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:25.781150 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-4e2b3630-b198-44b1-aefc-a73df9653bc3 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:25.782672 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-4e2b3630-b198-44b1-aefc-a73df9653bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:25.790337 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc3346-a931-491a-ab69-52dabe875198 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:25.813649 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:25.826629 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c0c58b-e744-432d-ad64-9c1676dc2284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:25.827489 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0c58b-e744-432d-ad64-9c1676dc2284 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:25.827673 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0c58b-e744-432d-ad64-9c1676dc2284 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:25.827905 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0c58b-e744-432d-ad64-9c1676dc2284 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:25.828683 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c0c58b-e744-432d-ad64-9c1676dc2284 None admin] RBAC: Adding query filter params (name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:25.828992 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c0c58b-e744-432d-ad64-9c1676dc2284 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:25.830464 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c0c58b-e744-432d-ad64-9c1676dc2284 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:25.839670 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 403/795] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jul 11 20:48:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:25.840443 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c0c58b-e744-432d-ad64-9c1676dc2284 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:25.859152 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 393/796] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:48:25.860322 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b3630-b198-44b1-aefc-a73df9653bc3 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:25.896688 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:25.967154 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b3630-b198-44b1-aefc-a73df9653bc3 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:25.967879 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c0c58b-e744-432d-ad64-9c1676dc2284 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:26.003157 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa10e5c-b0cf-4070-ae91-2460cfbfa747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:26.004085 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa10e5c-b0cf-4070-ae91-2460cfbfa747 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:26.004372 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa10e5c-b0cf-4070-ae91-2460cfbfa747 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:26.004664 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa10e5c-b0cf-4070-ae91-2460cfbfa747 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:26.007029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca9672-1c68-4391-b49f-79bd7bd1270d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:26.008214 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca9672-1c68-4391-b49f-79bd7bd1270d None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:26.009234 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca9672-1c68-4391-b49f-79bd7bd1270d None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:26.009918 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca9672-1c68-4391-b49f-79bd7bd1270d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:26.013140 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa10e5c-b0cf-4070-ae91-2460cfbfa747 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:26.014460 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa10e5c-b0cf-4070-ae91-2460cfbfa747 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:26.021597 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca9672-1c68-4391-b49f-79bd7bd1270d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:26.023315 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca9672-1c68-4391-b49f-79bd7bd1270d None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:26.030055 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-afa10e5c-b0cf-4070-ae91-2460cfbfa747 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:26.030055 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:26.030055 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:26.030055 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:26.030055 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:26.030055 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:26.030055 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:26.030055 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:26.030055 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:26.030055 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:26.030055 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:26.030055 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:26.030055 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:48:26.030055 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:48:26.030055 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:48:26.031020 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:48:26.031020 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:26.031020 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:26.031020 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:26.031020 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:26.031020 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:26.031020 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:26.031020 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:26.031020 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:26.031020 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:26.031020 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:26.031020 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:26.031020 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:26.031020 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:26.031020 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:26.031020 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:26.031020 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:26.031922 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:48:26.031922 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:48:26.031922 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:48:26.031922 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:48:26.031922 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:48:26.031922 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:48:26.031922 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:26.031922 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:26.031922 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 404/797] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:48:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:26.032895 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa10e5c-b0cf-4070-ae91-2460cfbfa747 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:26.048653 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-97ca9672-1c68-4391-b49f-79bd7bd1270d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:26.048653 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:26.048653 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:26.048653 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:26.048653 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:26.048653 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:26.048653 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:26.048653 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:26.048653 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:26.048653 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:26.048653 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:26.048653 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:26.048653 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:26.048653 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:26.048653 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:26.049629 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:26.049629 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:26.049629 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:26.049629 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:26.049629 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:26.049629 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:26.049629 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:26.049629 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:26.049629 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:26.049629 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:26.049629 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:26.049629 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:26.049629 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:26.049629 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:26.049629 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:26.049629 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:26.049629 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:26.050519 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:26.050519 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:26.050519 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:26.050519 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:26.053039 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 394/798] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:26.054188 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca9672-1c68-4391-b49f-79bd7bd1270d None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:26.082579 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:26.141110 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa10e5c-b0cf-4070-ae91-2460cfbfa747 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:26.149660 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:26.168482 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca9672-1c68-4391-b49f-79bd7bd1270d None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:26.184185 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd756d-d099-4a83-a5ef-536ced62cf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:26.185276 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd756d-d099-4a83-a5ef-536ced62cf97 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:26.185569 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd756d-d099-4a83-a5ef-536ced62cf97 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:26.186111 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd756d-d099-4a83-a5ef-536ced62cf97 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:26.187163 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd756d-d099-4a83-a5ef-536ced62cf97 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:26.188576 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd756d-d099-4a83-a5ef-536ced62cf97 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:26.201251 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-79fd756d-d099-4a83-a5ef-536ced62cf97 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 20:48:26.201251 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:26.201251 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:48:26.201251 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:48:26.201251 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:48:26.201251 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:48:26.201251 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:48:26.201251 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:26.201251 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 20:48:26.201251 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:26.201251 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:48:26.201251 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:26.201251 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:26.201251 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:26.201251 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:26.201251 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:26.202225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:26.202225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:26.202225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:26.202225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:26.202225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:26.202225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:26.202225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:26.202225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:48:26.202225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:48:26.202225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:48:26.202225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:48:26.202225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:26.202225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:26.202225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:26.202225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:26.202225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:26.203752 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:26.203752 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:26.203752 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:26.203752 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:26.203752 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:26.203752 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:26.203752 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:26.203752 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:26.203752 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:26.203752 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:26.203752 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:26.203752 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:48:26.203752 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:26.203752 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 20:48:26.203752 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:26.203752 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 405/799] 10.222.0.40 () {56 vars in 1129 bytes} [Mon Jul 11 20:48:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:26.204693 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd756d-d099-4a83-a5ef-536ced62cf97 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:26.209445 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621e7f9-a6b1-483e-a769-4fb662e48634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:26.210122 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621e7f9-a6b1-483e-a769-4fb662e48634 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:26.210408 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621e7f9-a6b1-483e-a769-4fb662e48634 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:26.210688 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621e7f9-a6b1-483e-a769-4fb662e48634 None admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:26.212091 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d621e7f9-a6b1-483e-a769-4fb662e48634 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:26.212705 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d621e7f9-a6b1-483e-a769-4fb662e48634 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:26.213978 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d621e7f9-a6b1-483e-a769-4fb662e48634 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:26.226671 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 395/800] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 11 20:48:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:26.229577 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dfe0f-4ae1-464e-9229-84d2e03351a4 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:26.230226 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dfe0f-4ae1-464e-9229-84d2e03351a4 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:26.230820 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dfe0f-4ae1-464e-9229-84d2e03351a4 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:26.237328 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 396/801] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:26.237328 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0dfe0f-4ae1-464e-9229-84d2e03351a4 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:26.316028 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd756d-d099-4a83-a5ef-536ced62cf97 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:26.326811 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:26.349980 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0dfe0f-4ae1-464e-9229-84d2e03351a4 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:26.354098 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a27580-e61d-42f5-9f94-da1a3f27f1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:26.354775 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a27580-e61d-42f5-9f94-da1a3f27f1ee None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:26.355060 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a27580-e61d-42f5-9f94-da1a3f27f1ee None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:26.355400 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a27580-e61d-42f5-9f94-da1a3f27f1ee None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:26.356136 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a27580-e61d-42f5-9f94-da1a3f27f1ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:26.356849 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a27580-e61d-42f5-9f94-da1a3f27f1ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:26.359299 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a27580-e61d-42f5-9f94-da1a3f27f1ee None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:26.377597 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 406/802] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:26.377597 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a27580-e61d-42f5-9f94-da1a3f27f1ee None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:26.391692 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d121348-8a76-4204-ab78-5f85ebdc031a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:26.392421 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d121348-8a76-4204-ab78-5f85ebdc031a None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:26.392711 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d121348-8a76-4204-ab78-5f85ebdc031a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:26.393000 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d121348-8a76-4204-ab78-5f85ebdc031a None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:26.393711 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d121348-8a76-4204-ab78-5f85ebdc031a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:26.394025 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d121348-8a76-4204-ab78-5f85ebdc031a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:26.395412 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d121348-8a76-4204-ab78-5f85ebdc031a None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:26.400162 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 397/803] 10.222.0.40 () {56 vars in 1124 bytes} [Mon Jul 11 20:48:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:26.401330 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d34313-8a76-4500-810c-5232036b3636 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:26.401622 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d34313-8a76-4500-810c-5232036b3636 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:26.401904 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d34313-8a76-4500-810c-5232036b3636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:26.413072 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:26.419210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-32d34313-8a76-4500-810c-5232036b3636 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:26.420441 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-32d34313-8a76-4500-810c-5232036b3636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:26.489809 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a27580-e61d-42f5-9f94-da1a3f27f1ee None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:26.497423 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 398/804] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:48:26.497423 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d34313-8a76-4500-810c-5232036b3636 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:26.532655 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef7e24-c9bc-4538-a9e0-85cdcb374f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:26.533547 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef7e24-c9bc-4538-a9e0-85cdcb374f3d None admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:26.533829 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef7e24-c9bc-4538-a9e0-85cdcb374f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:26.534107 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef7e24-c9bc-4538-a9e0-85cdcb374f3d None admin] PATH_INFO: `/v3/projects/eca3ef2561fa435e80ff451aeab14f3b/users/dc950dfb1d3b4308a33f3d430fe34c1c/roles/86273ff072f3438d822e870272491768` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:26.536080 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef7e24-c9bc-4538-a9e0-85cdcb374f3d None admin] RBAC: Authorizing `identity:create_grant(project_id=eca3ef2561fa435e80ff451aeab14f3b, user_id=dc950dfb1d3b4308a33f3d430fe34c1c, role_id=86273ff072f3438d822e870272491768)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:26.537506 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef7e24-c9bc-4538-a9e0-85cdcb374f3d None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:26.609434 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 407/805] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 11 20:48:26 2022] PUT /identity/v3/projects/eca3ef2561fa435e80ff451aeab14f3b/users/dc950dfb1d3b4308a33f3d430fe34c1c/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:48:26.609434 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef7e24-c9bc-4538-a9e0-85cdcb374f3d None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:26.621330 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d34313-8a76-4500-810c-5232036b3636 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:26.642990 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:26.686129 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4addbcb7-644e-45e1-a161-66b2be43e077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:26.687909 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4addbcb7-644e-45e1-a161-66b2be43e077 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:26.688677 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4addbcb7-644e-45e1-a161-66b2be43e077 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:26.689141 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4addbcb7-644e-45e1-a161-66b2be43e077 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:26.693759 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:26.701992 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4addbcb7-644e-45e1-a161-66b2be43e077 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:26.703776 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4addbcb7-644e-45e1-a161-66b2be43e077 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:26.732917 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-4addbcb7-644e-45e1-a161-66b2be43e077 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 20:48:26.732917 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:26.732917 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:26.732917 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:26.732917 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:26.732917 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:26.732917 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:26.732917 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:26.732917 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:26.732917 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:26.732917 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:26.732917 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:26.732917 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:48:26.732917 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:48:26.732917 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:48:26.732917 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:48:26.733969 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:26.733969 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:26.733969 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:48:26.733969 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:26.733969 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:48:26.733969 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:26.733969 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:26.733969 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:26.733969 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:26.733969 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:26.733969 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:26.733969 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:26.733969 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:26.733969 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:26.733969 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:26.733969 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:26.733969 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:26.733969 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:26.734910 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:26.734910 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:26.734910 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:48:26.734910 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:48:26.734910 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:48:26.734910 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:48:26.734910 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:48:26.734910 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:48:26.734910 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 20:48:26.734910 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:26.743577 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 399/806] 10.222.0.40 () {56 vars in 1117 bytes} [Mon Jul 11 20:48:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:26.743577 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4addbcb7-644e-45e1-a161-66b2be43e077 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:26.745250 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef7e24-c9bc-4538-a9e0-85cdcb374f3d None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:26.803100 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a94c57-de03-40c4-9931-4d70d78b7b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:26.804489 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a94c57-de03-40c4-9931-4d70d78b7b96 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:26.804602 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a94c57-de03-40c4-9931-4d70d78b7b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:26.804976 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a94c57-de03-40c4-9931-4d70d78b7b96 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:26.807036 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a94c57-de03-40c4-9931-4d70d78b7b96 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:26.807356 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a94c57-de03-40c4-9931-4d70d78b7b96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:26.809125 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a94c57-de03-40c4-9931-4d70d78b7b96 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:26.815311 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 408/807] 10.222.0.40 () {56 vars in 1124 bytes} [Mon Jul 11 20:48:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:26.816094 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a94c57-de03-40c4-9931-4d70d78b7b96 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:26.879683 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4addbcb7-644e-45e1-a161-66b2be43e077 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:26.923721 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b91719-5261-49a5-8121-dade13e3fea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:26.924938 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b91719-5261-49a5-8121-dade13e3fea0 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:26.925231 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b91719-5261-49a5-8121-dade13e3fea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:26.925513 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b91719-5261-49a5-8121-dade13e3fea0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:26.939780 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b91719-5261-49a5-8121-dade13e3fea0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:48:26.941029 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:26.951050 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a94c57-de03-40c4-9931-4d70d78b7b96 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:26.951207 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-f3b91719-5261-49a5-8121-dade13e3fea0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:48:26.951207 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:26.951207 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:26.951207 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:26.951207 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:26.951207 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:26.951207 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:26.951207 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:26.951207 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:26.951207 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:26.951207 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:26.951207 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:26.951207 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:48:26.951207 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:48:26.951207 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:48:26.951207 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:48:26.952576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:48:26.952576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:48:26.952576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:48:26.952576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:48:26.952576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:26.952576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:26.952576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:26.952576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:26.952576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:26.952576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:26.952576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:26.952576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:26.952576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:26.952576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:26.952576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:26.952576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:26.953410 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:26.953410 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:26.953410 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:26.953410 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:26.953410 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:48:26.953410 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:48:26.953410 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:48:26.953410 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:48:26.953410 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:48:26.953410 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:48:26.953410 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:48:26.953410 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:26.953410 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 400/808] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 11 20:48:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:26.954683 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b91719-5261-49a5-8121-dade13e3fea0 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:26.998001 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c4d2b-8862-43d2-ad73-f4a00d01caf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:26.998602 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c4d2b-8862-43d2-ad73-f4a00d01caf9 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:26.998888 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c4d2b-8862-43d2-ad73-f4a00d01caf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:26.999168 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c4d2b-8862-43d2-ad73-f4a00d01caf9 None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:27.000290 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c4d2b-8862-43d2-ad73-f4a00d01caf9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:27.000603 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c4d2b-8862-43d2-ad73-f4a00d01caf9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:27.002054 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c4d2b-8862-43d2-ad73-f4a00d01caf9 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:27.024792 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 409/809] 10.222.0.40 () {56 vars in 1149 bytes} [Mon Jul 11 20:48:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:27.024792 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c4d2b-8862-43d2-ad73-f4a00d01caf9 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:27.027520 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:27.078954 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b91719-5261-49a5-8121-dade13e3fea0 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:27.116284 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad9bfc-6f11-493d-8515-fcc173b8c9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:27.116951 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad9bfc-6f11-493d-8515-fcc173b8c9a2 None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:27.117241 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad9bfc-6f11-493d-8515-fcc173b8c9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:27.117543 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad9bfc-6f11-493d-8515-fcc173b8c9a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:27.118428 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad9bfc-6f11-493d-8515-fcc173b8c9a2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:27.119793 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad9bfc-6f11-493d-8515-fcc173b8c9a2 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:27.129948 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c4d2b-8862-43d2-ad73-f4a00d01caf9 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:27.165219 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aacf7c2-4afc-4e90-86cf-079dbedbce84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:27.165989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacf7c2-4afc-4e90-86cf-079dbedbce84 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:27.166276 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacf7c2-4afc-4e90-86cf-079dbedbce84 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:27.166554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacf7c2-4afc-4e90-86cf-079dbedbce84 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:27.167296 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aacf7c2-4afc-4e90-86cf-079dbedbce84 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:27.167606 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aacf7c2-4afc-4e90-86cf-079dbedbce84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:27.169099 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aacf7c2-4afc-4e90-86cf-079dbedbce84 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:27.177516 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 410/810] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:48:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:27.178762 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255b822-65e6-408b-9368-d805c6ef4eae None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:27.179059 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255b822-65e6-408b-9368-d805c6ef4eae None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:27.179342 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255b822-65e6-408b-9368-d805c6ef4eae None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:27.180989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 411/811] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:27.181532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255b822-65e6-408b-9368-d805c6ef4eae None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:27.198874 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:27.215153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 401/812] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 11 20:48:26 2022] POST /identity/v3/endpoints => generated 346 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:48:27.216596 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad9bfc-6f11-493d-8515-fcc173b8c9a2 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:27.344229 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255b822-65e6-408b-9368-d805c6ef4eae None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:27.356474 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad9bfc-6f11-493d-8515-fcc173b8c9a2 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:27.376352 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:27.390315 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99073745-aae4-413b-858e-0ad055317eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:27.391137 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99073745-aae4-413b-858e-0ad055317eec None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:27.391424 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99073745-aae4-413b-858e-0ad055317eec None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:27.391717 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99073745-aae4-413b-858e-0ad055317eec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:27.404625 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99073745-aae4-413b-858e-0ad055317eec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:27.406252 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99073745-aae4-413b-858e-0ad055317eec None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:27.409599 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f726b-62e4-40e8-bc25-3c725172ef55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:27.410516 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f726b-62e4-40e8-bc25-3c725172ef55 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:27.410805 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f726b-62e4-40e8-bc25-3c725172ef55 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:27.411080 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f726b-62e4-40e8-bc25-3c725172ef55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:27.424608 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f726b-62e4-40e8-bc25-3c725172ef55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:27.426179 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f726b-62e4-40e8-bc25-3c725172ef55 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:27.427220 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-99073745-aae4-413b-858e-0ad055317eec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:27.427220 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:27.427220 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:27.427220 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:27.427220 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:27.427220 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:27.427220 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:27.427220 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:27.427220 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:27.427220 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:27.427220 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:27.427220 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:27.427220 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:27.427220 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:27.427220 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:27.428202 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:27.428202 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:27.428202 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:27.428202 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:27.428202 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:27.428202 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:27.428202 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:27.428202 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:27.428202 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:27.428202 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:27.428202 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:27.428202 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:27.428202 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:27.428202 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:27.428202 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:27.428202 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:27.428202 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:27.429618 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:27.429618 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:27.429618 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:27.429618 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:27.429618 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 412/813] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:27.430627 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d550b-824d-41e1-aee6-7a1b5b60c140 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:27.430816 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d550b-824d-41e1-aee6-7a1b5b60c140 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:27.431092 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d550b-824d-41e1-aee6-7a1b5b60c140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:27.453521 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-6d9d550b-824d-41e1-aee6-7a1b5b60c140 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:27.454771 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-6d9d550b-824d-41e1-aee6-7a1b5b60c140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:27.459497 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-020f726b-62e4-40e8-bc25-3c725172ef55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:27.459497 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:27.459497 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:27.459497 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:27.459497 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:27.459497 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:27.459497 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:27.459497 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:27.459497 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:27.459497 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:27.459497 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:27.459497 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:27.459497 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:27.459497 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:27.459497 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:27.460453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:27.460453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:27.460453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:27.460453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:27.460453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:27.460453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:27.460453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:27.460453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:27.460453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:27.460453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:27.460453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:27.460453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:27.460453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:27.460453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:27.460453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:27.460453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:27.460453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:27.461849 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:27.461849 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:27.461849 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:27.461849 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:27.461849 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 402/814] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:27.462655 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f726b-62e4-40e8-bc25-3c725172ef55 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:27.519454 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:27.532773 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 413/815] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:48:27.533988 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d550b-824d-41e1-aee6-7a1b5b60c140 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:27.642533 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d550b-824d-41e1-aee6-7a1b5b60c140 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:27.686547 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637474f-fe7a-4504-bccf-a3fa4b6a7e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:27.687654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637474f-fe7a-4504-bccf-a3fa4b6a7e1a None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:27.688230 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637474f-fe7a-4504-bccf-a3fa4b6a7e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:27.688734 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637474f-fe7a-4504-bccf-a3fa4b6a7e1a None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:27.689650 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8637474f-fe7a-4504-bccf-a3fa4b6a7e1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:27.690160 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8637474f-fe7a-4504-bccf-a3fa4b6a7e1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:27.691739 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8637474f-fe7a-4504-bccf-a3fa4b6a7e1a None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:27.705052 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 414/816] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:27.710289 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637474f-fe7a-4504-bccf-a3fa4b6a7e1a None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:27.721030 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f726b-62e4-40e8-bc25-3c725172ef55 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:27.756720 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc8fca-5c9c-463b-aebd-5326d670fcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:27.757431 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc8fca-5c9c-463b-aebd-5326d670fcd3 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:27.757706 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc8fca-5c9c-463b-aebd-5326d670fcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:27.757981 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc8fca-5c9c-463b-aebd-5326d670fcd3 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:27.759285 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc8fca-5c9c-463b-aebd-5326d670fcd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:27.759746 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc8fca-5c9c-463b-aebd-5326d670fcd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:27.761153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc8fca-5c9c-463b-aebd-5326d670fcd3 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:27.768396 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:27.773177 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 403/817] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:27.774634 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc8fca-5c9c-463b-aebd-5326d670fcd3 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:27.802226 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:27.823696 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637474f-fe7a-4504-bccf-a3fa4b6a7e1a None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:27.866165 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a9312-126a-41db-9a85-bce3b6583f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:27.868770 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a9312-126a-41db-9a85-bce3b6583f89 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:27.869761 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a9312-126a-41db-9a85-bce3b6583f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:27.870245 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a9312-126a-41db-9a85-bce3b6583f89 None admin] PATH_INFO: `/v3/services/network` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:27.871511 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a9312-126a-41db-9a85-bce3b6583f89 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:27.873632 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a9312-126a-41db-9a85-bce3b6583f89 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:27.891174 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-8a2a9312-126a-41db-9a85-bce3b6583f89 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 20:48:27.891174 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:27.891174 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:48:27.891174 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:48:27.891174 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:48:27.891174 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:48:27.891174 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:48:27.891174 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:27.891174 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 20:48:27.891174 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:27.891174 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:48:27.891174 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:27.891174 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:27.891174 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:27.891174 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:27.891174 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:27.891174 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:27.892255 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:27.892255 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:27.892255 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:27.892255 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:27.892255 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:27.892255 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:27.892255 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:48:27.892255 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:48:27.892255 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:48:27.892255 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:48:27.892255 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:27.892255 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:27.892255 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:27.892255 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:27.892255 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:27.892255 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:27.893133 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:27.893133 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:27.893133 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:27.893133 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:27.893133 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:27.893133 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:27.893133 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:27.893133 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:27.893133 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:27.893133 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:27.893133 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:48:27.893133 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:27.893133 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 20:48:27.893133 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:27.896036 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 415/818] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:48:27 2022] GET /identity/v3/services/network => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:27.897046 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a9312-126a-41db-9a85-bce3b6583f89 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:27.901503 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc8fca-5c9c-463b-aebd-5326d670fcd3 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:27.953360 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e5e76-69e5-4e03-af8e-2caafb66ac54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:27.954243 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e5e76-69e5-4e03-af8e-2caafb66ac54 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:27.954531 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e5e76-69e5-4e03-af8e-2caafb66ac54 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:27.954813 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e5e76-69e5-4e03-af8e-2caafb66ac54 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:27.964581 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e5e76-69e5-4e03-af8e-2caafb66ac54 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:27.966036 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e5e76-69e5-4e03-af8e-2caafb66ac54 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:27.985418 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-ed0e5e76-69e5-4e03-af8e-2caafb66ac54 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 20:48:27.985418 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:27.985418 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:27.985418 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:27.985418 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:27.985418 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:27.985418 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:27.985418 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:27.985418 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:27.985418 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:27.985418 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:27.985418 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:27.985418 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:48:27.985418 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:48:27.985418 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:48:27.985418 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:48:27.986388 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:27.986388 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:27.986388 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:48:27.986388 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:27.986388 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:48:27.986388 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:27.986388 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:27.986388 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:27.986388 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:27.986388 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:27.986388 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:27.986388 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:27.986388 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:27.986388 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:27.986388 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:27.986388 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:27.986388 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:27.986388 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:27.987312 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:27.987312 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:27.987312 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:48:27.987312 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:48:27.987312 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:48:27.987312 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:48:27.987312 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:48:27.987312 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:48:27.987312 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 20:48:27.987312 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:27.987312 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 404/819] 10.222.0.40 () {56 vars in 1093 bytes} [Mon Jul 11 20:48:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:27.987888 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e5e76-69e5-4e03-af8e-2caafb66ac54 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:28.021133 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a9312-126a-41db-9a85-bce3b6583f89 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:28.035391 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:28.057136 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1fc4e1-7402-4487-8f2a-53b257bbd175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:28.057942 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1fc4e1-7402-4487-8f2a-53b257bbd175 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:28.058225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1fc4e1-7402-4487-8f2a-53b257bbd175 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:28.058510 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1fc4e1-7402-4487-8f2a-53b257bbd175 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:28.065574 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1fc4e1-7402-4487-8f2a-53b257bbd175 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:28.067037 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1fc4e1-7402-4487-8f2a-53b257bbd175 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:28.081870 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-fe1fc4e1-7402-4487-8f2a-53b257bbd175 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:28.081870 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:28.081870 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:28.081870 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:28.081870 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:28.081870 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:28.081870 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:28.081870 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:28.081870 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:28.081870 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:28.081870 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:28.081870 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:28.081870 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:48:28.081870 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:48:28.081870 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:48:28.082807 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:48:28.082807 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:28.082807 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:28.082807 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:28.082807 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:28.082807 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:28.082807 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:28.082807 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:28.082807 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:28.082807 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:28.082807 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:28.082807 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:28.082807 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:28.082807 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:28.082807 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:28.082807 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:28.082807 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:28.083700 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:48:28.083700 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:48:28.083700 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:48:28.083700 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:48:28.083700 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:48:28.083700 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:48:28.083700 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:28.083700 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:28.087063 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:28.087892 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 416/820] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:48:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:28.089369 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1fc4e1-7402-4487-8f2a-53b257bbd175 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:28.105017 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e5e76-69e5-4e03-af8e-2caafb66ac54 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:28.141574 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39dbaf-4e10-40b1-a9ed-b0bfaed49b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:28.142573 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39dbaf-4e10-40b1-a9ed-b0bfaed49b43 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:28.143084 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39dbaf-4e10-40b1-a9ed-b0bfaed49b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:28.143619 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39dbaf-4e10-40b1-a9ed-b0bfaed49b43 None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:28.144548 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39dbaf-4e10-40b1-a9ed-b0bfaed49b43 None admin] RBAC: Adding query filter params (name=network) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:28.145071 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39dbaf-4e10-40b1-a9ed-b0bfaed49b43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:28.146618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39dbaf-4e10-40b1-a9ed-b0bfaed49b43 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:28.152004 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 405/821] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Jul 11 20:48:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:28.153148 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39dbaf-4e10-40b1-a9ed-b0bfaed49b43 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:28.193477 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1fc4e1-7402-4487-8f2a-53b257bbd175 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:28.228898 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa7a3e3-ff1e-4a5b-b894-01c7068c7947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:28.229567 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7a3e3-ff1e-4a5b-b894-01c7068c7947 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:28.229858 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7a3e3-ff1e-4a5b-b894-01c7068c7947 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:28.230136 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7a3e3-ff1e-4a5b-b894-01c7068c7947 None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:28.230973 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa7a3e3-ff1e-4a5b-b894-01c7068c7947 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:28.231289 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa7a3e3-ff1e-4a5b-b894-01c7068c7947 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:28.232759 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa7a3e3-ff1e-4a5b-b894-01c7068c7947 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:28.250658 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 417/822] 10.222.0.40 () {56 vars in 1133 bytes} [Mon Jul 11 20:48:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:28.251439 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa7a3e3-ff1e-4a5b-b894-01c7068c7947 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:28.261306 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39dbaf-4e10-40b1-a9ed-b0bfaed49b43 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:28.287349 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:28.299014 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ecba69-f371-428f-84cc-1f1f7c818948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:28.300089 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ecba69-f371-428f-84cc-1f1f7c818948 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:28.300540 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ecba69-f371-428f-84cc-1f1f7c818948 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:28.301027 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ecba69-f371-428f-84cc-1f1f7c818948 None admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:28.301981 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ecba69-f371-428f-84cc-1f1f7c818948 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:28.302457 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ecba69-f371-428f-84cc-1f1f7c818948 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:28.304119 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ecba69-f371-428f-84cc-1f1f7c818948 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:28.317327 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 406/823] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 11 20:48:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:28.318404 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ecba69-f371-428f-84cc-1f1f7c818948 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:28.330823 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:28.363004 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa7a3e3-ff1e-4a5b-b894-01c7068c7947 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:28.406061 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68878e-c521-4c10-9fb1-c0da5601b933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:28.406670 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68878e-c521-4c10-9fb1-c0da5601b933 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:28.406955 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68878e-c521-4c10-9fb1-c0da5601b933 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:28.407234 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68878e-c521-4c10-9fb1-c0da5601b933 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:28.408112 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f68878e-c521-4c10-9fb1-c0da5601b933 None admin] RBAC: Adding query filter params (type=network) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:28.408395 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f68878e-c521-4c10-9fb1-c0da5601b933 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:28.409920 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f68878e-c521-4c10-9fb1-c0da5601b933 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:28.416741 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 418/824] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Jul 11 20:48:28 2022] GET /identity/v3/services?type=network => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:28.417835 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68878e-c521-4c10-9fb1-c0da5601b933 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:28.433723 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ecba69-f371-428f-84cc-1f1f7c818948 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:28.469166 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4edeb-a8fe-4e70-b230-5b7003d25dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:28.470291 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4edeb-a8fe-4e70-b230-5b7003d25dee None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:28.470791 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4edeb-a8fe-4e70-b230-5b7003d25dee None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:28.471278 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4edeb-a8fe-4e70-b230-5b7003d25dee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:28.529333 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68878e-c521-4c10-9fb1-c0da5601b933 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:28.532311 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:28.545718 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b4edeb-a8fe-4e70-b230-5b7003d25dee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:28.547449 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b4edeb-a8fe-4e70-b230-5b7003d25dee None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:28.558456 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:28.567338 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb6fbe-d1bb-4027-bab8-03200fac7d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:28.568459 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb6fbe-d1bb-4027-bab8-03200fac7d2f None admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:28.568893 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb6fbe-d1bb-4027-bab8-03200fac7d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:28.569348 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb6fbe-d1bb-4027-bab8-03200fac7d2f None admin] PATH_INFO: `/v3/projects/eca3ef2561fa435e80ff451aeab14f3b/users/90ea5d52fd6d4068b7837d363eebb94f/roles/17bc727d82f24074aba8b1185cb99739` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:28.585158 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb6fbe-d1bb-4027-bab8-03200fac7d2f None admin] RBAC: Authorizing `identity:create_grant(project_id=eca3ef2561fa435e80ff451aeab14f3b, user_id=90ea5d52fd6d4068b7837d363eebb94f, role_id=17bc727d82f24074aba8b1185cb99739)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:28.586660 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb6fbe-d1bb-4027-bab8-03200fac7d2f None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:28.664336 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 419/825] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 11 20:48:28 2022] PUT /identity/v3/projects/eca3ef2561fa435e80ff451aeab14f3b/users/90ea5d52fd6d4068b7837d363eebb94f/roles/17bc727d82f24074aba8b1185cb99739 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:48:28.665723 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb6fbe-d1bb-4027-bab8-03200fac7d2f None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:28.670993 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 407/826] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:48:28 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 20:48:28.672508 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4edeb-a8fe-4e70-b230-5b7003d25dee None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:28.880517 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb6fbe-d1bb-4027-bab8-03200fac7d2f None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:28.884010 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4edeb-a8fe-4e70-b230-5b7003d25dee None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:28.894475 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:28.925502 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3467c6d-1ca4-4183-8904-0cb5e03197b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:28.925692 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467eb40-312e-4e3a-9f67-3753ee40c1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:28.926135 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467eb40-312e-4e3a-9f67-3753ee40c1d2 None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:28.926257 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3467c6d-1ca4-4183-8904-0cb5e03197b9 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:28.926417 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467eb40-312e-4e3a-9f67-3753ee40c1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:28.926519 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3467c6d-1ca4-4183-8904-0cb5e03197b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:28.926699 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467eb40-312e-4e3a-9f67-3753ee40c1d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:28.926803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3467c6d-1ca4-4183-8904-0cb5e03197b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:28.927446 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c467eb40-312e-4e3a-9f67-3753ee40c1d2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:28.929032 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c467eb40-312e-4e3a-9f67-3753ee40c1d2 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:28.938399 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3467c6d-1ca4-4183-8904-0cb5e03197b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:28.940043 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3467c6d-1ca4-4183-8904-0cb5e03197b9 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:28.958649 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-b3467c6d-1ca4-4183-8904-0cb5e03197b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:28.958649 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:28.958649 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:28.958649 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:28.958649 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:28.958649 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:28.958649 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:28.958649 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:28.958649 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:28.958649 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:28.958649 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:28.958649 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:28.958649 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:28.958649 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:28.958649 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:28.959645 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:28.959645 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:28.959645 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:28.959645 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:28.959645 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:28.959645 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:28.959645 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:28.959645 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:28.959645 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:28.959645 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:28.959645 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:28.959645 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:28.959645 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:28.959645 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:28.959645 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:28.959645 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:28.959645 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:28.960575 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:28.960575 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:28.960575 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:28.960575 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:28.960575 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 408/827] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:28.961952 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56970108-a845-4041-b5dd-65153cdfa4a8 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:28.962248 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56970108-a845-4041-b5dd-65153cdfa4a8 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:28.962534 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56970108-a845-4041-b5dd-65153cdfa4a8 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:28.964093 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 409/828] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:28.968713 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56970108-a845-4041-b5dd-65153cdfa4a8 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:29.011590 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 420/829] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 11 20:48:28 2022] POST /identity/v3/endpoints => generated 327 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:48:29.016477 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052ea61-3268-4bae-b535-68a17915b23b None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:29.016477 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052ea61-3268-4bae-b535-68a17915b23b None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:29.016477 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052ea61-3268-4bae-b535-68a17915b23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:29.022676 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:29.041409 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-5052ea61-3268-4bae-b535-68a17915b23b None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:29.042871 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-5052ea61-3268-4bae-b535-68a17915b23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:29.172044 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56970108-a845-4041-b5dd-65153cdfa4a8 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:29.200599 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 421/830] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:48:29.228395 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef29c5-918a-4b82-89bf-ec24ba7604db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:29.229079 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef29c5-918a-4b82-89bf-ec24ba7604db None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:29.229365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef29c5-918a-4b82-89bf-ec24ba7604db None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:29.229643 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef29c5-918a-4b82-89bf-ec24ba7604db None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:29.230372 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef29c5-918a-4b82-89bf-ec24ba7604db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:29.230682 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef29c5-918a-4b82-89bf-ec24ba7604db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:29.232789 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef29c5-918a-4b82-89bf-ec24ba7604db None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:29.238197 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052ea61-3268-4bae-b535-68a17915b23b None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:29.246084 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 410/831] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:29.252647 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef29c5-918a-4b82-89bf-ec24ba7604db None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:29.273713 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:29.362565 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052ea61-3268-4bae-b535-68a17915b23b None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:29.364724 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef29c5-918a-4b82-89bf-ec24ba7604db None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:29.397420 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:29.403494 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9bf60-e0c4-4b0f-b955-e0ce4ed5125f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:29.404427 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9bf60-e0c4-4b0f-b955-e0ce4ed5125f None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:29.412129 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9bf60-e0c4-4b0f-b955-e0ce4ed5125f None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:29.412129 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9bf60-e0c4-4b0f-b955-e0ce4ed5125f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:29.412326 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b20360-372a-49e8-bfdc-8ae8998f8633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:29.412326 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b20360-372a-49e8-bfdc-8ae8998f8633 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:29.412326 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b20360-372a-49e8-bfdc-8ae8998f8633 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:29.412326 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b20360-372a-49e8-bfdc-8ae8998f8633 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:29.412884 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9bf60-e0c4-4b0f-b955-e0ce4ed5125f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:29.414453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9bf60-e0c4-4b0f-b955-e0ce4ed5125f None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:29.419700 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b20360-372a-49e8-bfdc-8ae8998f8633 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:48:29.427989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-e7b20360-372a-49e8-bfdc-8ae8998f8633 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:48:29.427989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:29.427989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:29.427989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:29.427989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:29.427989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:29.427989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:29.427989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:29.427989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:29.427989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:29.427989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:29.427989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:29.427989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:48:29.427989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:48:29.427989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:48:29.427989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:48:29.428912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:48:29.428912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:48:29.428912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:48:29.428912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:48:29.428912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:29.428912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:29.428912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:29.428912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:29.428912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:29.428912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:29.428912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:29.428912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:29.428912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:29.428912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:29.428912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:29.428912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:29.429743 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:29.429743 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:29.429743 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:29.429743 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:29.429743 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:48:29.429743 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:48:29.429743 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:48:29.429743 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:48:29.429743 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:48:29.429743 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:48:29.429743 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:48:29.429743 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:29.431624 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-25e9bf60-e0c4-4b0f-b955-e0ce4ed5125f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:29.431624 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:29.431624 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:29.431624 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:29.431624 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:29.431624 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:29.431624 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:29.431624 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:29.431624 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:29.431624 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:29.431624 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:29.431624 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:29.431624 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:48:29.431624 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:48:29.431624 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:48:29.432502 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:48:29.432502 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:29.432502 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:29.432502 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:29.432502 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:29.432502 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:29.432502 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:29.432502 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:29.432502 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:29.432502 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:29.432502 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:29.432502 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:29.432502 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:29.432502 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:29.432502 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:29.432502 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:29.432502 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:29.433384 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:48:29.433384 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:48:29.433384 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:48:29.433384 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:48:29.433384 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:48:29.433384 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:48:29.433384 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:29.433384 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:29.433384 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 411/832] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:48:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:29.435160 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 422/833] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 11 20:48:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:48:29.439831 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9bf60-e0c4-4b0f-b955-e0ce4ed5125f None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:29.442398 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b20360-372a-49e8-bfdc-8ae8998f8633 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:29.532626 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:29.550583 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b20360-372a-49e8-bfdc-8ae8998f8633 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:29.557547 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9bf60-e0c4-4b0f-b955-e0ce4ed5125f None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:29.584570 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc330b5e-f16b-45a3-b134-f7155b925ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:29.585240 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc330b5e-f16b-45a3-b134-f7155b925ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:29.585528 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc330b5e-f16b-45a3-b134-f7155b925ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:29.585807 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc330b5e-f16b-45a3-b134-f7155b925ed6 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:29.587284 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc330b5e-f16b-45a3-b134-f7155b925ed6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:29.587605 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc330b5e-f16b-45a3-b134-f7155b925ed6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:29.589016 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc330b5e-f16b-45a3-b134-f7155b925ed6 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:29.596944 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 423/834] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:48:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:29.598255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bca99e-6dc0-4da1-af68-ad7efca9edf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:29.599120 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bca99e-6dc0-4da1-af68-ad7efca9edf1 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:29.599598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bca99e-6dc0-4da1-af68-ad7efca9edf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:29.600077 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bca99e-6dc0-4da1-af68-ad7efca9edf1 None admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:29.601053 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bca99e-6dc0-4da1-af68-ad7efca9edf1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:29.601576 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba64515-cb43-43d9-8625-a3073ff9dbdc None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:29.601702 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bca99e-6dc0-4da1-af68-ad7efca9edf1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:29.602005 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba64515-cb43-43d9-8625-a3073ff9dbdc None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:29.602344 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba64515-cb43-43d9-8625-a3073ff9dbdc None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:29.603635 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bca99e-6dc0-4da1-af68-ad7efca9edf1 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:29.607668 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 424/835] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:29.607668 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba64515-cb43-43d9-8625-a3073ff9dbdc None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:29.616406 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 412/836] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 11 20:48:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:29.617565 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6acb2-3461-4833-80d8-2769441331c5 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:29.619541 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6acb2-3461-4833-80d8-2769441331c5 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:29.619541 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6acb2-3461-4833-80d8-2769441331c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:29.635295 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-f2c6acb2-3461-4833-80d8-2769441331c5 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:29.636506 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-f2c6acb2-3461-4833-80d8-2769441331c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:29.675691 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:29.711984 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 413/837] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:48:29.713149 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6acb2-3461-4833-80d8-2769441331c5 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:29.734456 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba64515-cb43-43d9-8625-a3073ff9dbdc None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:29.771900 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d72f88-c46a-4183-aa93-f12a91cb2618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:29.772777 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d72f88-c46a-4183-aa93-f12a91cb2618 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:29.773069 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d72f88-c46a-4183-aa93-f12a91cb2618 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:29.773340 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d72f88-c46a-4183-aa93-f12a91cb2618 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:29.785896 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d72f88-c46a-4183-aa93-f12a91cb2618 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:29.786482 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:29.788179 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d72f88-c46a-4183-aa93-f12a91cb2618 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:29.810909 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-d8d72f88-c46a-4183-aa93-f12a91cb2618 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:29.810909 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:29.810909 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:29.810909 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:29.810909 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:29.810909 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:29.810909 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:29.810909 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:29.810909 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:29.810909 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:29.810909 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:29.810909 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:29.810909 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:29.810909 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:29.810909 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:29.812192 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:29.812192 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:29.812192 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:29.812192 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:29.812192 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:29.812192 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:29.812192 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:29.812192 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:29.812192 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:29.812192 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:29.812192 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:29.812192 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:29.812192 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:29.812192 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:29.812192 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:29.812192 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:29.812192 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:29.817839 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:29.817839 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:29.817839 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:29.817839 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:29.817839 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 425/838] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:29.817839 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d72f88-c46a-4183-aa93-f12a91cb2618 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:29.826268 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6acb2-3461-4833-80d8-2769441331c5 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:29.862134 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e6443-e97e-4c44-a6a4-7759dbc0ebf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:29.862805 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e6443-e97e-4c44-a6a4-7759dbc0ebf1 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:29.863095 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e6443-e97e-4c44-a6a4-7759dbc0ebf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:29.863376 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e6443-e97e-4c44-a6a4-7759dbc0ebf1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:29.864237 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e6443-e97e-4c44-a6a4-7759dbc0ebf1 None admin] RBAC: Adding query filter params (role.id=86273ff072f3438d822e870272491768, scope.project.id=eca3ef2561fa435e80ff451aeab14f3b, user.id=8ac15411c75f4bd4a86f6753c9240a5b) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:29.864563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e6443-e97e-4c44-a6a4-7759dbc0ebf1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:29.865979 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e6443-e97e-4c44-a6a4-7759dbc0ebf1 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:29.880009 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 414/839] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:48:29 2022] GET /identity/v3/role_assignments?user.id=8ac15411c75f4bd4a86f6753c9240a5b&scope.project.id=eca3ef2561fa435e80ff451aeab14f3b&role.id=86273ff072f3438d822e870272491768 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:29.880009 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e6443-e97e-4c44-a6a4-7759dbc0ebf1 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:29.947520 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d72f88-c46a-4183-aa93-f12a91cb2618 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:29.958431 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:30.000143 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf545cd-b1d9-402c-9d5e-b86a318eca25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:30.001504 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf545cd-b1d9-402c-9d5e-b86a318eca25 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:30.001983 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf545cd-b1d9-402c-9d5e-b86a318eca25 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:30.002438 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf545cd-b1d9-402c-9d5e-b86a318eca25 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:30.003185 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf545cd-b1d9-402c-9d5e-b86a318eca25 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:30.004183 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e6443-e97e-4c44-a6a4-7759dbc0ebf1 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:30.004763 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf545cd-b1d9-402c-9d5e-b86a318eca25 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:30.023090 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-4bf545cd-b1d9-402c-9d5e-b86a318eca25 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 20:48:30.023090 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:30.023090 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:48:30.023090 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:48:30.023090 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:48:30.023090 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:48:30.023090 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:48:30.023090 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:30.023090 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 20:48:30.023090 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:30.023090 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:48:30.023090 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:30.023090 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:30.023090 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:30.023090 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:30.023090 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:30.023090 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:30.024399 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:30.024399 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:30.024399 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:30.024399 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:30.024399 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:30.024399 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:30.024399 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:48:30.024399 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:48:30.024399 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:48:30.024399 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:48:30.024399 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:30.024399 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:30.024399 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:30.024399 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:30.024399 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:30.024399 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:30.025435 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:30.025435 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:30.025435 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:30.025435 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:30.025435 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:30.025435 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:30.025435 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:30.025435 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:30.025435 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:30.025435 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:30.025435 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:48:30.025435 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:30.025435 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 20:48:30.025435 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:30.025435 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 426/840] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jul 11 20:48:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:30.033026 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf545cd-b1d9-402c-9d5e-b86a318eca25 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:30.046884 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:30.053202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416898d-7549-4e65-bcd3-bbaef71434d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:30.054057 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416898d-7549-4e65-bcd3-bbaef71434d7 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:30.054474 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416898d-7549-4e65-bcd3-bbaef71434d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:30.054857 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416898d-7549-4e65-bcd3-bbaef71434d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:30.056528 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f416898d-7549-4e65-bcd3-bbaef71434d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:30.057097 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f416898d-7549-4e65-bcd3-bbaef71434d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:30.058420 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f416898d-7549-4e65-bcd3-bbaef71434d7 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:30.073377 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 415/841] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:30.079280 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416898d-7549-4e65-bcd3-bbaef71434d7 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:30.165194 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf545cd-b1d9-402c-9d5e-b86a318eca25 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:30.192587 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416898d-7549-4e65-bcd3-bbaef71434d7 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:30.206092 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55159c72-d5c9-41dd-a24c-2c485ad6ccf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:30.206866 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55159c72-d5c9-41dd-a24c-2c485ad6ccf7 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:30.207156 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55159c72-d5c9-41dd-a24c-2c485ad6ccf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:30.207435 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55159c72-d5c9-41dd-a24c-2c485ad6ccf7 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:30.208173 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55159c72-d5c9-41dd-a24c-2c485ad6ccf7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:30.208501 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55159c72-d5c9-41dd-a24c-2c485ad6ccf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:30.209961 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55159c72-d5c9-41dd-a24c-2c485ad6ccf7 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:30.215525 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 427/842] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jul 11 20:48:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:30.221016 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55159c72-d5c9-41dd-a24c-2c485ad6ccf7 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:30.237873 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e979e3-7286-418a-94f5-bb8146ae6f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:30.239163 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e979e3-7286-418a-94f5-bb8146ae6f96 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:30.239646 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e979e3-7286-418a-94f5-bb8146ae6f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:30.240566 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e979e3-7286-418a-94f5-bb8146ae6f96 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:30.251931 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e979e3-7286-418a-94f5-bb8146ae6f96 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:30.253924 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e979e3-7286-418a-94f5-bb8146ae6f96 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:30.261632 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:30.273895 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-29e979e3-7286-418a-94f5-bb8146ae6f96 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 20:48:30.273895 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:30.273895 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:30.273895 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:30.273895 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:30.273895 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:30.273895 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:30.273895 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:30.273895 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:30.273895 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:30.273895 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:30.273895 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:30.273895 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:48:30.273895 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:48:30.273895 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:48:30.273895 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:48:30.275469 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:30.275469 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:30.275469 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:48:30.275469 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:30.275469 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:48:30.275469 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:30.275469 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:30.275469 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:30.275469 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:30.275469 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:30.275469 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:30.275469 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:30.275469 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:30.275469 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:30.275469 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:30.275469 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:30.275469 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:30.275469 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:30.276628 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:30.276628 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:30.276628 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:48:30.276628 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:48:30.276628 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:48:30.276628 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:48:30.276628 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:48:30.276628 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:48:30.276628 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 20:48:30.276628 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:30.279464 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 416/843] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 11 20:48:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:30.285504 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e979e3-7286-418a-94f5-bb8146ae6f96 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:30.353704 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55159c72-d5c9-41dd-a24c-2c485ad6ccf7 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:30.354308 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:30.402386 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76337a7a-ac72-4eb2-aa09-49d5ba65225c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:30.403064 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76337a7a-ac72-4eb2-aa09-49d5ba65225c None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:30.403374 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76337a7a-ac72-4eb2-aa09-49d5ba65225c None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:30.403652 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76337a7a-ac72-4eb2-aa09-49d5ba65225c None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:30.404859 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76337a7a-ac72-4eb2-aa09-49d5ba65225c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:30.405173 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76337a7a-ac72-4eb2-aa09-49d5ba65225c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:30.406816 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76337a7a-ac72-4eb2-aa09-49d5ba65225c None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:30.420000 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 428/844] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jul 11 20:48:30 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:30.420709 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e979e3-7286-418a-94f5-bb8146ae6f96 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:30.460208 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a76de-3553-4dc7-a341-0dd638af2b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:30.460899 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a76de-3553-4dc7-a341-0dd638af2b81 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:30.461184 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a76de-3553-4dc7-a341-0dd638af2b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:30.462177 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a76de-3553-4dc7-a341-0dd638af2b81 None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:30.462963 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a76de-3553-4dc7-a341-0dd638af2b81 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:30.463275 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a76de-3553-4dc7-a341-0dd638af2b81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:30.464744 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a76de-3553-4dc7-a341-0dd638af2b81 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:30.488312 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 417/845] 10.222.0.40 () {56 vars in 1135 bytes} [Mon Jul 11 20:48:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:30.494594 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76337a7a-ac72-4eb2-aa09-49d5ba65225c None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:30.607572 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:30.611134 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76337a7a-ac72-4eb2-aa09-49d5ba65225c None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:30.647629 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d32393-195c-4349-b77f-b976f8cbe75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:30.648657 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d32393-195c-4349-b77f-b976f8cbe75a None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:30.649478 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d32393-195c-4349-b77f-b976f8cbe75a None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:30.649761 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d32393-195c-4349-b77f-b976f8cbe75a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:30.721367 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d32393-195c-4349-b77f-b976f8cbe75a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:30.722833 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d32393-195c-4349-b77f-b976f8cbe75a None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:30.821746 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:30.826249 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 429/846] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:48:30 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 20:48:30.831881 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a76de-3553-4dc7-a341-0dd638af2b81 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:30.886608 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d8a83-71e3-4b55-842a-7845101ed994 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:30.886922 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d8a83-71e3-4b55-842a-7845101ed994 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:30.887089 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d8a83-71e3-4b55-842a-7845101ed994 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:30.888776 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 430/847] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:48:30.895934 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87fed29-5c0d-41c7-b4d9-705818a7a3d1 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:30.896491 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87fed29-5c0d-41c7-b4d9-705818a7a3d1 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:30.896995 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87fed29-5c0d-41c7-b4d9-705818a7a3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:30.915299 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-c87fed29-5c0d-41c7-b4d9-705818a7a3d1 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:30.916863 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-c87fed29-5c0d-41c7-b4d9-705818a7a3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:30.955057 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a76de-3553-4dc7-a341-0dd638af2b81 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:30.964812 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:30.990990 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815917f-e59c-4928-808a-5f7c9be15651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:30.991940 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815917f-e59c-4928-808a-5f7c9be15651 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:30.992261 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815917f-e59c-4928-808a-5f7c9be15651 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:30.992662 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815917f-e59c-4928-808a-5f7c9be15651 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:30.994850 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 431/848] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 20:48:31.008708 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815917f-e59c-4928-808a-5f7c9be15651 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:31.010695 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815917f-e59c-4928-808a-5f7c9be15651 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:31.020040 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87fed29-5c0d-41c7-b4d9-705818a7a3d1 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:31.030688 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-4815917f-e59c-4928-808a-5f7c9be15651 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:31.030688 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:31.030688 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:31.030688 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:31.030688 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:31.030688 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:31.030688 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:31.030688 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:31.030688 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:31.030688 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:31.030688 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:31.030688 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:31.030688 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:31.030688 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:31.030688 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:31.031603 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:31.031603 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:31.031603 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:31.031603 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:31.031603 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:31.031603 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:31.031603 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:31.031603 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:31.031603 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:31.031603 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:31.031603 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:31.031603 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:31.031603 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:31.031603 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:31.031603 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:31.031603 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:31.031603 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:31.032564 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:31.032564 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:31.032564 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:31.032564 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:31.036331 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 418/849] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:31.037542 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815917f-e59c-4928-808a-5f7c9be15651 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:31.144127 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87fed29-5c0d-41c7-b4d9-705818a7a3d1 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:31.144307 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815917f-e59c-4928-808a-5f7c9be15651 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:31.175394 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:31.180782 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e5647d-cf85-42fa-98af-c3eefc64ae28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:31.181521 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5647d-cf85-42fa-98af-c3eefc64ae28 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:31.181886 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5647d-cf85-42fa-98af-c3eefc64ae28 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:31.182163 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5647d-cf85-42fa-98af-c3eefc64ae28 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:31.182997 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e5647d-cf85-42fa-98af-c3eefc64ae28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:31.183310 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e5647d-cf85-42fa-98af-c3eefc64ae28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:31.185085 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e5647d-cf85-42fa-98af-c3eefc64ae28 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:31.185866 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03fb23-f890-4aa3-b3c9-23327f9ff9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:31.187121 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03fb23-f890-4aa3-b3c9-23327f9ff9af None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:31.187719 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03fb23-f890-4aa3-b3c9-23327f9ff9af None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:31.188311 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03fb23-f890-4aa3-b3c9-23327f9ff9af None admin] PATH_INFO: `/v3/roles/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:31.199912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf03fb23-f890-4aa3-b3c9-23327f9ff9af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:48:31.202848 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 419/850] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:31.204259 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e5647d-cf85-42fa-98af-c3eefc64ae28 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:31.209115 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-bf03fb23-f890-4aa3-b3c9-23327f9ff9af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:48:31.209115 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:31.209115 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:31.209115 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:31.209115 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:31.209115 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:31.209115 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:31.209115 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:31.209115 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:31.209115 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:31.209115 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:31.209115 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:31.209115 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:48:31.209115 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:48:31.209115 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:48:31.209115 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:48:31.210066 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:48:31.210066 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:48:31.210066 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:48:31.210066 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:48:31.210066 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:31.210066 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:31.210066 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:31.210066 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:31.210066 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:31.210066 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:31.210066 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:31.210066 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:31.210066 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:31.210066 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:31.210066 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:31.210066 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:31.210922 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:31.210922 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:31.210922 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:31.210922 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:31.210922 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:48:31.210922 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:48:31.210922 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:48:31.210922 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:48:31.210922 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:48:31.210922 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:48:31.210922 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:48:31.210922 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:31.214394 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 432/851] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 11 20:48:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:48:31.220938 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03fb23-f890-4aa3-b3c9-23327f9ff9af None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:31.235132 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:31.339058 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e5647d-cf85-42fa-98af-c3eefc64ae28 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:31.353481 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03fb23-f890-4aa3-b3c9-23327f9ff9af None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:31.374247 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ae53b-b0f0-47ff-bdd7-dfb14a7cd9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:31.374880 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ae53b-b0f0-47ff-bdd7-dfb14a7cd9e9 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:31.375417 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ae53b-b0f0-47ff-bdd7-dfb14a7cd9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:31.375689 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ae53b-b0f0-47ff-bdd7-dfb14a7cd9e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:31.382626 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ae53b-b0f0-47ff-bdd7-dfb14a7cd9e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:31.384034 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ae53b-b0f0-47ff-bdd7-dfb14a7cd9e9 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:31.390950 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c450d-cae4-46a6-af3b-1d9bc9235259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:31.392002 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c450d-cae4-46a6-af3b-1d9bc9235259 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:31.392499 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c450d-cae4-46a6-af3b-1d9bc9235259 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:31.392983 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c450d-cae4-46a6-af3b-1d9bc9235259 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:31.393932 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c450d-cae4-46a6-af3b-1d9bc9235259 None admin] RBAC: Adding query filter params (name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:31.394502 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c450d-cae4-46a6-af3b-1d9bc9235259 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:31.396204 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c450d-cae4-46a6-af3b-1d9bc9235259 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:31.399872 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-180ae53b-b0f0-47ff-bdd7-dfb14a7cd9e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:31.399872 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:31.399872 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:31.399872 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:31.399872 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:31.399872 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:31.399872 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:31.399872 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:31.399872 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:31.399872 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:31.399872 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:31.399872 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:31.399872 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:48:31.399872 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:48:31.399872 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:48:31.400768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:48:31.400768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:31.400768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:31.400768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:31.400768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:31.400768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:31.400768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:31.400768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:31.400768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:31.400768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:31.400768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:31.400768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:31.400768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:31.400768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:31.400768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:31.400768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:31.400768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:31.401671 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:48:31.401671 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:48:31.401671 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:48:31.401671 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:48:31.401671 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:48:31.401671 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:48:31.401671 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:31.401671 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:31.405877 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 420/852] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:48:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:48:31.406715 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ae53b-b0f0-47ff-bdd7-dfb14a7cd9e9 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:31.413869 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 433/853] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jul 11 20:48:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:31.416339 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c450d-cae4-46a6-af3b-1d9bc9235259 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:31.469452 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:31.490553 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:31.511417 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ae53b-b0f0-47ff-bdd7-dfb14a7cd9e9 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:31.527037 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c450d-cae4-46a6-af3b-1d9bc9235259 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:31.547752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d09381-6ef4-45a5-bf99-ac5abf1479d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:31.548473 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d09381-6ef4-45a5-bf99-ac5abf1479d3 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:31.548744 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d09381-6ef4-45a5-bf99-ac5abf1479d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:31.549020 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d09381-6ef4-45a5-bf99-ac5abf1479d3 None admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:31.549806 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d09381-6ef4-45a5-bf99-ac5abf1479d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:31.550391 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d09381-6ef4-45a5-bf99-ac5abf1479d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:31.551516 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d09381-6ef4-45a5-bf99-ac5abf1479d3 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:31.564314 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 421/854] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 11 20:48:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:31.570291 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d09381-6ef4-45a5-bf99-ac5abf1479d3 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:31.572331 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa518beb-684b-4121-afc4-d9c9932dde37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:31.573593 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa518beb-684b-4121-afc4-d9c9932dde37 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:31.574201 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa518beb-684b-4121-afc4-d9c9932dde37 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:31.574755 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa518beb-684b-4121-afc4-d9c9932dde37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:31.588695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa518beb-684b-4121-afc4-d9c9932dde37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:31.590595 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa518beb-684b-4121-afc4-d9c9932dde37 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:31.610885 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-fa518beb-684b-4121-afc4-d9c9932dde37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:31.610885 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:31.610885 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:31.610885 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:31.610885 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:31.610885 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:31.610885 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:31.610885 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:31.610885 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:31.610885 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:31.610885 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:31.610885 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:31.610885 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:31.610885 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:31.610885 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:31.611833 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:31.611833 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:31.611833 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:31.611833 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:31.611833 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:31.611833 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:31.611833 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:31.611833 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:31.611833 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:31.611833 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:31.611833 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:31.611833 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:31.611833 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:31.611833 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:31.611833 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:31.611833 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:31.611833 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:31.613102 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:31.613102 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:31.613102 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:31.613102 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:31.620335 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 434/855] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:48:31.621821 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa518beb-684b-4121-afc4-d9c9932dde37 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:31.676285 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d09381-6ef4-45a5-bf99-ac5abf1479d3 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:31.712477 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680817b-a6b1-4e1d-a836-9ba0863a026a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:31.713143 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680817b-a6b1-4e1d-a836-9ba0863a026a None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:31.713429 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680817b-a6b1-4e1d-a836-9ba0863a026a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:31.713707 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680817b-a6b1-4e1d-a836-9ba0863a026a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:31.714533 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680817b-a6b1-4e1d-a836-9ba0863a026a None admin] RBAC: Adding query filter params (role.id=86273ff072f3438d822e870272491768, scope.project.id=eca3ef2561fa435e80ff451aeab14f3b, user.id=dc950dfb1d3b4308a33f3d430fe34c1c) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:31.714845 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680817b-a6b1-4e1d-a836-9ba0863a026a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:31.716280 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680817b-a6b1-4e1d-a836-9ba0863a026a None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:31.728246 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 422/856] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:48:31 2022] GET /identity/v3/role_assignments?user.id=dc950dfb1d3b4308a33f3d430fe34c1c&scope.project.id=eca3ef2561fa435e80ff451aeab14f3b&role.id=86273ff072f3438d822e870272491768 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:31.747662 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa518beb-684b-4121-afc4-d9c9932dde37 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:31.749833 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:31.789139 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d4f61-2af8-424f-a292-884efa57e263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:31.791013 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d4f61-2af8-424f-a292-884efa57e263 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:31.791533 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d4f61-2af8-424f-a292-884efa57e263 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:31.792049 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d4f61-2af8-424f-a292-884efa57e263 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:31.793012 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d4f61-2af8-424f-a292-884efa57e263 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:31.793575 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d4f61-2af8-424f-a292-884efa57e263 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:31.795211 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d4f61-2af8-424f-a292-884efa57e263 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:31.814260 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 435/857] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:31.816344 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680817b-a6b1-4e1d-a836-9ba0863a026a None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:31.821515 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:31.928632 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680817b-a6b1-4e1d-a836-9ba0863a026a None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:31.964665 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e5f1e-65d6-4470-b91a-d83ad346880d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:31.965847 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e5f1e-65d6-4470-b91a-d83ad346880d None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:31.966342 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e5f1e-65d6-4470-b91a-d83ad346880d None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:31.966845 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e5f1e-65d6-4470-b91a-d83ad346880d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:31.975107 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e5f1e-65d6-4470-b91a-d83ad346880d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:31.976961 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e5f1e-65d6-4470-b91a-d83ad346880d None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:31.992944 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-955e5f1e-65d6-4470-b91a-d83ad346880d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 20:48:31.992944 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:31.992944 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:31.992944 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:31.992944 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:31.992944 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:31.992944 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:31.992944 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:31.992944 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:31.992944 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:31.992944 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:31.992944 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:31.992944 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:48:31.992944 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:48:31.992944 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:48:31.992944 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:48:31.994047 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:31.994047 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:31.994047 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:48:31.994047 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:31.994047 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:48:31.994047 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:31.994047 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:31.994047 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:31.994047 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:31.994047 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:31.994047 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:31.994047 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:31.994047 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:31.994047 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:31.994047 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:31.994047 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:31.994047 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:31.994047 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:31.994987 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:31.994987 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:31.994987 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:48:31.994987 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:48:31.994987 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:48:31.994987 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:48:31.994987 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:48:31.994987 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:48:31.994987 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 20:48:31.994987 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:32.002231 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 423/858] 10.222.0.40 () {56 vars in 1117 bytes} [Mon Jul 11 20:48:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:32.003780 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d4f61-2af8-424f-a292-884efa57e263 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:32.082191 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcb91f-d969-4b47-9146-79956e2666be None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:32.082506 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcb91f-d969-4b47-9146-79956e2666be None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:32.082760 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcb91f-d969-4b47-9146-79956e2666be None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:32.084434 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 424/859] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:32.090497 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce2bfb-2e47-4ed1-9daf-fbd43197efa4 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:32.090792 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce2bfb-2e47-4ed1-9daf-fbd43197efa4 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:32.091060 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce2bfb-2e47-4ed1-9daf-fbd43197efa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:32.112848 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-75ce2bfb-2e47-4ed1-9daf-fbd43197efa4 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:32.115097 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-75ce2bfb-2e47-4ed1-9daf-fbd43197efa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:32.118260 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d4f61-2af8-424f-a292-884efa57e263 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:32.154509 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c0b0d5-3f29-4a3a-91da-834a9b165cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:32.155265 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0b0d5-3f29-4a3a-91da-834a9b165cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:32.155649 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0b0d5-3f29-4a3a-91da-834a9b165cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:32.156060 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0b0d5-3f29-4a3a-91da-834a9b165cd5 None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:32.157016 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c0b0d5-3f29-4a3a-91da-834a9b165cd5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:32.157519 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c0b0d5-3f29-4a3a-91da-834a9b165cd5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:32.158961 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c0b0d5-3f29-4a3a-91da-834a9b165cd5 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:32.182853 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 436/860] 10.222.0.40 () {56 vars in 1149 bytes} [Mon Jul 11 20:48:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:32.184583 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c0b0d5-3f29-4a3a-91da-834a9b165cd5 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:32.200389 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:32.214639 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 425/861] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 20:48:32.215321 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:32.232652 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce2bfb-2e47-4ed1-9daf-fbd43197efa4 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:32.318765 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c0b0d5-3f29-4a3a-91da-834a9b165cd5 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:32.347422 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce2bfb-2e47-4ed1-9daf-fbd43197efa4 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:32.357834 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e44345-9551-4631-8373-0831c33c69e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:32.358939 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e44345-9551-4631-8373-0831c33c69e6 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:32.359063 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e44345-9551-4631-8373-0831c33c69e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:32.359448 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e44345-9551-4631-8373-0831c33c69e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:32.393553 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2749c912-cb1a-4c44-abb5-9935c57db1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:32.395214 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749c912-cb1a-4c44-abb5-9935c57db1fa None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:32.395658 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749c912-cb1a-4c44-abb5-9935c57db1fa None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:32.396120 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749c912-cb1a-4c44-abb5-9935c57db1fa None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:32.396929 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2749c912-cb1a-4c44-abb5-9935c57db1fa None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:32.399509 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2749c912-cb1a-4c44-abb5-9935c57db1fa None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:32.415556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-2749c912-cb1a-4c44-abb5-9935c57db1fa None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 20:48:32.415556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:32.415556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:48:32.415556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:48:32.415556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:48:32.415556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:48:32.415556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:48:32.415556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:32.415556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 20:48:32.415556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:32.415556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:48:32.415556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:32.415556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:32.415556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:32.415556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:32.415556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:32.416903 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:32.416903 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:32.416903 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:32.416903 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:32.416903 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:32.416903 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:32.416903 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:32.416903 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:48:32.416903 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:48:32.416903 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:48:32.416903 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:48:32.416903 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:32.416903 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:32.416903 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:32.416903 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:32.416903 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:32.417946 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:32.417946 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:32.417946 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:32.417946 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:32.417946 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:32.417946 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:32.417946 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:32.417946 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:32.417946 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:32.417946 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:32.417946 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:32.417946 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:48:32.417946 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:32.417946 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 20:48:32.417946 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:32.420593 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 426/862] 10.222.0.40 () {56 vars in 1132 bytes} [Mon Jul 11 20:48:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:32.426127 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2749c912-cb1a-4c44-abb5-9935c57db1fa None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:32.446182 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e44345-9551-4631-8373-0831c33c69e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:32.448451 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e44345-9551-4631-8373-0831c33c69e6 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:32.475816 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:32.504535 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:32.550366 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2749c912-cb1a-4c44-abb5-9935c57db1fa None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:32.567857 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 437/863] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:48:32 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 20:48:32.573619 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3f90a-ea1b-4415-b36e-2552524bef13 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:32.573920 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3f90a-ea1b-4415-b36e-2552524bef13 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:32.574204 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3f90a-ea1b-4415-b36e-2552524bef13 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:32.576133 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 438/864] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:32.580701 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3f90a-ea1b-4415-b36e-2552524bef13 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:32.586951 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf881e-22b8-4912-8fa4-9dbd6aa719dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:32.588075 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf881e-22b8-4912-8fa4-9dbd6aa719dd None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:32.588509 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf881e-22b8-4912-8fa4-9dbd6aa719dd None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:32.588932 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf881e-22b8-4912-8fa4-9dbd6aa719dd None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:32.589894 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf881e-22b8-4912-8fa4-9dbd6aa719dd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:32.590369 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf881e-22b8-4912-8fa4-9dbd6aa719dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:32.591868 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf881e-22b8-4912-8fa4-9dbd6aa719dd None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:32.601548 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 427/865] 10.222.0.40 () {56 vars in 1126 bytes} [Mon Jul 11 20:48:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:32.603059 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3e33a-48c6-487c-a725-4ac08b542825 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:32.603514 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3e33a-48c6-487c-a725-4ac08b542825 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:32.603981 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3e33a-48c6-487c-a725-4ac08b542825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:32.620885 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-2af3e33a-48c6-487c-a725-4ac08b542825 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:32.622064 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-2af3e33a-48c6-487c-a725-4ac08b542825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:32.699133 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3f90a-ea1b-4415-b36e-2552524bef13 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:32.715991 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 428/866] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:48:32.715991 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3e33a-48c6-487c-a725-4ac08b542825 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:32.729911 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:32.746588 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2bc80-1f5c-46d5-901b-24daebd747d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:32.747397 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2bc80-1f5c-46d5-901b-24daebd747d0 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:32.747801 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2bc80-1f5c-46d5-901b-24daebd747d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:32.748141 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2bc80-1f5c-46d5-901b-24daebd747d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:32.759214 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa2bc80-1f5c-46d5-901b-24daebd747d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:32.760736 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa2bc80-1f5c-46d5-901b-24daebd747d0 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:32.773560 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:32.780428 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-4fa2bc80-1f5c-46d5-901b-24daebd747d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:32.780428 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:32.780428 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:32.780428 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:32.780428 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:32.780428 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:32.780428 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:32.780428 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:32.780428 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:32.780428 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:32.780428 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:32.780428 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:32.780428 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:32.780428 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:32.780428 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:32.781303 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:32.781303 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:32.781303 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:32.781303 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:32.781303 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:32.781303 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:32.781303 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:32.781303 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:32.781303 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:32.781303 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:32.781303 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:32.781303 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:32.781303 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:32.781303 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:32.781303 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:32.781303 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:32.781303 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:32.782176 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:32.782176 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:32.782176 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:32.782176 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:32.782176 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 439/867] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:32.782444 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2bc80-1f5c-46d5-901b-24daebd747d0 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:32.834430 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3e33a-48c6-487c-a725-4ac08b542825 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:32.875559 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d72a27-1b52-40c3-aa20-162d2c408ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:32.876261 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d72a27-1b52-40c3-aa20-162d2c408ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:32.876547 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d72a27-1b52-40c3-aa20-162d2c408ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:32.876821 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d72a27-1b52-40c3-aa20-162d2c408ba5 None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:32.877527 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d72a27-1b52-40c3-aa20-162d2c408ba5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:32.877835 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d72a27-1b52-40c3-aa20-162d2c408ba5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:32.879183 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d72a27-1b52-40c3-aa20-162d2c408ba5 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:32.884391 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 429/868] 10.222.0.40 () {56 vars in 1126 bytes} [Mon Jul 11 20:48:32 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:32.885170 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d72a27-1b52-40c3-aa20-162d2c408ba5 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:32.899059 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2bc80-1f5c-46d5-901b-24daebd747d0 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:32.942557 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce92b0-5573-4f05-afcf-df5685250e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:32.943622 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce92b0-5573-4f05-afcf-df5685250e5c None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:32.944132 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce92b0-5573-4f05-afcf-df5685250e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:32.944604 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce92b0-5573-4f05-afcf-df5685250e5c None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:32.946479 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce92b0-5573-4f05-afcf-df5685250e5c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:32.948391 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce92b0-5573-4f05-afcf-df5685250e5c None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:33.012918 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d72a27-1b52-40c3-aa20-162d2c408ba5 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:33.036264 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:33.048185 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 440/869] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Jul 11 20:48:32 2022] POST /identity/v3/services => generated 251 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:48:33.076951 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e82a5-f85a-4cfa-aa4b-2aabbee5db91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:33.077650 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e82a5-f85a-4cfa-aa4b-2aabbee5db91 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:33.077935 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e82a5-f85a-4cfa-aa4b-2aabbee5db91 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:33.078208 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e82a5-f85a-4cfa-aa4b-2aabbee5db91 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:33.078970 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e82a5-f85a-4cfa-aa4b-2aabbee5db91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:33.079282 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e82a5-f85a-4cfa-aa4b-2aabbee5db91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:33.080916 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e82a5-f85a-4cfa-aa4b-2aabbee5db91 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:33.095753 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 430/870] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:33.102710 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce92b0-5573-4f05-afcf-df5685250e5c None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:33.142300 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:33.220211 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce92b0-5573-4f05-afcf-df5685250e5c None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:33.259515 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133cb5bb-f7d8-4e97-8ce6-bfb9f7831475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:33.260787 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133cb5bb-f7d8-4e97-8ce6-bfb9f7831475 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:33.261239 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133cb5bb-f7d8-4e97-8ce6-bfb9f7831475 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:33.261781 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133cb5bb-f7d8-4e97-8ce6-bfb9f7831475 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:33.271074 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133cb5bb-f7d8-4e97-8ce6-bfb9f7831475 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:33.271327 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133cb5bb-f7d8-4e97-8ce6-bfb9f7831475 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:33.286369 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-133cb5bb-f7d8-4e97-8ce6-bfb9f7831475 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:33.286369 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:33.286369 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:33.286369 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:33.286369 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:33.286369 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:33.286369 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:33.286369 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:33.286369 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:33.286369 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:33.286369 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:33.286369 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:33.286369 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:48:33.286369 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:48:33.286369 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:48:33.287292 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:48:33.287292 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:33.287292 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:33.287292 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:33.287292 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:33.287292 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:33.287292 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:33.287292 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:33.287292 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:33.287292 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:33.287292 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:33.287292 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:33.287292 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:33.287292 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:33.287292 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:33.287292 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:33.287292 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:33.288225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:48:33.288225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:48:33.288225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:48:33.288225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:48:33.288225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:48:33.288225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:48:33.288225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:33.288225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:33.292099 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 441/871] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:48:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:33.295003 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e82a5-f85a-4cfa-aa4b-2aabbee5db91 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:33.406474 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e82a5-f85a-4cfa-aa4b-2aabbee5db91 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:33.443710 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bfa50e-efbb-4a24-b388-bf6b038bb89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:33.444424 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfa50e-efbb-4a24-b388-bf6b038bb89f None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:33.444720 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfa50e-efbb-4a24-b388-bf6b038bb89f None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:33.445006 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfa50e-efbb-4a24-b388-bf6b038bb89f None admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:33.446383 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bfa50e-efbb-4a24-b388-bf6b038bb89f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:33.446712 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bfa50e-efbb-4a24-b388-bf6b038bb89f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:33.448164 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bfa50e-efbb-4a24-b388-bf6b038bb89f None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:33.466998 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 431/872] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 11 20:48:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:33.468389 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133cb5bb-f7d8-4e97-8ce6-bfb9f7831475 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:33.567945 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:33.576999 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133cb5bb-f7d8-4e97-8ce6-bfb9f7831475 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:33.613664 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6501d71-3c8a-41c9-ae09-cc6da9ce42cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:33.614344 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6501d71-3c8a-41c9-ae09-cc6da9ce42cd None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:33.614643 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6501d71-3c8a-41c9-ae09-cc6da9ce42cd None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:33.614937 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6501d71-3c8a-41c9-ae09-cc6da9ce42cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:33.615782 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6501d71-3c8a-41c9-ae09-cc6da9ce42cd None admin] RBAC: Adding query filter params (role.id=17bc727d82f24074aba8b1185cb99739, scope.project.id=eca3ef2561fa435e80ff451aeab14f3b, user.id=90ea5d52fd6d4068b7837d363eebb94f) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:33.616137 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6501d71-3c8a-41c9-ae09-cc6da9ce42cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:33.618867 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6501d71-3c8a-41c9-ae09-cc6da9ce42cd None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:33.632138 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 442/873] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:48:33 2022] GET /identity/v3/role_assignments?user.id=90ea5d52fd6d4068b7837d363eebb94f&scope.project.id=eca3ef2561fa435e80ff451aeab14f3b&role.id=17bc727d82f24074aba8b1185cb99739 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:33.863312 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89107c9-76ce-41b4-87f8-f358c02c5e9b None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:33.863506 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89107c9-76ce-41b4-87f8-f358c02c5e9b None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:33.863799 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89107c9-76ce-41b4-87f8-f358c02c5e9b None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:33.865431 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 432/874] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:33.870779 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a8c0a-fc8c-4c54-8960-a17146fcb6fd None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:33.871079 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a8c0a-fc8c-4c54-8960-a17146fcb6fd None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:33.871364 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a8c0a-fc8c-4c54-8960-a17146fcb6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:33.890626 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-dc2a8c0a-fc8c-4c54-8960-a17146fcb6fd None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:33.891891 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-dc2a8c0a-fc8c-4c54-8960-a17146fcb6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:33.962462 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 443/875] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:33 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:48:33.985582 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89107c9-76ce-41b4-87f8-f358c02c5e9b None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:34.019550 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:34.101194 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89107c9-76ce-41b4-87f8-f358c02c5e9b None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:34.141127 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becea2fb-bef3-4d9e-8578-08999ce79ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:34.141872 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becea2fb-bef3-4d9e-8578-08999ce79ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:34.142164 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becea2fb-bef3-4d9e-8578-08999ce79ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:34.142452 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becea2fb-bef3-4d9e-8578-08999ce79ac7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:34.143122 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becea2fb-bef3-4d9e-8578-08999ce79ac7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:34.144521 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becea2fb-bef3-4d9e-8578-08999ce79ac7 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:34.157931 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-becea2fb-bef3-4d9e-8578-08999ce79ac7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 20:48:34.157931 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:34.157931 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:48:34.157931 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:48:34.157931 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:48:34.157931 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:48:34.157931 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:48:34.157931 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:34.157931 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 20:48:34.157931 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:34.157931 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:48:34.157931 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:34.157931 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:34.157931 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:34.157931 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:34.157931 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:34.157931 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:34.158962 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:34.158962 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:34.158962 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:34.158962 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:34.158962 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:34.158962 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:34.158962 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:48:34.158962 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:48:34.158962 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:48:34.158962 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:48:34.158962 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:34.158962 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:34.158962 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:34.158962 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:34.158962 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:34.158962 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:34.159823 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:34.159823 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:34.159823 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:34.159823 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:34.159823 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:34.159823 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:34.159823 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:34.159823 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:34.159823 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:34.159823 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:34.159823 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:48:34.159823 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:34.159823 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 20:48:34.159823 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:34.159823 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 433/876] 10.222.0.40 () {56 vars in 1126 bytes} [Mon Jul 11 20:48:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:34.167824 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a8c0a-fc8c-4c54-8960-a17146fcb6fd None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:34.257275 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:34.271874 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a8c0a-fc8c-4c54-8960-a17146fcb6fd None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:34.307541 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d0e03f-9eff-4ab2-aa5e-0487d5b51a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:34.308244 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0e03f-9eff-4ab2-aa5e-0487d5b51a59 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:34.308532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0e03f-9eff-4ab2-aa5e-0487d5b51a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:34.308809 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0e03f-9eff-4ab2-aa5e-0487d5b51a59 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:34.309511 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d0e03f-9eff-4ab2-aa5e-0487d5b51a59 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:34.309821 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d0e03f-9eff-4ab2-aa5e-0487d5b51a59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:34.311177 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d0e03f-9eff-4ab2-aa5e-0487d5b51a59 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:34.316181 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 444/877] 10.222.0.40 () {56 vars in 1122 bytes} [Mon Jul 11 20:48:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:34.322041 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becea2fb-bef3-4d9e-8578-08999ce79ac7 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:34.425081 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:34.435622 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becea2fb-bef3-4d9e-8578-08999ce79ac7 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:34.471210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338a3f0-b0a2-46fe-8be0-0a69695f289f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:34.471884 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338a3f0-b0a2-46fe-8be0-0a69695f289f None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:34.472206 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338a3f0-b0a2-46fe-8be0-0a69695f289f None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:34.472480 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338a3f0-b0a2-46fe-8be0-0a69695f289f None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:34.473188 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7338a3f0-b0a2-46fe-8be0-0a69695f289f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:34.473498 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7338a3f0-b0a2-46fe-8be0-0a69695f289f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:34.474846 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7338a3f0-b0a2-46fe-8be0-0a69695f289f None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:34.481133 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 434/878] 10.222.0.40 () {56 vars in 1122 bytes} [Mon Jul 11 20:48:34 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:35.062031 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c31777-1032-41ea-bb1e-94d1f7d43d56 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:35.062553 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c31777-1032-41ea-bb1e-94d1f7d43d56 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:35.062663 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c31777-1032-41ea-bb1e-94d1f7d43d56 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:35.064264 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 445/879] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:35.069325 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb0bc5-2634-4564-bcc9-780859391d8d None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:35.069625 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb0bc5-2634-4564-bcc9-780859391d8d None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:35.069911 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb0bc5-2634-4564-bcc9-780859391d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:35.087540 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-72fb0bc5-2634-4564-bcc9-780859391d8d None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:35.088943 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-72fb0bc5-2634-4564-bcc9-780859391d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:35.157756 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 435/880] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:35 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:48:35.159310 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1406f1-030c-4b24-b7bb-80ff0d9580e2 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:35.159616 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1406f1-030c-4b24-b7bb-80ff0d9580e2 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:35.159901 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1406f1-030c-4b24-b7bb-80ff0d9580e2 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:35.161478 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 446/881] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:35.167252 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79f985-6c00-4a4b-9413-97a599337640 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:35.167551 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79f985-6c00-4a4b-9413-97a599337640 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:35.167835 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79f985-6c00-4a4b-9413-97a599337640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:35.185645 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1406f1-030c-4b24-b7bb-80ff0d9580e2 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:35.186306 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-2c79f985-6c00-4a4b-9413-97a599337640 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:35.187514 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-2c79f985-6c00-4a4b-9413-97a599337640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:35.269511 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 436/882] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:35 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:48:35.292446 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79f985-6c00-4a4b-9413-97a599337640 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:35.313440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1406f1-030c-4b24-b7bb-80ff0d9580e2 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:35.328323 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:35.352658 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b56fc4-64b4-43e7-a07a-4afe0aefefbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:35.353689 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b56fc4-64b4-43e7-a07a-4afe0aefefbc None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:35.354176 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b56fc4-64b4-43e7-a07a-4afe0aefefbc None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:35.354673 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b56fc4-64b4-43e7-a07a-4afe0aefefbc None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:35.355609 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b56fc4-64b4-43e7-a07a-4afe0aefefbc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:35.357237 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b56fc4-64b4-43e7-a07a-4afe0aefefbc None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:35.417578 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79f985-6c00-4a4b-9413-97a599337640 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:35.452029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce86d93-c446-402c-9520-0d6f4188a245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:35.452882 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce86d93-c446-402c-9520-0d6f4188a245 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:35.453147 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce86d93-c446-402c-9520-0d6f4188a245 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:35.453428 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce86d93-c446-402c-9520-0d6f4188a245 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:35.454084 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce86d93-c446-402c-9520-0d6f4188a245 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:35.455442 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce86d93-c446-402c-9520-0d6f4188a245 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:35.468460 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-0ce86d93-c446-402c-9520-0d6f4188a245 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 20:48:35.468460 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:35.468460 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:48:35.468460 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:48:35.468460 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:48:35.468460 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:48:35.468460 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:48:35.468460 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:35.468460 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 20:48:35.468460 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:35.468460 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:48:35.468460 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:35.468460 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:35.468460 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:35.468460 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:35.468460 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:35.468460 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:35.469486 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:35.469486 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:35.469486 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:35.469486 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:35.469486 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:35.469486 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:35.469486 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:48:35.469486 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:48:35.469486 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:48:35.469486 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:48:35.469486 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:35.469486 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:35.469486 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:35.469486 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:35.469486 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:35.469486 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:35.470351 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:35.470351 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:35.470351 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:35.470351 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:35.470351 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:35.470351 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:35.470351 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:35.470351 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:35.470351 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:35.470351 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:35.470351 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:48:35.470351 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:35.470351 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 20:48:35.470351 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:35.470351 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 437/883] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jul 11 20:48:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:48:35.476941 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce86d93-c446-402c-9520-0d6f4188a245 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:35.481698 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 447/884] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Jul 11 20:48:35 2022] POST /identity/v3/services => generated 269 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 20:48:35.575552 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:35.594792 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce86d93-c446-402c-9520-0d6f4188a245 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:35.643206 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c6334-6189-4a82-b3c8-95ad29b1046a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:35.644247 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c6334-6189-4a82-b3c8-95ad29b1046a None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:35.644684 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c6334-6189-4a82-b3c8-95ad29b1046a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:35.645132 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c6334-6189-4a82-b3c8-95ad29b1046a None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:35.646018 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c6334-6189-4a82-b3c8-95ad29b1046a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:35.646481 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c6334-6189-4a82-b3c8-95ad29b1046a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:35.648052 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c6334-6189-4a82-b3c8-95ad29b1046a None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:35.653945 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 438/885] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jul 11 20:48:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:35.660031 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b56fc4-64b4-43e7-a07a-4afe0aefefbc None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:35.675239 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:35.774490 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b56fc4-64b4-43e7-a07a-4afe0aefefbc None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:35.809161 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0999a-aab2-45c4-b516-2b4a343c82d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:35.809840 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0999a-aab2-45c4-b516-2b4a343c82d4 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:35.810121 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0999a-aab2-45c4-b516-2b4a343c82d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:35.810397 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0999a-aab2-45c4-b516-2b4a343c82d4 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:35.811103 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0999a-aab2-45c4-b516-2b4a343c82d4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:35.811414 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0999a-aab2-45c4-b516-2b4a343c82d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:35.812912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0999a-aab2-45c4-b516-2b4a343c82d4 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:35.818283 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 448/886] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jul 11 20:48:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:35.824749 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c6334-6189-4a82-b3c8-95ad29b1046a None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:35.863993 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157c0c0-6c58-4db7-9322-a13ffc282295 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:35.864271 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157c0c0-6c58-4db7-9322-a13ffc282295 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:35.864485 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157c0c0-6c58-4db7-9322-a13ffc282295 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:35.866032 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 449/887] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:35.871597 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a3b89-b012-4d45-87e9-be4860f8de26 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:35.871887 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a3b89-b012-4d45-87e9-be4860f8de26 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:35.872194 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a3b89-b012-4d45-87e9-be4860f8de26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:35.894652 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-8b1a3b89-b012-4d45-87e9-be4860f8de26 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:35.896000 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-8b1a3b89-b012-4d45-87e9-be4860f8de26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:35.940762 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c6334-6189-4a82-b3c8-95ad29b1046a None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:35.983942 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ffd16-1eb5-47e5-9e03-8d50f7967828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:35.984748 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ffd16-1eb5-47e5-9e03-8d50f7967828 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:35.985101 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ffd16-1eb5-47e5-9e03-8d50f7967828 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:35.985455 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ffd16-1eb5-47e5-9e03-8d50f7967828 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:35.986303 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ffd16-1eb5-47e5-9e03-8d50f7967828 None admin] RBAC: Adding query filter params (interface=public, service_id=9b4a7a901ea8405583ddf362973e9deb, region_id=RegionOne) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:35.986693 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ffd16-1eb5-47e5-9e03-8d50f7967828 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:35.996135 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ffd16-1eb5-47e5-9e03-8d50f7967828 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:35.996135 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 439/889] 10.222.0.40 () {56 vars in 1251 bytes} [Mon Jul 11 20:48:35 2022] GET /identity/v3/endpoints?service_id=9b4a7a901ea8405583ddf362973e9deb&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:35.996617 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 450/889] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:48:35.999514 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ffd16-1eb5-47e5-9e03-8d50f7967828 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:36.011386 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:36.012794 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a3b89-b012-4d45-87e9-be4860f8de26 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:36.017052 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:36.120618 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a3b89-b012-4d45-87e9-be4860f8de26 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:36.141351 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ffd16-1eb5-47e5-9e03-8d50f7967828 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:36.158341 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b25d6-e8b6-4fa3-985c-b28a34258641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:36.159539 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b25d6-e8b6-4fa3-985c-b28a34258641 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:36.160063 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b25d6-e8b6-4fa3-985c-b28a34258641 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:36.160540 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b25d6-e8b6-4fa3-985c-b28a34258641 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:36.172374 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b25d6-e8b6-4fa3-985c-b28a34258641 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:48:36.181695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-200b25d6-e8b6-4fa3-985c-b28a34258641 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 20:48:36.181695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:36.181695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:36.181695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:36.181695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:36.181695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:36.181695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:36.181695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:36.181695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:36.181695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:36.181695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:36.181695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:36.181695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:48:36.181695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:48:36.181695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:48:36.181695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:48:36.182605 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:48:36.182605 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:48:36.182605 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:48:36.182605 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:48:36.182605 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:36.182605 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:36.182605 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:36.182605 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:36.182605 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:36.182605 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:36.182605 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:36.182605 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:36.182605 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:36.182605 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:36.182605 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:36.182605 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:36.183449 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:36.183449 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:36.183449 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:36.183449 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:36.183449 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:48:36.183449 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:48:36.183449 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:48:36.183449 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:48:36.183449 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:48:36.183449 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:48:36.183449 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 20:48:36.183449 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:36.190370 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 451/890] 10.222.0.40 () {56 vars in 1120 bytes} [Mon Jul 11 20:48:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:36.190504 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1e210-9436-4701-9e52-5386d6de1215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:36.190504 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1e210-9436-4701-9e52-5386d6de1215 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:36.190504 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1e210-9436-4701-9e52-5386d6de1215 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:36.190504 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1e210-9436-4701-9e52-5386d6de1215 None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:36.190791 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1e210-9436-4701-9e52-5386d6de1215 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:36.190791 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1e210-9436-4701-9e52-5386d6de1215 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:36.191244 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b25d6-e8b6-4fa3-985c-b28a34258641 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:36.204076 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 440/891] 10.222.0.40 () {56 vars in 1087 bytes} [Mon Jul 11 20:48:35 2022] GET /identity/v3/services => generated 1268 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 20:48:36.268707 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:36.312618 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b25d6-e8b6-4fa3-985c-b28a34258641 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:36.349180 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f587b7-34ba-4f6e-8e23-1fa4bbb3d436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:36.349915 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f587b7-34ba-4f6e-8e23-1fa4bbb3d436 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:36.350205 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f587b7-34ba-4f6e-8e23-1fa4bbb3d436 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:36.350483 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f587b7-34ba-4f6e-8e23-1fa4bbb3d436 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:36.351247 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f587b7-34ba-4f6e-8e23-1fa4bbb3d436 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:36.351560 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f587b7-34ba-4f6e-8e23-1fa4bbb3d436 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:36.353621 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f587b7-34ba-4f6e-8e23-1fa4bbb3d436 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:36.363119 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 452/892] 10.222.0.40 () {56 vars in 1115 bytes} [Mon Jul 11 20:48:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:36.369250 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1e210-9436-4701-9e52-5386d6de1215 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:36.448636 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:36.479851 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1e210-9436-4701-9e52-5386d6de1215 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:36.515897 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b0b5f-746e-4074-a07f-1e6096a68b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:36.516728 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b0b5f-746e-4074-a07f-1e6096a68b18 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:36.517019 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b0b5f-746e-4074-a07f-1e6096a68b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:36.517298 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b0b5f-746e-4074-a07f-1e6096a68b18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:36.528498 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b0b5f-746e-4074-a07f-1e6096a68b18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:36.529947 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b0b5f-746e-4074-a07f-1e6096a68b18 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:36.547319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-fa7b0b5f-746e-4074-a07f-1e6096a68b18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:36.547319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:36.547319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:36.547319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:36.547319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:36.547319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:36.547319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:36.547319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:36.547319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:36.547319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:36.547319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:36.547319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:36.547319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:36.547319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:36.547319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:36.548259 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:36.548259 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:36.548259 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:36.548259 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:36.548259 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:36.548259 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:36.548259 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:36.548259 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:36.548259 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:36.548259 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:36.548259 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:36.548259 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:36.548259 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:36.548259 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:36.548259 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:36.548259 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:36.548259 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:36.549144 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:36.549144 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:36.549144 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:36.549144 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:36.549144 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 441/893] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:36.555574 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f587b7-34ba-4f6e-8e23-1fa4bbb3d436 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:36.605771 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418771a5-9b58-4c1c-a4c1-837cb9024585 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:36.606111 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418771a5-9b58-4c1c-a4c1-837cb9024585 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:36.606348 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418771a5-9b58-4c1c-a4c1-837cb9024585 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:36.608942 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 442/894] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:48:36.612956 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63fca20-03b0-4181-9687-9428e0a2b3c0 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:36.613254 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63fca20-03b0-4181-9687-9428e0a2b3c0 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:36.613537 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63fca20-03b0-4181-9687-9428e0a2b3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:36.631816 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-e63fca20-03b0-4181-9687-9428e0a2b3c0 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:36.633082 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-e63fca20-03b0-4181-9687-9428e0a2b3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:36.680048 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f587b7-34ba-4f6e-8e23-1fa4bbb3d436 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:36.706587 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:36.715759 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ae0f3-2b05-4dca-aed0-7da0e9d33378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:36.716473 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ae0f3-2b05-4dca-aed0-7da0e9d33378 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:36.716808 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ae0f3-2b05-4dca-aed0-7da0e9d33378 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:36.717662 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ae0f3-2b05-4dca-aed0-7da0e9d33378 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:36.717809 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ae0f3-2b05-4dca-aed0-7da0e9d33378 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:36.718122 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ae0f3-2b05-4dca-aed0-7da0e9d33378 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:36.719500 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ae0f3-2b05-4dca-aed0-7da0e9d33378 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:36.725566 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 443/895] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:36 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 20:48:36.741755 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 453/896] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:36.748482 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63fca20-03b0-4181-9687-9428e0a2b3c0 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:36.753035 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ae0f3-2b05-4dca-aed0-7da0e9d33378 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:36.823513 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:36.863145 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ae0f3-2b05-4dca-aed0-7da0e9d33378 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:36.872314 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63fca20-03b0-4181-9687-9428e0a2b3c0 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:36.899634 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613a99d-de3e-4954-9693-fe05fcb34123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:36.900588 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613a99d-de3e-4954-9693-fe05fcb34123 None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:36.900855 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613a99d-de3e-4954-9693-fe05fcb34123 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:36.901141 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613a99d-de3e-4954-9693-fe05fcb34123 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:36.901872 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613a99d-de3e-4954-9693-fe05fcb34123 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:36.903334 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613a99d-de3e-4954-9693-fe05fcb34123 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:36.911277 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484155e-ca5c-4019-886f-7453ccb6aa48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:36.912200 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484155e-ca5c-4019-886f-7453ccb6aa48 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:36.912485 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484155e-ca5c-4019-886f-7453ccb6aa48 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:36.912762 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484155e-ca5c-4019-886f-7453ccb6aa48 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:36.920499 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484155e-ca5c-4019-886f-7453ccb6aa48 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:36.921943 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484155e-ca5c-4019-886f-7453ccb6aa48 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:36.937190 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-1484155e-ca5c-4019-886f-7453ccb6aa48 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 20:48:36.937190 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:36.937190 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:36.937190 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:36.937190 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:36.937190 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:36.937190 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:36.937190 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:36.937190 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:36.937190 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:36.937190 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:36.937190 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:36.937190 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:48:36.937190 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:48:36.937190 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:48:36.937190 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:48:36.938215 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:36.938215 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:36.938215 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:48:36.938215 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:36.938215 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:48:36.938215 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:36.938215 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:36.938215 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:36.938215 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:36.938215 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:36.938215 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:36.938215 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:36.938215 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:36.938215 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:36.938215 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:36.938215 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:36.938215 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:36.938215 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:36.939201 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:36.939201 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:36.939201 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:48:36.939201 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:48:36.939201 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:48:36.939201 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:48:36.939201 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:48:36.939201 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:48:36.939201 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 20:48:36.939201 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:36.943020 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 444/897] 10.222.0.40 () {56 vars in 1117 bytes} [Mon Jul 11 20:48:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:36.943780 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484155e-ca5c-4019-886f-7453ccb6aa48 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:36.967207 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 454/898] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Jul 11 20:48:36 2022] POST /identity/v3/services => generated 241 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:48:37.065844 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484155e-ca5c-4019-886f-7453ccb6aa48 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:37.082546 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:37.111384 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d86aa4-cd40-40c4-ada5-883fc6cd44f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:37.112097 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d86aa4-cd40-40c4-ada5-883fc6cd44f7 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:37.112384 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d86aa4-cd40-40c4-ada5-883fc6cd44f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:37.112663 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d86aa4-cd40-40c4-ada5-883fc6cd44f7 None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:37.113505 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d86aa4-cd40-40c4-ada5-883fc6cd44f7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:37.113816 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d86aa4-cd40-40c4-ada5-883fc6cd44f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:37.115294 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d86aa4-cd40-40c4-ada5-883fc6cd44f7 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:37.134595 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 445/899] 10.222.0.40 () {56 vars in 1149 bytes} [Mon Jul 11 20:48:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:37.141221 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613a99d-de3e-4954-9693-fe05fcb34123 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:37.191299 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:37.246882 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613a99d-de3e-4954-9693-fe05fcb34123 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:37.282080 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f260f-a490-4783-a83c-15335bb4cae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:37.282741 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f260f-a490-4783-a83c-15335bb4cae5 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:37.283029 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f260f-a490-4783-a83c-15335bb4cae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:37.283310 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f260f-a490-4783-a83c-15335bb4cae5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:37.353711 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f260f-a490-4783-a83c-15335bb4cae5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:37.355161 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f260f-a490-4783-a83c-15335bb4cae5 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:37.401738 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:37.459315 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 455/900] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:48:37 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 20:48:37.465519 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d86aa4-cd40-40c4-ada5-883fc6cd44f7 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:37.571425 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d86aa4-cd40-40c4-ada5-883fc6cd44f7 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:37.606814 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ddf8f1-6c87-43d1-a6f4-8da8c97508c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:37.607621 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ddf8f1-6c87-43d1-a6f4-8da8c97508c8 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:37.607903 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ddf8f1-6c87-43d1-a6f4-8da8c97508c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:37.608209 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ddf8f1-6c87-43d1-a6f4-8da8c97508c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:37.618861 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ddf8f1-6c87-43d1-a6f4-8da8c97508c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:37.620316 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ddf8f1-6c87-43d1-a6f4-8da8c97508c8 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:37.639106 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-79ddf8f1-6c87-43d1-a6f4-8da8c97508c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:37.639106 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:37.639106 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:37.639106 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:37.639106 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:37.639106 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:37.639106 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:37.639106 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:37.639106 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:37.639106 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:37.639106 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:37.639106 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:37.639106 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:37.639106 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:37.639106 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:37.640056 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:37.640056 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:37.640056 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:37.640056 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:37.640056 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:37.640056 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:37.640056 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:37.640056 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:37.640056 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:37.640056 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:37.640056 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:37.640056 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:37.640056 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:37.640056 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:37.640056 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:37.640056 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:37.640056 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:37.641998 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:37.641998 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:37.641998 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:37.641998 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:37.641998 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 446/901] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:37.646196 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f260f-a490-4783-a83c-15335bb4cae5 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:37.705448 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7743a0b-7163-414a-9dba-6c2ee6ebc2e6 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:37.705830 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7743a0b-7163-414a-9dba-6c2ee6ebc2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:37.706113 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7743a0b-7163-414a-9dba-6c2ee6ebc2e6 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:37.707728 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 447/902] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:48:37.712993 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a50995-5c4b-4890-974a-b277ee9e0f6a None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:37.713391 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a50995-5c4b-4890-974a-b277ee9e0f6a None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:37.713768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a50995-5c4b-4890-974a-b277ee9e0f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:37.732499 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-f1a50995-5c4b-4890-974a-b277ee9e0f6a None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:37.733819 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-f1a50995-5c4b-4890-974a-b277ee9e0f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:37.752092 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:37.764683 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f260f-a490-4783-a83c-15335bb4cae5 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:37.815100 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 448/903] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:48:37.824731 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d3544-8e5e-4d29-a63e-678d0ac7bb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:37.829423 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d3544-8e5e-4d29-a63e-678d0ac7bb4b None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:37.829423 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d3544-8e5e-4d29-a63e-678d0ac7bb4b None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:37.829423 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d3544-8e5e-4d29-a63e-678d0ac7bb4b None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:37.829423 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d3544-8e5e-4d29-a63e-678d0ac7bb4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:37.829423 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d3544-8e5e-4d29-a63e-678d0ac7bb4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:37.829423 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d3544-8e5e-4d29-a63e-678d0ac7bb4b None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:37.841556 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 456/904] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:37.843334 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a50995-5c4b-4890-974a-b277ee9e0f6a None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:37.847421 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d3544-8e5e-4d29-a63e-678d0ac7bb4b None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:37.856768 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:37.954390 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d3544-8e5e-4d29-a63e-678d0ac7bb4b None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:37.972019 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a50995-5c4b-4890-974a-b277ee9e0f6a None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:38.002708 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e30f2a-618a-4625-8628-c92abc0ecd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:38.004202 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e30f2a-618a-4625-8628-c92abc0ecd5c None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:38.004897 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e30f2a-618a-4625-8628-c92abc0ecd5c None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:38.005428 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e30f2a-618a-4625-8628-c92abc0ecd5c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:38.008769 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a160007-de01-4614-b282-ea664b3c67b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:38.009699 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a160007-de01-4614-b282-ea664b3c67b3 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:38.010083 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a160007-de01-4614-b282-ea664b3c67b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:38.010460 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a160007-de01-4614-b282-ea664b3c67b3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:38.011213 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a160007-de01-4614-b282-ea664b3c67b3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:38.012722 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a160007-de01-4614-b282-ea664b3c67b3 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:38.014996 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e30f2a-618a-4625-8628-c92abc0ecd5c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:38.017310 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e30f2a-618a-4625-8628-c92abc0ecd5c None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:38.026202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-6a160007-de01-4614-b282-ea664b3c67b3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 20:48:38.026202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:38.026202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:48:38.026202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:48:38.026202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:48:38.026202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:48:38.026202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:48:38.026202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:38.026202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 20:48:38.026202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:38.026202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:48:38.026202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:38.026202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:38.026202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:38.026202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:38.026202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:38.027359 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:38.027359 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:38.027359 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:38.027359 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:38.027359 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:38.027359 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:38.027359 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:38.027359 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:48:38.027359 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:48:38.027359 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:48:38.027359 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:48:38.027359 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:38.027359 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:38.027359 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:38.027359 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:38.027359 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:38.028457 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:38.028457 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:38.028457 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:38.028457 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:38.028457 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:38.028457 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:38.028457 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:38.028457 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:38.028457 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:38.028457 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:38.028457 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:38.028457 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:48:38.028457 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:38.028457 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 20:48:38.028457 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:38.035405 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 449/905] 10.222.0.40 () {56 vars in 1132 bytes} [Mon Jul 11 20:48:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:38.036583 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a160007-de01-4614-b282-ea664b3c67b3 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:38.039619 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-b7e30f2a-618a-4625-8628-c92abc0ecd5c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:38.039619 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:38.039619 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:38.039619 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:38.039619 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:38.039619 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:38.039619 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:38.039619 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:38.039619 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:38.039619 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:38.039619 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:38.039619 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:38.039619 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:48:38.039619 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:48:38.039619 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:48:38.040518 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:48:38.040518 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:38.040518 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:38.040518 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:38.040518 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:38.040518 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:38.040518 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:38.040518 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:38.040518 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:38.040518 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:38.040518 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:38.040518 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:38.040518 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:38.040518 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:38.040518 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:38.040518 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:38.040518 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:38.041394 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:48:38.041394 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:48:38.041394 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:48:38.041394 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:48:38.041394 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:48:38.041394 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:48:38.041394 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:38.041394 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:38.043824 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 457/906] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:48:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:38.049495 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e30f2a-618a-4625-8628-c92abc0ecd5c None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:38.057417 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:38.125279 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:38.164455 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e30f2a-618a-4625-8628-c92abc0ecd5c None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:38.176114 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a160007-de01-4614-b282-ea664b3c67b3 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:38.206106 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9e22a-8d76-475c-8d63-8868e2623359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:38.207170 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9e22a-8d76-475c-8d63-8868e2623359 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:38.207896 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9e22a-8d76-475c-8d63-8868e2623359 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:38.208619 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9e22a-8d76-475c-8d63-8868e2623359 None admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:38.209808 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd9e22a-8d76-475c-8d63-8868e2623359 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:38.210353 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd9e22a-8d76-475c-8d63-8868e2623359 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:38.212848 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd9e22a-8d76-475c-8d63-8868e2623359 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:38.212986 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395088e-aef2-4ba2-ade6-c8f7a5a384ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:38.213629 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395088e-aef2-4ba2-ade6-c8f7a5a384ea None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:38.213919 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395088e-aef2-4ba2-ade6-c8f7a5a384ea None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:38.214201 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395088e-aef2-4ba2-ade6-c8f7a5a384ea None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:38.214906 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395088e-aef2-4ba2-ade6-c8f7a5a384ea None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:38.215218 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395088e-aef2-4ba2-ade6-c8f7a5a384ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:38.216766 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395088e-aef2-4ba2-ade6-c8f7a5a384ea None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:38.226354 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 450/907] 10.222.0.40 () {56 vars in 1126 bytes} [Mon Jul 11 20:48:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:38.228075 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395088e-aef2-4ba2-ade6-c8f7a5a384ea None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:38.233848 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 458/908] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 11 20:48:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:38.244061 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9e22a-8d76-475c-8d63-8868e2623359 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:38.314507 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:38.344879 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395088e-aef2-4ba2-ade6-c8f7a5a384ea None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:38.363578 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9e22a-8d76-475c-8d63-8868e2623359 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:38.381722 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737df65-4c54-4304-ab07-e35d0c5d5127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:38.382601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737df65-4c54-4304-ab07-e35d0c5d5127 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:38.383392 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737df65-4c54-4304-ab07-e35d0c5d5127 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:38.384054 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737df65-4c54-4304-ab07-e35d0c5d5127 None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:38.384964 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0737df65-4c54-4304-ab07-e35d0c5d5127 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:38.385474 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0737df65-4c54-4304-ab07-e35d0c5d5127 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:38.387043 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0737df65-4c54-4304-ab07-e35d0c5d5127 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:38.395584 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:38.397377 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 451/909] 10.222.0.40 () {56 vars in 1126 bytes} [Mon Jul 11 20:48:38 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:38.398315 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737df65-4c54-4304-ab07-e35d0c5d5127 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:38.407332 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c334df-4f9d-4cb4-b591-96cdce78095d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:38.408647 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c334df-4f9d-4cb4-b591-96cdce78095d None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:38.409090 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c334df-4f9d-4cb4-b591-96cdce78095d None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:38.414737 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c334df-4f9d-4cb4-b591-96cdce78095d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:38.414737 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c334df-4f9d-4cb4-b591-96cdce78095d None admin] RBAC: Adding query filter params (role.id=1400a904c27a413fa8b7c591773b08cf, scope.project.id=eca3ef2561fa435e80ff451aeab14f3b, user.id=90ea5d52fd6d4068b7837d363eebb94f) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:38.414737 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c334df-4f9d-4cb4-b591-96cdce78095d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:38.414737 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c334df-4f9d-4cb4-b591-96cdce78095d None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:38.421616 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 459/910] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:48:38 2022] GET /identity/v3/role_assignments?user.id=90ea5d52fd6d4068b7837d363eebb94f&scope.project.id=eca3ef2561fa435e80ff451aeab14f3b&role.id=1400a904c27a413fa8b7c591773b08cf => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:38.441773 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ab21c-9118-41a5-a5e2-f5729656cb69 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:38.442071 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ab21c-9118-41a5-a5e2-f5729656cb69 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:38.442359 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ab21c-9118-41a5-a5e2-f5729656cb69 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:38.443954 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 460/911] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:38.450083 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59689e0-6a83-47f7-97b9-d253f73e2b93 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:38.450373 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59689e0-6a83-47f7-97b9-d253f73e2b93 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:38.450654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59689e0-6a83-47f7-97b9-d253f73e2b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:38.468386 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-b59689e0-6a83-47f7-97b9-d253f73e2b93 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:38.469597 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-b59689e0-6a83-47f7-97b9-d253f73e2b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:38.526249 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737df65-4c54-4304-ab07-e35d0c5d5127 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:38.547262 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 461/912] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 20:48:38.566185 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708dcbe5-7bdc-4b8d-b787-e02d16a529bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:38.566876 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708dcbe5-7bdc-4b8d-b787-e02d16a529bd None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:38.567167 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708dcbe5-7bdc-4b8d-b787-e02d16a529bd None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:38.567447 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708dcbe5-7bdc-4b8d-b787-e02d16a529bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:38.568410 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708dcbe5-7bdc-4b8d-b787-e02d16a529bd None admin] RBAC: Adding query filter params (interface=public, service_id=61280623cd694fe58e2435ef0f4595a0, region_id=RegionOne) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:38.569572 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59689e0-6a83-47f7-97b9-d253f73e2b93 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:38.572507 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708dcbe5-7bdc-4b8d-b787-e02d16a529bd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:38.574620 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708dcbe5-7bdc-4b8d-b787-e02d16a529bd None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:38.581158 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 452/913] 10.222.0.40 () {56 vars in 1251 bytes} [Mon Jul 11 20:48:38 2022] GET /identity/v3/endpoints?service_id=61280623cd694fe58e2435ef0f4595a0&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:38.586841 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708dcbe5-7bdc-4b8d-b787-e02d16a529bd None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:38.599860 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:38.706120 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59689e0-6a83-47f7-97b9-d253f73e2b93 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:38.730841 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708dcbe5-7bdc-4b8d-b787-e02d16a529bd None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:38.735203 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:38.752683 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea1f40-9922-4648-968b-fe51748b97e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:38.754274 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea1f40-9922-4648-968b-fe51748b97e0 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:38.754739 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea1f40-9922-4648-968b-fe51748b97e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:38.755170 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea1f40-9922-4648-968b-fe51748b97e0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:38.756001 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea1f40-9922-4648-968b-fe51748b97e0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:38.758258 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea1f40-9922-4648-968b-fe51748b97e0 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:38.774056 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-6bea1f40-9922-4648-968b-fe51748b97e0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 20:48:38.774056 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:38.774056 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:48:38.774056 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:48:38.774056 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:48:38.774056 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:48:38.774056 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:48:38.774056 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:38.774056 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 20:48:38.774056 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:38.774056 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:48:38.774056 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:38.774056 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:38.774056 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:38.774056 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:38.774056 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:38.774056 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:38.775122 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:38.775122 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:38.775122 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:38.775122 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:38.775122 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:38.775122 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:38.775122 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:48:38.775122 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:48:38.775122 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:48:38.775122 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:48:38.775122 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:38.775122 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:38.775122 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:38.775122 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:38.775122 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:38.775122 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:38.775937 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:38.775937 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:38.775937 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:38.775937 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:38.775937 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:38.775937 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:38.775937 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:38.775937 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:38.775937 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:38.775937 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:38.775937 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:48:38.775937 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:38.775937 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 20:48:38.775937 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:38.776714 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce163b13-6db7-4960-bf4a-5532ee8807a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:38.776714 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce163b13-6db7-4960-bf4a-5532ee8807a3 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:38.776714 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce163b13-6db7-4960-bf4a-5532ee8807a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:38.776714 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce163b13-6db7-4960-bf4a-5532ee8807a3 None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:38.776964 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce163b13-6db7-4960-bf4a-5532ee8807a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:38.783676 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce163b13-6db7-4960-bf4a-5532ee8807a3 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:38.784233 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 462/914] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jul 11 20:48:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:38.785735 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea1f40-9922-4648-968b-fe51748b97e0 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:38.791317 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 453/915] 10.222.0.40 () {56 vars in 1087 bytes} [Mon Jul 11 20:48:38 2022] GET /identity/v3/services => generated 1497 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 20:48:38.908244 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea1f40-9922-4648-968b-fe51748b97e0 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:38.949374 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab6dd9-1edf-437b-ada7-cc7d7235852f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:38.950063 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab6dd9-1edf-437b-ada7-cc7d7235852f None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:38.950352 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab6dd9-1edf-437b-ada7-cc7d7235852f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:38.950633 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab6dd9-1edf-437b-ada7-cc7d7235852f None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:38.951344 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab6dd9-1edf-437b-ada7-cc7d7235852f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:38.951660 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab6dd9-1edf-437b-ada7-cc7d7235852f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:38.953082 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab6dd9-1edf-437b-ada7-cc7d7235852f None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:38.958632 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 463/916] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jul 11 20:48:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:38.964953 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce163b13-6db7-4960-bf4a-5532ee8807a3 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:39.045800 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:39.082898 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce163b13-6db7-4960-bf4a-5532ee8807a3 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:39.108494 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a377c9c-f0fa-478f-93d7-3c92419adef2 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:39.108793 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a377c9c-f0fa-478f-93d7-3c92419adef2 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:39.109080 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a377c9c-f0fa-478f-93d7-3c92419adef2 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:39.110717 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 464/917] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:39.115558 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3659c6c-85c5-44e4-a32e-1d400297cbe7 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:39.115851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3659c6c-85c5-44e4-a32e-1d400297cbe7 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:39.116170 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3659c6c-85c5-44e4-a32e-1d400297cbe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:39.118562 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2f7ce-8e75-4223-962c-8dab1534fe08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:39.119244 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2f7ce-8e75-4223-962c-8dab1534fe08 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:39.119528 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2f7ce-8e75-4223-962c-8dab1534fe08 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:39.119804 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2f7ce-8e75-4223-962c-8dab1534fe08 None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:39.120550 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2f7ce-8e75-4223-962c-8dab1534fe08 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:39.120861 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2f7ce-8e75-4223-962c-8dab1534fe08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:39.122226 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2f7ce-8e75-4223-962c-8dab1534fe08 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:39.128188 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 454/918] 10.222.0.40 () {56 vars in 1114 bytes} [Mon Jul 11 20:48:38 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:39.133916 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2f7ce-8e75-4223-962c-8dab1534fe08 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:39.137228 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-b3659c6c-85c5-44e4-a32e-1d400297cbe7 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:39.138703 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-b3659c6c-85c5-44e4-a32e-1d400297cbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:39.188975 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:39.224311 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 465/919] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 20:48:39.244366 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3659c6c-85c5-44e4-a32e-1d400297cbe7 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:39.259291 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2f7ce-8e75-4223-962c-8dab1534fe08 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:39.304259 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef2f6f-cc5a-423b-bd24-441427c53a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:39.305050 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef2f6f-cc5a-423b-bd24-441427c53a02 None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:39.305325 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef2f6f-cc5a-423b-bd24-441427c53a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:39.305745 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef2f6f-cc5a-423b-bd24-441427c53a02 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:39.306773 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef2f6f-cc5a-423b-bd24-441427c53a02 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:39.308437 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef2f6f-cc5a-423b-bd24-441427c53a02 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:39.313842 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:39.357866 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3659c6c-85c5-44e4-a32e-1d400297cbe7 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:39.394041 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101fc554-6351-4a90-9b6a-705c109e484b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:39.394845 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fc554-6351-4a90-9b6a-705c109e484b None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:39.395124 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fc554-6351-4a90-9b6a-705c109e484b None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:39.395399 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fc554-6351-4a90-9b6a-705c109e484b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:39.396072 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101fc554-6351-4a90-9b6a-705c109e484b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:39.397432 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101fc554-6351-4a90-9b6a-705c109e484b None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:39.408758 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 455/920] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 11 20:48:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 20:48:39.410554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-101fc554-6351-4a90-9b6a-705c109e484b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 20:48:39.410554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:39.410554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:48:39.410554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:48:39.410554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:48:39.410554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:48:39.410554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:48:39.410554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:39.410554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 20:48:39.410554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:39.410554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:48:39.410554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:39.410554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:39.410554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:39.410554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:39.410554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:39.410554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:39.411560 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:39.411560 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:39.411560 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:39.411560 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:39.411560 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:39.411560 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:39.411560 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:48:39.411560 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:48:39.411560 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:48:39.411560 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:48:39.411560 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:39.411560 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:39.411560 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:39.411560 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:39.411560 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:39.411560 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:39.412448 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:39.412448 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:39.412448 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:39.412448 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:39.412448 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:39.412448 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:39.412448 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:39.412448 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:39.412448 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:39.412448 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:39.412448 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:48:39.412448 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:39.412448 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 20:48:39.412448 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:39.412448 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 466/921] 10.222.0.40 () {56 vars in 1126 bytes} [Mon Jul 11 20:48:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:48:39.420899 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef2f6f-cc5a-423b-bd24-441427c53a02 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:39.546889 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef2f6f-cc5a-423b-bd24-441427c53a02 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:39.587071 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62927ca-1832-4761-8f64-7633ff6464a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:39.587818 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62927ca-1832-4761-8f64-7633ff6464a8 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:39.588267 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62927ca-1832-4761-8f64-7633ff6464a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:39.588552 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62927ca-1832-4761-8f64-7633ff6464a8 None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:39.589269 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62927ca-1832-4761-8f64-7633ff6464a8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:39.589585 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62927ca-1832-4761-8f64-7633ff6464a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:39.590957 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62927ca-1832-4761-8f64-7633ff6464a8 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:39.597280 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 456/922] 10.222.0.40 () {56 vars in 1122 bytes} [Mon Jul 11 20:48:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:39.603329 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101fc554-6351-4a90-9b6a-705c109e484b None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:39.655789 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:39.720352 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101fc554-6351-4a90-9b6a-705c109e484b None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:39.754839 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a934ed-0969-4cbe-afca-9bd6c58cb998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:39.755883 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a934ed-0969-4cbe-afca-9bd6c58cb998 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:39.756399 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a934ed-0969-4cbe-afca-9bd6c58cb998 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:39.756876 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a934ed-0969-4cbe-afca-9bd6c58cb998 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:39.757774 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a934ed-0969-4cbe-afca-9bd6c58cb998 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:39.758423 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a934ed-0969-4cbe-afca-9bd6c58cb998 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:39.760042 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a934ed-0969-4cbe-afca-9bd6c58cb998 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:39.765742 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 467/923] 10.222.0.40 () {56 vars in 1122 bytes} [Mon Jul 11 20:48:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:39.773310 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62927ca-1832-4761-8f64-7633ff6464a8 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:39.828667 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:39.881825 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62927ca-1832-4761-8f64-7633ff6464a8 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:39.922295 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c78903-8e87-4b20-ac87-e9691edc8cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:39.923292 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c78903-8e87-4b20-ac87-e9691edc8cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:39.923779 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c78903-8e87-4b20-ac87-e9691edc8cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:39.924282 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c78903-8e87-4b20-ac87-e9691edc8cf8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:39.925273 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c78903-8e87-4b20-ac87-e9691edc8cf8 None admin] RBAC: Adding query filter params (interface=public, service_id=338e04219b5d44b08b56e0960912ae4a, region_id=RegionOne) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:39.925888 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c78903-8e87-4b20-ac87-e9691edc8cf8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:39.927442 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c78903-8e87-4b20-ac87-e9691edc8cf8 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:39.933555 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 457/924] 10.222.0.40 () {56 vars in 1251 bytes} [Mon Jul 11 20:48:39 2022] GET /identity/v3/endpoints?service_id=338e04219b5d44b08b56e0960912ae4a&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:39.938922 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a934ed-0969-4cbe-afca-9bd6c58cb998 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:40.048368 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a934ed-0969-4cbe-afca-9bd6c58cb998 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:40.056397 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:40.087000 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b22ba-1967-4cfb-a936-316513a8e789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:40.087602 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b22ba-1967-4cfb-a936-316513a8e789 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:40.087888 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b22ba-1967-4cfb-a936-316513a8e789 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:40.088271 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b22ba-1967-4cfb-a936-316513a8e789 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:40.089010 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b22ba-1967-4cfb-a936-316513a8e789 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:40.090395 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b22ba-1967-4cfb-a936-316513a8e789 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:40.097130 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 468/925] 10.222.0.40 () {56 vars in 1087 bytes} [Mon Jul 11 20:48:39 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 20:48:40.564531 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9bb78-5053-4123-b183-844396ba4006 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:40.564833 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9bb78-5053-4123-b183-844396ba4006 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:40.565119 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9bb78-5053-4123-b183-844396ba4006 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:40.566751 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 458/926] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:40.573001 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc5706-21db-4a0c-9c22-ba6b0689fcb6 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:40.573480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc5706-21db-4a0c-9c22-ba6b0689fcb6 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:40.573617 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc5706-21db-4a0c-9c22-ba6b0689fcb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:40.591315 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-aecc5706-21db-4a0c-9c22-ba6b0689fcb6 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:40.592536 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-aecc5706-21db-4a0c-9c22-ba6b0689fcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:40.669302 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 469/927] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:48:40.692778 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d9bb78-5053-4123-b183-844396ba4006 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:40.805938 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d9bb78-5053-4123-b183-844396ba4006 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:40.819927 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:40.841641 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d97ec9-b5ee-4940-ab1a-f40f180729a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:40.842535 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d97ec9-b5ee-4940-ab1a-f40f180729a8 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:40.842823 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d97ec9-b5ee-4940-ab1a-f40f180729a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:40.843097 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d97ec9-b5ee-4940-ab1a-f40f180729a8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:40.854765 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d97ec9-b5ee-4940-ab1a-f40f180729a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:48:40.862761 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-00d97ec9-b5ee-4940-ab1a-f40f180729a8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 20:48:40.862761 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:40.862761 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:40.862761 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:40.862761 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:40.862761 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:40.862761 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:40.862761 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:40.862761 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:40.862761 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:40.862761 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:40.862761 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:40.862761 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:48:40.862761 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:48:40.862761 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:48:40.862761 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:48:40.863706 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:48:40.863706 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:48:40.863706 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:48:40.863706 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:48:40.863706 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:40.863706 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:40.863706 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:40.863706 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:40.863706 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:40.863706 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:40.863706 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:40.863706 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:40.863706 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:40.863706 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:40.863706 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:40.863706 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:40.864606 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:40.864606 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:40.864606 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:40.864606 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:40.864606 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:48:40.864606 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:48:40.864606 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:48:40.864606 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:48:40.864606 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:48:40.864606 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:48:40.864606 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 20:48:40.864606 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:40.865246 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 459/928] 10.222.0.40 () {56 vars in 1120 bytes} [Mon Jul 11 20:48:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:40.871877 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc5706-21db-4a0c-9c22-ba6b0689fcb6 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:40.979768 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:40.983267 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc5706-21db-4a0c-9c22-ba6b0689fcb6 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:41.019440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fbf5c0-e6cd-4cd2-8ef8-0f88a35bb91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:41.020185 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbf5c0-e6cd-4cd2-8ef8-0f88a35bb91a None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:41.020474 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbf5c0-e6cd-4cd2-8ef8-0f88a35bb91a None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:41.020754 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbf5c0-e6cd-4cd2-8ef8-0f88a35bb91a None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:41.021504 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fbf5c0-e6cd-4cd2-8ef8-0f88a35bb91a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:41.021817 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fbf5c0-e6cd-4cd2-8ef8-0f88a35bb91a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:41.023252 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fbf5c0-e6cd-4cd2-8ef8-0f88a35bb91a None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:41.026381 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50338c92-f836-4033-8521-12063af80bd2 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:41.026672 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50338c92-f836-4033-8521-12063af80bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:41.026948 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50338c92-f836-4033-8521-12063af80bd2 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:41.028595 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 460/929] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:48:41.037066 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c54e21-a0ee-4f1d-bc79-5fe215542639 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:41.037469 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c54e21-a0ee-4f1d-bc79-5fe215542639 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:41.037848 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c54e21-a0ee-4f1d-bc79-5fe215542639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:41.044129 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 470/930] 10.222.0.40 () {56 vars in 1115 bytes} [Mon Jul 11 20:48:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:41.045926 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fbf5c0-e6cd-4cd2-8ef8-0f88a35bb91a None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:41.064703 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-e8c54e21-a0ee-4f1d-bc79-5fe215542639 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:41.066136 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-e8c54e21-a0ee-4f1d-bc79-5fe215542639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:41.148386 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 461/931] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:48:41.172897 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fbf5c0-e6cd-4cd2-8ef8-0f88a35bb91a None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:41.174304 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c54e21-a0ee-4f1d-bc79-5fe215542639 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:41.217503 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba7c43-4967-437f-9af2-421e44dfe409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:41.218310 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba7c43-4967-437f-9af2-421e44dfe409 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:41.218597 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba7c43-4967-437f-9af2-421e44dfe409 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:41.218876 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba7c43-4967-437f-9af2-421e44dfe409 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:41.233928 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba7c43-4967-437f-9af2-421e44dfe409 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:41.235822 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba7c43-4967-437f-9af2-421e44dfe409 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:41.259311 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-deba7c43-4967-437f-9af2-421e44dfe409 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:41.259311 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:41.259311 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:41.259311 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:41.259311 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:41.259311 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:41.259311 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:41.259311 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:41.259311 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:41.259311 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:41.259311 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:41.259311 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:41.259311 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:41.259311 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:41.259311 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:41.266533 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:41.266533 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:41.266533 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:41.266533 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:41.266533 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:41.266533 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:41.266533 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:41.266533 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:41.266533 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:41.266533 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:41.266533 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:41.266533 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:41.266533 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:41.266533 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:41.266533 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:41.266533 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:41.266533 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:41.267479 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:41.267479 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:41.267479 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:41.267479 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:41.267479 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 471/932] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:41.268354 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba7c43-4967-437f-9af2-421e44dfe409 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:41.290787 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:41.300526 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c54e21-a0ee-4f1d-bc79-5fe215542639 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:41.303934 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:41.343045 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141ccd8-8d8f-4c26-86b2-b1d5f287602a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:41.344354 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141ccd8-8d8f-4c26-86b2-b1d5f287602a None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:41.344870 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141ccd8-8d8f-4c26-86b2-b1d5f287602a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:41.345373 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141ccd8-8d8f-4c26-86b2-b1d5f287602a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:41.346394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141ccd8-8d8f-4c26-86b2-b1d5f287602a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:41.348067 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141ccd8-8d8f-4c26-86b2-b1d5f287602a None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:41.362655 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-7141ccd8-8d8f-4c26-86b2-b1d5f287602a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 20:48:41.362655 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:41.362655 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:48:41.362655 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:48:41.362655 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:48:41.362655 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:48:41.362655 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:48:41.362655 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:41.362655 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 20:48:41.362655 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:41.362655 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:48:41.362655 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:41.362655 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:41.362655 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:41.362655 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:41.362655 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:41.363672 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:41.363672 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:41.363672 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:41.363672 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:41.363672 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:41.363672 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:41.363672 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:41.363672 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:48:41.363672 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:48:41.363672 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:48:41.363672 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:48:41.363672 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:41.363672 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:41.363672 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:41.363672 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:41.363672 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:41.364569 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:41.364569 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:41.364569 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:41.364569 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:41.364569 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:41.364569 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:41.364569 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:41.364569 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:41.364569 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:41.364569 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:41.364569 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:41.364569 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:48:41.364569 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:41.364569 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 20:48:41.364569 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:41.373438 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 462/933] 10.222.0.40 () {56 vars in 1132 bytes} [Mon Jul 11 20:48:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:41.375300 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141ccd8-8d8f-4c26-86b2-b1d5f287602a None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:41.401974 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba7c43-4967-437f-9af2-421e44dfe409 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:41.447580 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2ce46-b554-4a27-a9e2-2586bde900e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:41.448288 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2ce46-b554-4a27-a9e2-2586bde900e5 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:41.448574 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2ce46-b554-4a27-a9e2-2586bde900e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:41.448853 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2ce46-b554-4a27-a9e2-2586bde900e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:41.449842 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2ce46-b554-4a27-a9e2-2586bde900e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:41.450159 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2ce46-b554-4a27-a9e2-2586bde900e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:41.452253 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2ce46-b554-4a27-a9e2-2586bde900e5 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:41.471677 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 472/934] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:41.473015 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2ce46-b554-4a27-a9e2-2586bde900e5 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:41.499710 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141ccd8-8d8f-4c26-86b2-b1d5f287602a None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:41.538646 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1eba18-0c3a-4310-a5c6-aed19c4d2f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:41.539629 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1eba18-0c3a-4310-a5c6-aed19c4d2f1b None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:41.540404 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1eba18-0c3a-4310-a5c6-aed19c4d2f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:41.540697 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1eba18-0c3a-4310-a5c6-aed19c4d2f1b None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:41.541478 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1eba18-0c3a-4310-a5c6-aed19c4d2f1b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:41.541894 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1eba18-0c3a-4310-a5c6-aed19c4d2f1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:41.543275 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1eba18-0c3a-4310-a5c6-aed19c4d2f1b None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:41.553687 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 463/935] 10.222.0.40 () {56 vars in 1126 bytes} [Mon Jul 11 20:48:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:41.555794 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1eba18-0c3a-4310-a5c6-aed19c4d2f1b None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:41.575779 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:41.592298 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:41.602076 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2ce46-b554-4a27-a9e2-2586bde900e5 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:41.638906 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591f7ae-a6eb-442d-8c72-bd2e05244890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:41.639725 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591f7ae-a6eb-442d-8c72-bd2e05244890 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:41.640033 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591f7ae-a6eb-442d-8c72-bd2e05244890 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:41.640313 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591f7ae-a6eb-442d-8c72-bd2e05244890 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:41.648734 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2591f7ae-a6eb-442d-8c72-bd2e05244890 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:41.650165 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2591f7ae-a6eb-442d-8c72-bd2e05244890 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:41.668841 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-2591f7ae-a6eb-442d-8c72-bd2e05244890 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 20:48:41.668841 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:41.668841 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:41.668841 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:41.668841 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:41.668841 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:41.668841 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:41.668841 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:41.668841 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:41.668841 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:41.668841 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:41.668841 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:41.668841 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:48:41.668841 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:48:41.668841 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:48:41.668841 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:48:41.669767 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:41.669767 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:41.669767 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:48:41.669767 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:41.669767 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:48:41.669767 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:41.669767 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:41.669767 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:41.669767 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:41.669767 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:41.669767 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:41.669767 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:41.669767 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:41.669767 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:41.669767 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:41.669767 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:41.669767 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:41.669767 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:41.670701 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:41.670701 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:41.670701 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:48:41.670701 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:48:41.670701 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:48:41.670701 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:48:41.670701 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:48:41.670701 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:48:41.670701 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 20:48:41.670701 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:41.671226 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1eba18-0c3a-4310-a5c6-aed19c4d2f1b None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:41.674990 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 473/936] 10.222.0.40 () {56 vars in 1117 bytes} [Mon Jul 11 20:48:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:48:41.676323 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f75c51-3e6c-4bca-8ee7-25b0e0b02c97 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:41.676615 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f75c51-3e6c-4bca-8ee7-25b0e0b02c97 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:41.676898 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f75c51-3e6c-4bca-8ee7-25b0e0b02c97 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:41.683788 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 474/937] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:41.683788 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f75c51-3e6c-4bca-8ee7-25b0e0b02c97 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:41.708871 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e51911-7822-4802-8896-6b68755a63bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:41.709552 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e51911-7822-4802-8896-6b68755a63bd None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:41.709840 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e51911-7822-4802-8896-6b68755a63bd None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:41.710123 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e51911-7822-4802-8896-6b68755a63bd None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:41.710853 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e51911-7822-4802-8896-6b68755a63bd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:41.711801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e51911-7822-4802-8896-6b68755a63bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:41.713384 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e51911-7822-4802-8896-6b68755a63bd None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:41.723118 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 464/938] 10.222.0.40 () {56 vars in 1126 bytes} [Mon Jul 11 20:48:41 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:41.723118 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61b597-ec47-49f3-850f-a392cfc6a556 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:41.723118 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61b597-ec47-49f3-850f-a392cfc6a556 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:41.723118 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61b597-ec47-49f3-850f-a392cfc6a556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:41.738116 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-7d61b597-ec47-49f3-850f-a392cfc6a556 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:41.739411 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-7d61b597-ec47-49f3-850f-a392cfc6a556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:41.796703 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f75c51-3e6c-4bca-8ee7-25b0e0b02c97 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:41.820002 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 465/939] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:48:41.820002 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61b597-ec47-49f3-850f-a392cfc6a556 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:41.842346 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706b556-078b-4672-a2d8-bbec6965e2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:41.843092 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706b556-078b-4672-a2d8-bbec6965e2d3 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:41.843385 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706b556-078b-4672-a2d8-bbec6965e2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:41.843659 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706b556-078b-4672-a2d8-bbec6965e2d3 None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:41.844601 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5706b556-078b-4672-a2d8-bbec6965e2d3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:41.844918 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5706b556-078b-4672-a2d8-bbec6965e2d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:41.846381 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5706b556-078b-4672-a2d8-bbec6965e2d3 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:41.848340 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:41.852519 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:41.864698 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 475/940] 10.222.0.40 () {56 vars in 1149 bytes} [Mon Jul 11 20:48:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:41.865397 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706b556-078b-4672-a2d8-bbec6965e2d3 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:41.938825 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61b597-ec47-49f3-850f-a392cfc6a556 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:41.974201 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27afe78f-17bf-4071-9da2-859e94e3c03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:41.974896 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27afe78f-17bf-4071-9da2-859e94e3c03b None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:41.975181 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27afe78f-17bf-4071-9da2-859e94e3c03b None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:41.975459 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27afe78f-17bf-4071-9da2-859e94e3c03b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:41.976220 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27afe78f-17bf-4071-9da2-859e94e3c03b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:41.978225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706b556-078b-4672-a2d8-bbec6965e2d3 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:41.978591 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27afe78f-17bf-4071-9da2-859e94e3c03b None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:42.013881 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07992d2-e53d-4e1c-b5ec-f0f0a8329225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:42.014546 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07992d2-e53d-4e1c-b5ec-f0f0a8329225 None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:42.014831 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07992d2-e53d-4e1c-b5ec-f0f0a8329225 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:42.015105 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07992d2-e53d-4e1c-b5ec-f0f0a8329225 None admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:42.015791 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07992d2-e53d-4e1c-b5ec-f0f0a8329225 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:42.017245 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07992d2-e53d-4e1c-b5ec-f0f0a8329225 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:42.018589 dv-cinder-849022-2-smb devstack@keystone.service[80375]: WARNING keystone.server.flask.common [None req-f07992d2-e53d-4e1c-b5ec-f0f0a8329225 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 11 20:48:42.063320 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.sql.core [None req-f07992d2-e53d-4e1c-b5ec-f0f0a8329225 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 11 20:48:42.063320 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 11 20:48:42.063320 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [parameters: {'id': '67039ff20f53439281e1670b9f20ad12', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 11 20:48:42.063320 dv-cinder-849022-2-smb devstack@keystone.service[80375]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80375) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 11 20:48:42.076018 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 466/941] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 11 20:48:41 2022] POST /identity/v3/endpoints => generated 347 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:48:42.076018 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27afe78f-17bf-4071-9da2-859e94e3c03b None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:42.079640 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-f07992d2-e53d-4e1c-b5ec-f0f0a8329225 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 67039ff20f53439281e1670b9f20ad12.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 67039ff20f53439281e1670b9f20ad12. Jul 11 20:48:42.079640 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:42.079640 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 20:48:42.079640 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 20:48:42.079640 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 20:48:42.079640 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 20:48:42.079640 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 20:48:42.079640 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 20:48:42.079640 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 20:48:42.079640 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application conn.query(q) Jul 11 20:48:42.079640 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 20:48:42.079640 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 20:48:42.079640 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 20:48:42.080616 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application result.read() Jul 11 20:48:42.080616 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 20:48:42.080616 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 20:48:42.080616 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 20:48:42.080616 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 20:48:42.080616 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 20:48:42.080616 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 20:48:42.080616 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 20:48:42.080616 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 20:48:42.080616 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 11 20:48:42.080616 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:42.080616 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 11 20:48:42.080616 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:42.080616 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:42.080616 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 11 20:48:42.080616 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 11 20:48:42.080616 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 11 20:48:42.080616 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 11 20:48:42.081845 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 20:48:42.081845 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application next(self.gen) Jul 11 20:48:42.081845 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 11 20:48:42.081845 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application yield resource Jul 11 20:48:42.081845 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 20:48:42.081845 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application next(self.gen) Jul 11 20:48:42.081845 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 11 20:48:42.081845 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self.session.rollback() Jul 11 20:48:42.081845 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 11 20:48:42.081845 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self.force_reraise() Jul 11 20:48:42.081845 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 11 20:48:42.081845 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise self.value Jul 11 20:48:42.081845 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 11 20:48:42.081845 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 11 20:48:42.081845 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 11 20:48:42.081845 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application session.commit() Jul 11 20:48:42.081845 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 11 20:48:42.082948 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 11 20:48:42.082948 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 11 20:48:42.082948 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._prepare_impl() Jul 11 20:48:42.082948 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 11 20:48:42.082948 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self.session.flush() Jul 11 20:48:42.082948 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 11 20:48:42.082948 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._flush(objects) Jul 11 20:48:42.082948 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 11 20:48:42.082948 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 11 20:48:42.082948 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 11 20:48:42.082948 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application compat.raise_( Jul 11 20:48:42.082948 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 20:48:42.082948 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception Jul 11 20:48:42.082948 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 11 20:48:42.082948 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application flush_context.execute() Jul 11 20:48:42.082948 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 11 20:48:42.082948 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rec.execute(self) Jul 11 20:48:42.084419 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 11 20:48:42.084419 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 11 20:48:42.084419 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 11 20:48:42.084419 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 11 20:48:42.084419 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 11 20:48:42.084419 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 11 20:48:42.084419 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 11 20:48:42.084419 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 11 20:48:42.084419 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 11 20:48:42.084419 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 11 20:48:42.084419 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 11 20:48:42.084419 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 11 20:48:42.084419 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 11 20:48:42.084419 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 11 20:48:42.084419 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 11 20:48:42.085530 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 11 20:48:42.085530 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 20:48:42.085530 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception Jul 11 20:48:42.085530 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 20:48:42.085530 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 20:48:42.085530 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 20:48:42.085530 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 20:48:42.085530 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 20:48:42.085530 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 20:48:42.085530 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 20:48:42.085530 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application conn.query(q) Jul 11 20:48:42.085530 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 20:48:42.085530 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 20:48:42.085530 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 20:48:42.085530 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application result.read() Jul 11 20:48:42.085530 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 20:48:42.085530 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 20:48:42.087044 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 20:48:42.087044 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 20:48:42.087044 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 20:48:42.087044 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 20:48:42.087044 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 20:48:42.087044 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 20:48:42.087044 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 11 20:48:42.087044 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 11 20:48:42.087044 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [parameters: {'id': '67039ff20f53439281e1670b9f20ad12', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 11 20:48:42.087044 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 11 20:48:42.087044 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:42.087044 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:48:42.087044 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:42.087044 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:42.087044 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 11 20:48:42.088091 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 11 20:48:42.088091 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 11 20:48:42.088091 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 11 20:48:42.088091 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 11 20:48:42.088091 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:42.088091 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:48:42.088091 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:42.088091 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:42.088091 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:42.088091 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:42.088091 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:42.088091 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:42.088091 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:42.088091 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:42.088091 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:42.088091 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:42.088091 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:42.089464 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:42.089464 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 11 20:48:42.089464 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 11 20:48:42.089464 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:42.089464 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:42.089464 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 11 20:48:42.089464 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 11 20:48:42.089464 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 67039ff20f53439281e1670b9f20ad12. Jul 11 20:48:42.089464 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:42.089464 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 476/942] 10.222.0.40 () {60 vars in 1140 bytes} [Mon Jul 11 20:48:41 2022] POST /identity/v3/projects => generated 262 bytes in 208 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:42.089464 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07992d2-e53d-4e1c-b5ec-f0f0a8329225 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:42.189346 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:42.231725 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:42.261773 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27afe78f-17bf-4071-9da2-859e94e3c03b None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:42.269912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07992d2-e53d-4e1c-b5ec-f0f0a8329225 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:42.300252 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5d6f0-ac1b-4916-95d5-6eb4d8c10f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:42.301064 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5d6f0-ac1b-4916-95d5-6eb4d8c10f0d None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:42.301349 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5d6f0-ac1b-4916-95d5-6eb4d8c10f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:42.301627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5d6f0-ac1b-4916-95d5-6eb4d8c10f0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:42.306886 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e0e5f-6ac9-42fe-aa5c-13cef61ceb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:42.307695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e0e5f-6ac9-42fe-aa5c-13cef61ceb6c None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:42.308010 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e0e5f-6ac9-42fe-aa5c-13cef61ceb6c None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:42.308299 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e0e5f-6ac9-42fe-aa5c-13cef61ceb6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:42.313479 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f5d6f0-ac1b-4916-95d5-6eb4d8c10f0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:42.314921 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f5d6f0-ac1b-4916-95d5-6eb4d8c10f0d None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:42.316235 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e0e5f-6ac9-42fe-aa5c-13cef61ceb6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:42.317935 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e0e5f-6ac9-42fe-aa5c-13cef61ceb6c None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:42.333119 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-01f5d6f0-ac1b-4916-95d5-6eb4d8c10f0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:42.333119 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:42.333119 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:42.333119 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:42.333119 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:42.333119 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:42.333119 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:42.333119 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:42.333119 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:42.333119 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:42.333119 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:42.333119 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:42.333119 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:42.333119 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:42.333119 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:42.334049 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:42.334049 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:42.334049 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:42.334049 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:42.334049 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:42.334049 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:42.334049 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:42.334049 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:42.334049 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:42.334049 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:42.334049 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:42.334049 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:42.334049 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:42.334049 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:42.334049 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:42.334049 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:42.334049 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:42.335020 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:42.335020 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:42.335020 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:42.335020 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:42.335261 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-7d3e0e5f-6ac9-42fe-aa5c-13cef61ceb6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:42.335261 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:42.335261 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:42.335261 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:42.335261 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:42.335261 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:42.335261 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:42.335261 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:42.335261 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:42.335261 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:42.335261 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:42.335261 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:42.335261 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:48:42.335261 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:48:42.335261 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:48:42.336734 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:48:42.336734 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:42.336734 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:42.336734 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:42.336734 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:42.336734 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:42.336734 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:42.336734 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:42.336734 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:42.336734 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:42.336734 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:42.336734 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:42.336734 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:42.336734 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:42.336734 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:42.336734 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:42.336734 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:42.337637 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:48:42.337637 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:48:42.337637 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:48:42.337637 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:48:42.337637 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:48:42.337637 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:48:42.337637 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:42.337637 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:42.338074 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 467/943] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:42.338074 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec2bd0-516e-4703-a69a-74a716285d55 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:42.338074 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec2bd0-516e-4703-a69a-74a716285d55 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:42.338074 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec2bd0-516e-4703-a69a-74a716285d55 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:42.339184 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 468/944] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:42.339472 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 477/945] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:48:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:48:42.340521 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec2bd0-516e-4703-a69a-74a716285d55 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:42.344471 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e0e5f-6ac9-42fe-aa5c-13cef61ceb6c None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:42.448620 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e0e5f-6ac9-42fe-aa5c-13cef61ceb6c None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:42.458454 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:42.460265 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec2bd0-516e-4703-a69a-74a716285d55 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:42.483980 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f76406-eb19-4b0e-9b2a-c88411dead2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:42.484677 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f76406-eb19-4b0e-9b2a-c88411dead2f None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:42.485076 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f76406-eb19-4b0e-9b2a-c88411dead2f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:42.485361 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f76406-eb19-4b0e-9b2a-c88411dead2f None admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:42.486244 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f76406-eb19-4b0e-9b2a-c88411dead2f None admin] RBAC: Adding query filter params (name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:42.486557 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f76406-eb19-4b0e-9b2a-c88411dead2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:42.488125 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f76406-eb19-4b0e-9b2a-c88411dead2f None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:42.491250 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:42.497679 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f0954-4a7a-47e0-8817-f527ff97e307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:42.498417 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f0954-4a7a-47e0-8817-f527ff97e307 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:42.498709 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f0954-4a7a-47e0-8817-f527ff97e307 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:42.498991 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f0954-4a7a-47e0-8817-f527ff97e307 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:42.499717 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f0954-4a7a-47e0-8817-f527ff97e307 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:42.501119 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f0954-4a7a-47e0-8817-f527ff97e307 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:42.503078 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f0954-4a7a-47e0-8817-f527ff97e307 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:42.511592 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 478/946] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Jul 11 20:48:42 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:42.512879 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa27568-4852-441e-9a5a-0dc20ad0170e None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:42.513186 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa27568-4852-441e-9a5a-0dc20ad0170e None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:42.513474 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa27568-4852-441e-9a5a-0dc20ad0170e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:42.539625 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 469/947] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:42.542834 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-3aa27568-4852-441e-9a5a-0dc20ad0170e None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:42.544464 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-3aa27568-4852-441e-9a5a-0dc20ad0170e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:42.545075 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f0954-4a7a-47e0-8817-f527ff97e307 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:42.629749 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 479/948] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:48:42.658669 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa27568-4852-441e-9a5a-0dc20ad0170e None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:42.701693 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f0954-4a7a-47e0-8817-f527ff97e307 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:42.754606 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7682a-6965-4262-a74e-88f4e56317d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:42.755424 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7682a-6965-4262-a74e-88f4e56317d5 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:42.755716 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7682a-6965-4262-a74e-88f4e56317d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:42.756025 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7682a-6965-4262-a74e-88f4e56317d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:42.766242 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed7682a-6965-4262-a74e-88f4e56317d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:42.767711 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed7682a-6965-4262-a74e-88f4e56317d5 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:42.786556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-4ed7682a-6965-4262-a74e-88f4e56317d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:42.786556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:42.786556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:42.786556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:42.786556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:42.786556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:42.786556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:42.786556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:42.786556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:42.786556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:42.786556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:42.786556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:42.786556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:48:42.786556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:48:42.786556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:48:42.787507 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:48:42.787507 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:42.787507 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:42.787507 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:42.787507 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:42.787507 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:42.787507 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:42.787507 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:42.787507 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:42.787507 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:42.787507 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:42.787507 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:42.787507 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:42.787507 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:42.787507 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:42.787507 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:42.787507 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:42.788512 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:48:42.788512 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:48:42.788512 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:48:42.788512 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:48:42.788512 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:48:42.788512 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:48:42.788512 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:42.788512 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:42.788512 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 470/949] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:48:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:42.794409 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7682a-6965-4262-a74e-88f4e56317d5 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:42.799759 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:42.803632 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa27568-4852-441e-9a5a-0dc20ad0170e None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:42.846456 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6849af1-2fb1-4ee7-90ea-5f2b133b305a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:42.847383 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6849af1-2fb1-4ee7-90ea-5f2b133b305a None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:42.847801 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6849af1-2fb1-4ee7-90ea-5f2b133b305a None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:42.848148 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6849af1-2fb1-4ee7-90ea-5f2b133b305a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:42.848817 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6849af1-2fb1-4ee7-90ea-5f2b133b305a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:42.850401 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6849af1-2fb1-4ee7-90ea-5f2b133b305a None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:42.852358 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:42.865282 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-a6849af1-2fb1-4ee7-90ea-5f2b133b305a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 20:48:42.865282 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:42.865282 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:48:42.865282 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:48:42.865282 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:48:42.865282 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:48:42.865282 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:48:42.865282 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:42.865282 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 20:48:42.865282 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:42.865282 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:48:42.865282 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:42.865282 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:42.865282 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:42.865282 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:42.865282 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:42.865282 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:42.866516 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:42.866516 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:42.866516 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:42.866516 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:42.866516 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:42.866516 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:42.866516 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:48:42.866516 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:48:42.866516 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:48:42.866516 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:48:42.866516 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:42.866516 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:42.866516 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:42.866516 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:42.866516 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:42.866516 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:42.868339 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:42.868339 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:42.868339 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:42.868339 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:42.868339 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:42.868339 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:42.868339 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:42.868339 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:42.868339 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:42.868339 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:42.868339 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:48:42.868339 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:42.868339 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 20:48:42.868339 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:42.868339 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 480/950] 10.222.0.40 () {56 vars in 1126 bytes} [Mon Jul 11 20:48:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:48:42.873478 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6849af1-2fb1-4ee7-90ea-5f2b133b305a None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:42.910058 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7682a-6965-4262-a74e-88f4e56317d5 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:42.948446 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04052e02-6e92-4205-a639-302606b608be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:42.949128 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04052e02-6e92-4205-a639-302606b608be None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:42.949416 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04052e02-6e92-4205-a639-302606b608be None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:42.949698 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04052e02-6e92-4205-a639-302606b608be None admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:42.950492 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04052e02-6e92-4205-a639-302606b608be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:42.950894 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04052e02-6e92-4205-a639-302606b608be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:42.952541 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04052e02-6e92-4205-a639-302606b608be None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:42.965434 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 471/951] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 11 20:48:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:42.970936 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04052e02-6e92-4205-a639-302606b608be None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:42.990948 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6849af1-2fb1-4ee7-90ea-5f2b133b305a None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:43.032900 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad69daa-8706-48ff-905b-41bd5846fe37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:43.033577 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad69daa-8706-48ff-905b-41bd5846fe37 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:43.033865 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad69daa-8706-48ff-905b-41bd5846fe37 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:43.034252 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad69daa-8706-48ff-905b-41bd5846fe37 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:43.034969 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad69daa-8706-48ff-905b-41bd5846fe37 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:43.035286 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad69daa-8706-48ff-905b-41bd5846fe37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:43.036784 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad69daa-8706-48ff-905b-41bd5846fe37 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:43.047236 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 481/952] 10.222.0.40 () {56 vars in 1122 bytes} [Mon Jul 11 20:48:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:43.048256 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad69daa-8706-48ff-905b-41bd5846fe37 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:43.079654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:43.100239 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04052e02-6e92-4205-a639-302606b608be None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:43.111572 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:43.150158 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bcaffb-886e-45fa-8f4b-9de3ac173264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:43.152128 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcaffb-886e-45fa-8f4b-9de3ac173264 None admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:43.152628 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcaffb-886e-45fa-8f4b-9de3ac173264 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:43.153319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcaffb-886e-45fa-8f4b-9de3ac173264 None admin] PATH_INFO: `/v3/projects/eca3ef2561fa435e80ff451aeab14f3b/users/90ea5d52fd6d4068b7837d363eebb94f/roles/1400a904c27a413fa8b7c591773b08cf` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:43.156296 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bcaffb-886e-45fa-8f4b-9de3ac173264 None admin] RBAC: Authorizing `identity:create_grant(project_id=eca3ef2561fa435e80ff451aeab14f3b, user_id=90ea5d52fd6d4068b7837d363eebb94f, role_id=1400a904c27a413fa8b7c591773b08cf)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:43.158730 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bcaffb-886e-45fa-8f4b-9de3ac173264 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:43.169722 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad69daa-8706-48ff-905b-41bd5846fe37 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:43.207701 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe54a32-f589-4964-8d6b-96a8085e66d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:43.208420 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe54a32-f589-4964-8d6b-96a8085e66d9 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:43.208711 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe54a32-f589-4964-8d6b-96a8085e66d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:43.209083 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe54a32-f589-4964-8d6b-96a8085e66d9 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:43.209800 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe54a32-f589-4964-8d6b-96a8085e66d9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:43.210113 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe54a32-f589-4964-8d6b-96a8085e66d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:43.211749 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe54a32-f589-4964-8d6b-96a8085e66d9 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:43.222062 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 482/953] 10.222.0.40 () {56 vars in 1122 bytes} [Mon Jul 11 20:48:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:43.223028 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe54a32-f589-4964-8d6b-96a8085e66d9 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:43.257756 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 472/954] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 11 20:48:42 2022] PUT /identity/v3/projects/eca3ef2561fa435e80ff451aeab14f3b/users/90ea5d52fd6d4068b7837d363eebb94f/roles/1400a904c27a413fa8b7c591773b08cf => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 20:48:43.340099 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:43.350845 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe54a32-f589-4964-8d6b-96a8085e66d9 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:43.391453 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4bb20c-d988-4916-8dde-be08788965b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:43.392190 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bb20c-d988-4916-8dde-be08788965b4 None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:43.392483 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bb20c-d988-4916-8dde-be08788965b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:43.392763 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bb20c-d988-4916-8dde-be08788965b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:43.393583 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4bb20c-d988-4916-8dde-be08788965b4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:43.394983 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4bb20c-d988-4916-8dde-be08788965b4 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:43.476640 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 483/955] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 11 20:48:43 2022] POST /identity/v3/endpoints => generated 349 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 20:48:44.263356 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24c473-b8c9-4fc9-ae32-b44a19c9ad0c None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:44.263902 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24c473-b8c9-4fc9-ae32-b44a19c9ad0c None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:44.263902 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24c473-b8c9-4fc9-ae32-b44a19c9ad0c None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:44.265468 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 473/956] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:44.271051 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aadb91-a096-46c1-8510-d60b131a1979 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:44.271479 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aadb91-a096-46c1-8510-d60b131a1979 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:44.271689 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aadb91-a096-46c1-8510-d60b131a1979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:44.289451 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-95aadb91-a096-46c1-8510-d60b131a1979 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:44.296572 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-95aadb91-a096-46c1-8510-d60b131a1979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:44.366581 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 484/957] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:48:44.390223 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24c473-b8c9-4fc9-ae32-b44a19c9ad0c None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:44.547957 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24c473-b8c9-4fc9-ae32-b44a19c9ad0c None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:44.585350 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b484f74d-35b9-4d63-b8ca-a0d10b37c7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:44.586359 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b484f74d-35b9-4d63-b8ca-a0d10b37c7ec None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:44.586652 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b484f74d-35b9-4d63-b8ca-a0d10b37c7ec None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:44.586936 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b484f74d-35b9-4d63-b8ca-a0d10b37c7ec None admin] PATH_INFO: `/v3/services/compute` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:44.587600 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b484f74d-35b9-4d63-b8ca-a0d10b37c7ec None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:44.589272 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b484f74d-35b9-4d63-b8ca-a0d10b37c7ec None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:44.603266 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-b484f74d-35b9-4d63-b8ca-a0d10b37c7ec None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 20:48:44.603266 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:44.603266 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:48:44.603266 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:48:44.603266 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:48:44.603266 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:48:44.603266 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:48:44.603266 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:44.603266 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 20:48:44.603266 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:44.603266 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:48:44.603266 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:44.603266 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:44.603266 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:44.603266 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:44.603266 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:44.603266 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:44.604383 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:44.604383 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:44.604383 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:44.604383 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:44.604383 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:44.604383 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:44.604383 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:48:44.604383 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:48:44.604383 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:48:44.604383 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:48:44.604383 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:44.604383 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:44.604383 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:44.604383 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:44.604383 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:44.604383 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:44.605357 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:44.605357 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:44.605357 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:44.605357 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:44.605357 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:44.605357 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:44.605357 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:44.605357 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:44.605357 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:44.605357 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:44.605357 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:48:44.605357 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:44.605357 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 20:48:44.605357 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:44.606644 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 474/958] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:48:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:44.612901 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aadb91-a096-46c1-8510-d60b131a1979 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:44.739645 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:44.777441 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aadb91-a096-46c1-8510-d60b131a1979 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:44.817013 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5016b-13ea-4532-bbfc-409abfaf9206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:44.817614 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5016b-13ea-4532-bbfc-409abfaf9206 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:44.817902 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5016b-13ea-4532-bbfc-409abfaf9206 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:44.818187 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5016b-13ea-4532-bbfc-409abfaf9206 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:44.818903 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c5016b-13ea-4532-bbfc-409abfaf9206 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:44.819218 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c5016b-13ea-4532-bbfc-409abfaf9206 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:44.821196 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c5016b-13ea-4532-bbfc-409abfaf9206 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:44.830838 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 485/959] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Jul 11 20:48:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:44.832231 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b484f74d-35b9-4d63-b8ca-a0d10b37c7ec None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:44.855463 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82452cfb-50cf-437a-b8fb-fdfa42252546 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:44.856124 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82452cfb-50cf-437a-b8fb-fdfa42252546 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:44.856553 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82452cfb-50cf-437a-b8fb-fdfa42252546 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:44.858415 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 486/960] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:48:44.863424 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5292819-9d4c-4467-8009-3b70a1ab8f19 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:44.863995 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5292819-9d4c-4467-8009-3b70a1ab8f19 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:44.864495 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5292819-9d4c-4467-8009-3b70a1ab8f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:44.868996 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:44.883783 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-b5292819-9d4c-4467-8009-3b70a1ab8f19 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:44.885296 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-b5292819-9d4c-4467-8009-3b70a1ab8f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:44.946213 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b484f74d-35b9-4d63-b8ca-a0d10b37c7ec None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:44.958678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 487/961] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 20:48:44.984024 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205f625-425a-4ca9-a113-58b0559ab8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:44.984730 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205f625-425a-4ca9-a113-58b0559ab8cf None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:44.985022 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205f625-425a-4ca9-a113-58b0559ab8cf None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:44.985302 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205f625-425a-4ca9-a113-58b0559ab8cf None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:44.985803 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5292819-9d4c-4467-8009-3b70a1ab8f19 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:44.986015 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9205f625-425a-4ca9-a113-58b0559ab8cf None admin] RBAC: Adding query filter params (type=compute) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:44.986331 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9205f625-425a-4ca9-a113-58b0559ab8cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:44.987696 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9205f625-425a-4ca9-a113-58b0559ab8cf None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:44.996052 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 475/962] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Jul 11 20:48:44 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:45.062778 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:45.104446 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5292819-9d4c-4467-8009-3b70a1ab8f19 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:45.147921 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8f967-1bd5-4ac5-a407-c1bfe035f9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:45.148751 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8f967-1bd5-4ac5-a407-c1bfe035f9a1 None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:45.149030 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8f967-1bd5-4ac5-a407-c1bfe035f9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:45.149311 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8f967-1bd5-4ac5-a407-c1bfe035f9a1 None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:45.150039 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8f967-1bd5-4ac5-a407-c1bfe035f9a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:45.151507 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8f967-1bd5-4ac5-a407-c1bfe035f9a1 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:45.195157 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.sql.core [None req-20b8f967-1bd5-4ac5-a407-c1bfe035f9a1 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 11 20:48:45.195157 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 11 20:48:45.195157 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [parameters: {'user_id': '39658c48518d45cf9e2fa148da5582b2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 11 20:48:45.195157 dv-cinder-849022-2-smb devstack@keystone.service[80375]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80375) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 11 20:48:45.202710 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-20b8f967-1bd5-4ac5-a407-c1bfe035f9a1 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 11 20:48:45.202710 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:45.202710 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 20:48:45.202710 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 20:48:45.202710 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 20:48:45.202710 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 20:48:45.202710 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 20:48:45.202710 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 20:48:45.202710 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 20:48:45.202710 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application conn.query(q) Jul 11 20:48:45.202710 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 20:48:45.202710 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 20:48:45.202710 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 20:48:45.202710 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application result.read() Jul 11 20:48:45.202710 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 20:48:45.203664 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 20:48:45.203664 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 20:48:45.203664 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 20:48:45.203664 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 20:48:45.203664 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 20:48:45.203664 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 20:48:45.203664 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 20:48:45.203664 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 11 20:48:45.203664 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:45.203664 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 11 20:48:45.203664 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:45.203664 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:45.203664 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 11 20:48:45.203664 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 11 20:48:45.203664 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 11 20:48:45.203664 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 11 20:48:45.203664 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 20:48:45.203664 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application next(self.gen) Jul 11 20:48:45.204737 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 11 20:48:45.204737 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application yield resource Jul 11 20:48:45.204737 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 20:48:45.204737 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application next(self.gen) Jul 11 20:48:45.204737 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 11 20:48:45.204737 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self.session.rollback() Jul 11 20:48:45.204737 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 11 20:48:45.204737 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self.force_reraise() Jul 11 20:48:45.204737 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 11 20:48:45.204737 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise self.value Jul 11 20:48:45.204737 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 11 20:48:45.204737 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 11 20:48:45.204737 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 11 20:48:45.204737 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application session.commit() Jul 11 20:48:45.204737 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 11 20:48:45.204737 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 11 20:48:45.204737 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 11 20:48:45.205638 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._prepare_impl() Jul 11 20:48:45.205638 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 11 20:48:45.205638 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self.session.flush() Jul 11 20:48:45.205638 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 11 20:48:45.205638 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._flush(objects) Jul 11 20:48:45.205638 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 11 20:48:45.205638 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 11 20:48:45.205638 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 11 20:48:45.205638 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application compat.raise_( Jul 11 20:48:45.205638 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 20:48:45.205638 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception Jul 11 20:48:45.205638 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 11 20:48:45.205638 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application flush_context.execute() Jul 11 20:48:45.205638 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 11 20:48:45.205638 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rec.execute(self) Jul 11 20:48:45.205638 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 11 20:48:45.205638 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 11 20:48:45.206524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 11 20:48:45.206524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 11 20:48:45.206524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 11 20:48:45.206524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 11 20:48:45.206524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 11 20:48:45.206524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 11 20:48:45.206524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 11 20:48:45.206524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 11 20:48:45.206524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 11 20:48:45.206524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 11 20:48:45.206524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 11 20:48:45.206524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 11 20:48:45.206524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 11 20:48:45.206524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 11 20:48:45.206524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 20:48:45.206524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception Jul 11 20:48:45.207408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 20:48:45.207408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 20:48:45.207408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 20:48:45.207408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 20:48:45.207408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 20:48:45.207408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 20:48:45.207408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 20:48:45.207408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application conn.query(q) Jul 11 20:48:45.207408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 20:48:45.207408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 20:48:45.207408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 20:48:45.207408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application result.read() Jul 11 20:48:45.207408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 20:48:45.207408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 20:48:45.207408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 20:48:45.207408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 20:48:45.209612 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 20:48:45.209612 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 20:48:45.209612 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 20:48:45.209612 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 20:48:45.209612 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 11 20:48:45.209612 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 11 20:48:45.209612 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [parameters: {'user_id': '39658c48518d45cf9e2fa148da5582b2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 11 20:48:45.209612 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 11 20:48:45.209612 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:45.209612 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:48:45.209612 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:45.209612 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:45.209612 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:45.209612 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:45.209612 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:45.211572 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:45.211572 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:45.211572 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:45.211572 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:45.211572 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:45.211572 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:45.211572 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:45.211572 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 11 20:48:45.211572 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 11 20:48:45.211572 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:45.211572 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:45.211572 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:48:45.211572 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:45.211572 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:48:45.211572 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:45.211572 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 11 20:48:45.211572 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 11 20:48:45.213959 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 11 20:48:45.213959 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 11 20:48:45.213959 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 11 20:48:45.213959 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 11 20:48:45.213959 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 11 20:48:45.213959 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:45.213959 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 488/963] 10.222.0.40 () {60 vars in 1131 bytes} [Mon Jul 11 20:48:44 2022] POST /identity/v3/users => generated 160 bytes in 220 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:48:45.216988 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205f625-425a-4ca9-a113-58b0559ab8cf None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:45.328178 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:45.338282 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205f625-425a-4ca9-a113-58b0559ab8cf None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:45.376610 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba92c7-120f-4806-8841-30509a32fa07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:45.377814 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba92c7-120f-4806-8841-30509a32fa07 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:45.378283 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba92c7-120f-4806-8841-30509a32fa07 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:45.378781 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba92c7-120f-4806-8841-30509a32fa07 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:45.388470 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba92c7-120f-4806-8841-30509a32fa07 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:45.390187 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba92c7-120f-4806-8841-30509a32fa07 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:45.408090 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-edba92c7-120f-4806-8841-30509a32fa07 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 20:48:45.408090 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:45.408090 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:45.408090 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:45.408090 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:45.408090 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:45.408090 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:45.408090 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:45.408090 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:45.408090 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:45.408090 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:45.408090 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:45.408090 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:48:45.408090 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:48:45.408090 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:48:45.408090 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:48:45.409130 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:45.409130 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:45.409130 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:48:45.409130 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:45.409130 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:48:45.409130 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:45.409130 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:45.409130 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:45.409130 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:45.409130 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:45.409130 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:45.409130 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:45.409130 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:45.409130 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:45.409130 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:45.409130 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:45.409130 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:45.409130 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:45.410056 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:45.410056 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:45.410056 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:48:45.410056 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:48:45.410056 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:48:45.410056 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:48:45.410056 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:48:45.410056 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:48:45.410056 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 20:48:45.410056 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:45.412654 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 476/964] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:48:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:45.424006 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8f967-1bd5-4ac5-a407-c1bfe035f9a1 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:45.440298 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b600a-f863-4aea-8e3a-2f3a12931484 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:45.440655 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b600a-f863-4aea-8e3a-2f3a12931484 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:45.441148 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b600a-f863-4aea-8e3a-2f3a12931484 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:45.443418 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 477/965] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:48:45.449410 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270c493-0627-40a7-9bb2-dcd2bf0adce6 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:45.449797 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270c493-0627-40a7-9bb2-dcd2bf0adce6 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:45.450176 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270c493-0627-40a7-9bb2-dcd2bf0adce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:45.467798 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-7270c493-0627-40a7-9bb2-dcd2bf0adce6 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:45.469155 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-7270c493-0627-40a7-9bb2-dcd2bf0adce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:45.542054 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8f967-1bd5-4ac5-a407-c1bfe035f9a1 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:45.545285 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 478/966] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 20:48:45.577055 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270c493-0627-40a7-9bb2-dcd2bf0adce6 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:45.581248 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:45.588952 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856dbc6f-5102-49b1-92cf-d87d146d8bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:45.589640 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856dbc6f-5102-49b1-92cf-d87d146d8bcf None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:45.589926 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856dbc6f-5102-49b1-92cf-d87d146d8bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:45.590205 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856dbc6f-5102-49b1-92cf-d87d146d8bcf None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:45.591018 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856dbc6f-5102-49b1-92cf-d87d146d8bcf None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:45.591329 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856dbc6f-5102-49b1-92cf-d87d146d8bcf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:45.593071 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856dbc6f-5102-49b1-92cf-d87d146d8bcf None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:45.640077 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 489/967] 10.222.0.40 () {56 vars in 1101 bytes} [Mon Jul 11 20:48:45 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:45.704475 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:45.719090 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270c493-0627-40a7-9bb2-dcd2bf0adce6 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:45.729004 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbfbe4-be90-4980-ab1d-88fd74e0a058 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:45.729299 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbfbe4-be90-4980-ab1d-88fd74e0a058 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:45.729588 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbfbe4-be90-4980-ab1d-88fd74e0a058 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:45.736533 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 490/968] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:45 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:48:45.738932 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226a34e-63e5-4e10-b9d2-43b0f7ef15c4 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:45.739222 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226a34e-63e5-4e10-b9d2-43b0f7ef15c4 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:45.739506 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226a34e-63e5-4e10-b9d2-43b0f7ef15c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:45.760729 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-8226a34e-63e5-4e10-b9d2-43b0f7ef15c4 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:45.762299 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-8226a34e-63e5-4e10-b9d2-43b0f7ef15c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:45.769752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1e914-e542-4bf0-8bdf-dce25f423796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:45.771088 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1e914-e542-4bf0-8bdf-dce25f423796 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:45.771598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1e914-e542-4bf0-8bdf-dce25f423796 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:45.772149 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1e914-e542-4bf0-8bdf-dce25f423796 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:45.785837 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1e914-e542-4bf0-8bdf-dce25f423796 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:48:45.796882 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-9ba1e914-e542-4bf0-8bdf-dce25f423796 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 20:48:45.796882 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:45.796882 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:45.796882 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:45.796882 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:45.796882 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:45.796882 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:45.796882 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:45.796882 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:45.796882 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:45.796882 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:45.796882 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:45.796882 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:48:45.796882 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:48:45.796882 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:48:45.796882 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:48:45.797936 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:48:45.797936 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:48:45.797936 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:48:45.797936 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:48:45.797936 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:45.797936 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:45.797936 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:45.797936 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:45.797936 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:45.797936 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:45.797936 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:45.797936 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:45.797936 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:45.797936 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:45.797936 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:45.797936 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:45.798803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:45.798803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:45.798803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:45.798803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:45.798803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:48:45.798803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:48:45.798803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:48:45.798803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:48:45.798803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:48:45.798803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:48:45.798803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 20:48:45.798803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:45.801812 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 479/969] 10.222.0.40 () {56 vars in 1120 bytes} [Mon Jul 11 20:48:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:45.809577 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1e914-e542-4bf0-8bdf-dce25f423796 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:45.862558 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 491/970] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:48:45.888205 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226a34e-63e5-4e10-b9d2-43b0f7ef15c4 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:45.949829 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1e914-e542-4bf0-8bdf-dce25f423796 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:46.004211 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c3210-7c61-48d3-8126-4b02edf477fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:46.004905 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c3210-7c61-48d3-8126-4b02edf477fa None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:46.005197 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c3210-7c61-48d3-8126-4b02edf477fa None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:46.005481 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c3210-7c61-48d3-8126-4b02edf477fa None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:46.006240 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c3210-7c61-48d3-8126-4b02edf477fa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:46.006558 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c3210-7c61-48d3-8126-4b02edf477fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:46.008501 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c3210-7c61-48d3-8126-4b02edf477fa None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:46.017895 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 480/971] 10.222.0.40 () {56 vars in 1115 bytes} [Mon Jul 11 20:48:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:46.023482 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c3210-7c61-48d3-8126-4b02edf477fa None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:46.028672 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226a34e-63e5-4e10-b9d2-43b0f7ef15c4 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:46.041869 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:46.048799 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:46.072714 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae07bb-e736-42c5-aaf4-5b5329db13cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:46.073547 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae07bb-e736-42c5-aaf4-5b5329db13cc None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:46.073840 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae07bb-e736-42c5-aaf4-5b5329db13cc None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:46.074121 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae07bb-e736-42c5-aaf4-5b5329db13cc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:46.074785 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae07bb-e736-42c5-aaf4-5b5329db13cc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:46.076356 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae07bb-e736-42c5-aaf4-5b5329db13cc None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:46.089712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-7cae07bb-e736-42c5-aaf4-5b5329db13cc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 20:48:46.089712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:46.089712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:48:46.089712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:48:46.089712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:48:46.089712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:48:46.089712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:48:46.089712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:46.089712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 20:48:46.089712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:46.089712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:48:46.089712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:46.089712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:46.089712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:46.089712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:46.089712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:46.089712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:46.090800 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:46.090800 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:46.090800 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:46.090800 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:46.090800 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:46.090800 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:46.090800 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:48:46.090800 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:48:46.090800 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:48:46.090800 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:48:46.090800 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:46.090800 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:46.090800 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:46.090800 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:46.090800 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:46.090800 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:46.091668 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:46.091668 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:46.091668 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:46.091668 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:46.091668 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:46.091668 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:46.091668 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:46.091668 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:46.091668 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:46.091668 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:46.091668 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:48:46.091668 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:46.091668 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 20:48:46.091668 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:46.091668 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 492/972] 10.222.0.40 () {56 vars in 1126 bytes} [Mon Jul 11 20:48:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:48:46.097897 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae07bb-e736-42c5-aaf4-5b5329db13cc None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:46.148143 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c3210-7c61-48d3-8126-4b02edf477fa None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:46.188515 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc57c6-389b-4f98-994a-9797b0858972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:46.189318 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc57c6-389b-4f98-994a-9797b0858972 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:46.189605 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc57c6-389b-4f98-994a-9797b0858972 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:46.189883 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc57c6-389b-4f98-994a-9797b0858972 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:46.202669 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc57c6-389b-4f98-994a-9797b0858972 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:46.204150 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc57c6-389b-4f98-994a-9797b0858972 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:46.212416 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae07bb-e736-42c5-aaf4-5b5329db13cc None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:46.222831 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-77fc57c6-389b-4f98-994a-9797b0858972 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:46.222831 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:46.222831 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:46.222831 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:46.222831 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:46.222831 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:46.222831 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:46.222831 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:46.222831 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:46.222831 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:46.222831 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:46.222831 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:46.222831 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:46.222831 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:46.222831 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:46.223939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:46.223939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:46.223939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:46.223939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:46.223939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:46.223939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:46.223939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:46.223939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:46.223939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:46.223939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:46.223939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:46.223939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:46.223939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:46.223939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:46.223939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:46.223939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:46.223939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:46.225405 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:46.225405 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:46.225405 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:46.225405 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:46.225405 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 481/973] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:48:46.229869 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc57c6-389b-4f98-994a-9797b0858972 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:46.254506 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447de687-d39e-4542-90b1-9d571251df00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:46.255304 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447de687-d39e-4542-90b1-9d571251df00 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:46.255588 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447de687-d39e-4542-90b1-9d571251df00 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:46.255863 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447de687-d39e-4542-90b1-9d571251df00 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:46.257031 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447de687-d39e-4542-90b1-9d571251df00 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:46.257368 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447de687-d39e-4542-90b1-9d571251df00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:46.259932 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447de687-d39e-4542-90b1-9d571251df00 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:46.272331 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 493/974] 10.222.0.40 () {56 vars in 1122 bytes} [Mon Jul 11 20:48:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:46.273324 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447de687-d39e-4542-90b1-9d571251df00 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:46.305137 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:46.331676 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:46.356811 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc57c6-389b-4f98-994a-9797b0858972 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:46.393022 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f5c173-434d-4e54-b98e-2f20e3facc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:46.393695 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5c173-434d-4e54-b98e-2f20e3facc80 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:46.393985 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5c173-434d-4e54-b98e-2f20e3facc80 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:46.394269 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5c173-434d-4e54-b98e-2f20e3facc80 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:46.394993 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f5c173-434d-4e54-b98e-2f20e3facc80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:46.395312 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f5c173-434d-4e54-b98e-2f20e3facc80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:46.396698 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f5c173-434d-4e54-b98e-2f20e3facc80 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:46.401318 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447de687-d39e-4542-90b1-9d571251df00 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:46.409328 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 482/975] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:46.414577 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f5c173-434d-4e54-b98e-2f20e3facc80 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:46.437049 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39350e67-9caf-433e-ad42-a73c2c2eabc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:46.437751 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39350e67-9caf-433e-ad42-a73c2c2eabc3 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:46.438005 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39350e67-9caf-433e-ad42-a73c2c2eabc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:46.438284 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39350e67-9caf-433e-ad42-a73c2c2eabc3 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:46.438988 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39350e67-9caf-433e-ad42-a73c2c2eabc3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:46.439300 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39350e67-9caf-433e-ad42-a73c2c2eabc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:46.440701 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39350e67-9caf-433e-ad42-a73c2c2eabc3 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:46.446478 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 494/976] 10.222.0.40 () {56 vars in 1122 bytes} [Mon Jul 11 20:48:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:46.452235 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39350e67-9caf-433e-ad42-a73c2c2eabc3 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:46.532450 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f5c173-434d-4e54-b98e-2f20e3facc80 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:46.556399 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39350e67-9caf-433e-ad42-a73c2c2eabc3 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:46.557319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:46.566216 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:46.568951 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7defcd00-a1c5-402e-b51c-5c9641c21f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:46.569850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defcd00-a1c5-402e-b51c-5c9641c21f04 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:46.574151 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defcd00-a1c5-402e-b51c-5c9641c21f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:46.574151 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defcd00-a1c5-402e-b51c-5c9641c21f04 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:46.578513 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7defcd00-a1c5-402e-b51c-5c9641c21f04 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:46.579903 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7defcd00-a1c5-402e-b51c-5c9641c21f04 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:46.592605 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e4017-fb55-4f03-bcfb-e122a3dd578d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:46.596868 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e4017-fb55-4f03-bcfb-e122a3dd578d None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:46.596868 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e4017-fb55-4f03-bcfb-e122a3dd578d None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:46.596868 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e4017-fb55-4f03-bcfb-e122a3dd578d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:46.596868 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e4017-fb55-4f03-bcfb-e122a3dd578d None admin] RBAC: Adding query filter params (interface=admin, service_id=338e04219b5d44b08b56e0960912ae4a, region_id=RegionOne) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:46.596868 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e4017-fb55-4f03-bcfb-e122a3dd578d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:46.596868 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e4017-fb55-4f03-bcfb-e122a3dd578d None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:46.597304 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-7defcd00-a1c5-402e-b51c-5c9641c21f04 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 20:48:46.597304 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:46.597304 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:46.597304 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:46.597304 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:46.597304 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:46.597304 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:46.597304 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:46.597304 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:46.597304 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:46.597304 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:46.597304 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:46.597304 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:48:46.597304 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:48:46.597304 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:48:46.597304 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:48:46.598147 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:46.598147 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:46.598147 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:48:46.598147 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:46.598147 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:48:46.598147 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:46.598147 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:46.598147 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:46.598147 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:46.598147 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:46.598147 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:46.598147 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:46.598147 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:46.598147 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:46.598147 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:46.598147 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:46.598147 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:46.598147 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:46.599099 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:46.599099 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:46.599099 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:48:46.599099 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:48:46.599099 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:48:46.599099 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:48:46.599099 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:48:46.599099 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:48:46.599099 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 20:48:46.599099 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:46.599099 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 483/977] 10.222.0.40 () {56 vars in 1117 bytes} [Mon Jul 11 20:48:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:48:46.604261 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7defcd00-a1c5-402e-b51c-5c9641c21f04 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:46.611700 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 495/978] 10.222.0.40 () {56 vars in 1249 bytes} [Mon Jul 11 20:48:46 2022] GET /identity/v3/endpoints?service_id=338e04219b5d44b08b56e0960912ae4a&interface=admin®ion_id=RegionOne => generated 193 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:46.612792 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e4017-fb55-4f03-bcfb-e122a3dd578d None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:46.719401 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7defcd00-a1c5-402e-b51c-5c9641c21f04 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:46.726750 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e4017-fb55-4f03-bcfb-e122a3dd578d None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:46.756642 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdbd288-ee9b-4d98-8aec-16c64032de5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:46.757393 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbd288-ee9b-4d98-8aec-16c64032de5c None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:46.757683 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbd288-ee9b-4d98-8aec-16c64032de5c None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:46.758490 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbd288-ee9b-4d98-8aec-16c64032de5c None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:46.759326 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdbd288-ee9b-4d98-8aec-16c64032de5c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:46.759677 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdbd288-ee9b-4d98-8aec-16c64032de5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:46.761231 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdbd288-ee9b-4d98-8aec-16c64032de5c None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:46.764808 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc7e75-1a40-4e53-b381-9afc1aa8ca6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:46.765482 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc7e75-1a40-4e53-b381-9afc1aa8ca6f None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:46.765767 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc7e75-1a40-4e53-b381-9afc1aa8ca6f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:46.766045 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc7e75-1a40-4e53-b381-9afc1aa8ca6f None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:46.766730 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc7e75-1a40-4e53-b381-9afc1aa8ca6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:46.768117 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc7e75-1a40-4e53-b381-9afc1aa8ca6f None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:46.775504 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 496/979] 10.222.0.40 () {56 vars in 1087 bytes} [Mon Jul 11 20:48:46 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 20:48:46.784169 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 484/980] 10.222.0.40 () {56 vars in 1149 bytes} [Mon Jul 11 20:48:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:46.785203 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc7e75-1a40-4e53-b381-9afc1aa8ca6f None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:46.825070 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:46.897118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc7e75-1a40-4e53-b381-9afc1aa8ca6f None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:46.937017 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940f8ae-137b-4239-b524-cb250e9ba99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:46.937686 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940f8ae-137b-4239-b524-cb250e9ba99f None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:46.937983 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940f8ae-137b-4239-b524-cb250e9ba99f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:46.938267 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940f8ae-137b-4239-b524-cb250e9ba99f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:47.009655 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940f8ae-137b-4239-b524-cb250e9ba99f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:47.011130 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940f8ae-137b-4239-b524-cb250e9ba99f None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:47.045361 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:47.116853 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 497/981] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:48:46 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 20:48:47.118652 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdbd288-ee9b-4d98-8aec-16c64032de5c None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:47.161732 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:47.221844 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdbd288-ee9b-4d98-8aec-16c64032de5c None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:47.232008 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e322b-eced-4943-9a44-8b21e696cd3e None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:47.232008 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e322b-eced-4943-9a44-8b21e696cd3e None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:47.232008 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e322b-eced-4943-9a44-8b21e696cd3e None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:47.233515 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 498/982] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:48:47.238644 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e8d10-ff66-42d1-9e08-f24a32968da1 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:47.238958 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e8d10-ff66-42d1-9e08-f24a32968da1 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:47.239248 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e8d10-ff66-42d1-9e08-f24a32968da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:47.256981 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-5e1e8d10-ff66-42d1-9e08-f24a32968da1 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:47.267505 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-5e1e8d10-ff66-42d1-9e08-f24a32968da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:47.267626 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e566e3f-c13a-40b8-b1e3-51394a94b3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:47.267626 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e566e3f-c13a-40b8-b1e3-51394a94b3cb None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:47.267626 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e566e3f-c13a-40b8-b1e3-51394a94b3cb None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:47.267626 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e566e3f-c13a-40b8-b1e3-51394a94b3cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:47.274903 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e566e3f-c13a-40b8-b1e3-51394a94b3cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:47.276512 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e566e3f-c13a-40b8-b1e3-51394a94b3cb None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:47.295908 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-9e566e3f-c13a-40b8-b1e3-51394a94b3cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:47.295908 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:47.295908 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:47.295908 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:47.295908 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:47.295908 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:47.295908 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:47.295908 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:47.295908 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:47.295908 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:47.295908 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:47.295908 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:47.295908 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:47.295908 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:47.295908 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:47.297064 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:47.297064 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:47.297064 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:47.297064 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:47.297064 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:47.297064 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:47.297064 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:47.297064 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:47.297064 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:47.297064 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:47.297064 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:47.297064 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:47.297064 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:47.297064 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:47.297064 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:47.297064 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:47.297064 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:47.302750 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:47.302750 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:47.302750 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:47.302750 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:47.302750 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 485/983] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:47.303478 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e566e3f-c13a-40b8-b1e3-51394a94b3cb None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:47.338068 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 499/984] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:48:47.360725 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e8d10-ff66-42d1-9e08-f24a32968da1 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:47.406845 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:47.417162 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e566e3f-c13a-40b8-b1e3-51394a94b3cb None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:47.429588 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:47.453769 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35935aa-5071-4d59-858b-0fb59e4d5431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:47.454449 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35935aa-5071-4d59-858b-0fb59e4d5431 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:47.454735 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35935aa-5071-4d59-858b-0fb59e4d5431 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:47.455014 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35935aa-5071-4d59-858b-0fb59e4d5431 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:47.455790 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35935aa-5071-4d59-858b-0fb59e4d5431 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:47.456142 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35935aa-5071-4d59-858b-0fb59e4d5431 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:47.457617 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35935aa-5071-4d59-858b-0fb59e4d5431 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:47.467374 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e8d10-ff66-42d1-9e08-f24a32968da1 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:47.470310 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 486/985] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:47.475361 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35935aa-5071-4d59-858b-0fb59e4d5431 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:47.507232 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae504de-0a74-4bfc-bd87-1e4f561a30e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:47.508815 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae504de-0a74-4bfc-bd87-1e4f561a30e2 None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:47.509313 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae504de-0a74-4bfc-bd87-1e4f561a30e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:47.509753 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae504de-0a74-4bfc-bd87-1e4f561a30e2 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:47.510716 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae504de-0a74-4bfc-bd87-1e4f561a30e2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:47.512297 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae504de-0a74-4bfc-bd87-1e4f561a30e2 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:47.575055 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 500/986] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Jul 11 20:48:47 2022] POST /identity/v3/services => generated 242 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 20:48:47.577802 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35935aa-5071-4d59-858b-0fb59e4d5431 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:47.625986 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf7dab-4ec6-4166-b1c6-73170118fb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:47.627174 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf7dab-4ec6-4166-b1c6-73170118fb3f None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:47.627607 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf7dab-4ec6-4166-b1c6-73170118fb3f None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:47.628066 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf7dab-4ec6-4166-b1c6-73170118fb3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:47.637057 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cf7dab-4ec6-4166-b1c6-73170118fb3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:47.638911 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cf7dab-4ec6-4166-b1c6-73170118fb3f None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:47.655138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-26cf7dab-4ec6-4166-b1c6-73170118fb3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:47.655138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:47.655138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:47.655138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:47.655138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:47.655138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:47.655138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:47.655138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:47.655138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:47.655138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:47.655138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:47.655138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:47.655138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:48:47.655138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:48:47.655138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:48:47.656303 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:48:47.656303 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:47.656303 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:47.656303 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:47.656303 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:47.656303 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:47.656303 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:47.656303 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:47.656303 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:47.656303 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:47.656303 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:47.656303 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:47.656303 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:47.656303 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:47.656303 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:47.656303 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:47.656303 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:47.657421 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:48:47.657421 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:48:47.657421 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:48:47.657421 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:48:47.657421 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:48:47.657421 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:48:47.657421 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:47.657421 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:47.659773 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 487/987] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:48:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:48:47.666463 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae504de-0a74-4bfc-bd87-1e4f561a30e2 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:47.776744 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae504de-0a74-4bfc-bd87-1e4f561a30e2 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:47.804614 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:47.813325 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad34fec-ce16-44a1-8109-1f6c5c301fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:47.814003 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad34fec-ce16-44a1-8109-1f6c5c301fcd None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:47.814290 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad34fec-ce16-44a1-8109-1f6c5c301fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:47.814572 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad34fec-ce16-44a1-8109-1f6c5c301fcd None admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:47.815360 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad34fec-ce16-44a1-8109-1f6c5c301fcd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:47.815677 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad34fec-ce16-44a1-8109-1f6c5c301fcd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:47.817155 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad34fec-ce16-44a1-8109-1f6c5c301fcd None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:47.836510 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 501/988] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 11 20:48:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:47.836818 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf7dab-4ec6-4166-b1c6-73170118fb3f None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:47.847931 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:47.940915 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf7dab-4ec6-4166-b1c6-73170118fb3f None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:47.976126 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e32cf9-2128-4536-ab6a-a307b3bcd0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:47.977331 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e32cf9-2128-4536-ab6a-a307b3bcd0f4 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:47.977619 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e32cf9-2128-4536-ab6a-a307b3bcd0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:47.977899 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e32cf9-2128-4536-ab6a-a307b3bcd0f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:47.978727 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e32cf9-2128-4536-ab6a-a307b3bcd0f4 None admin] RBAC: Adding query filter params (role.id=1400a904c27a413fa8b7c591773b08cf, scope.project.id=eca3ef2561fa435e80ff451aeab14f3b, user.id=90ea5d52fd6d4068b7837d363eebb94f) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:47.979045 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e32cf9-2128-4536-ab6a-a307b3bcd0f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:47.980496 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e32cf9-2128-4536-ab6a-a307b3bcd0f4 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:47.992076 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 488/989] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:48:47 2022] GET /identity/v3/role_assignments?user.id=90ea5d52fd6d4068b7837d363eebb94f&scope.project.id=eca3ef2561fa435e80ff451aeab14f3b&role.id=1400a904c27a413fa8b7c591773b08cf => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:48.902115 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcaf630-8bd5-44ff-a52d-76c214810174 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:48.902625 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcaf630-8bd5-44ff-a52d-76c214810174 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:48.902701 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcaf630-8bd5-44ff-a52d-76c214810174 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:48.905071 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 502/990] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:48.909434 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2e5a2-4fb2-4c3c-a58e-a33ff35ba3f8 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:48.909843 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2e5a2-4fb2-4c3c-a58e-a33ff35ba3f8 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:48.910041 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2e5a2-4fb2-4c3c-a58e-a33ff35ba3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:48.926579 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-69d2e5a2-4fb2-4c3c-a58e-a33ff35ba3f8 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:48.927690 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-69d2e5a2-4fb2-4c3c-a58e-a33ff35ba3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:48.995471 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 489/991] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:48:49.018795 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcaf630-8bd5-44ff-a52d-76c214810174 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:49.123833 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcaf630-8bd5-44ff-a52d-76c214810174 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:49.158415 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2cb4c6-5ea8-4958-be67-74831e7e3816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:49.159228 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2cb4c6-5ea8-4958-be67-74831e7e3816 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:49.159514 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2cb4c6-5ea8-4958-be67-74831e7e3816 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:49.159792 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2cb4c6-5ea8-4958-be67-74831e7e3816 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:49.160475 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2cb4c6-5ea8-4958-be67-74831e7e3816 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:49.161839 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2cb4c6-5ea8-4958-be67-74831e7e3816 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:49.174221 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-5f2cb4c6-5ea8-4958-be67-74831e7e3816 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 20:48:49.174221 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:49.174221 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:48:49.174221 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:48:49.174221 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:48:49.174221 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:48:49.174221 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:48:49.174221 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:49.174221 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 20:48:49.174221 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:49.174221 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:48:49.174221 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:49.174221 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:49.174221 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:49.174221 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:49.174221 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:49.174221 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:49.175211 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:49.175211 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:49.175211 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:49.175211 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:49.175211 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:49.175211 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:49.175211 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:48:49.175211 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:48:49.175211 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:48:49.175211 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:48:49.175211 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:49.175211 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:49.175211 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:49.175211 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:49.175211 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:49.175211 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:49.176524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:49.176524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:49.176524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:49.176524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:49.176524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:49.176524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:49.176524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:49.176524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:49.176524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:49.176524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:49.176524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:48:49.176524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:49.176524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 20:48:49.176524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:49.180351 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 503/992] 10.222.0.40 () {56 vars in 1126 bytes} [Mon Jul 11 20:48:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:49.182262 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2e5a2-4fb2-4c3c-a58e-a33ff35ba3f8 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:49.184472 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:49.281901 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2e5a2-4fb2-4c3c-a58e-a33ff35ba3f8 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:49.315152 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e85d41-2d08-487e-bcc0-490d8a12c5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:49.315874 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e85d41-2d08-487e-bcc0-490d8a12c5ca None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:49.316189 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e85d41-2d08-487e-bcc0-490d8a12c5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:49.316468 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e85d41-2d08-487e-bcc0-490d8a12c5ca None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:49.317171 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e85d41-2d08-487e-bcc0-490d8a12c5ca None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:49.317481 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e85d41-2d08-487e-bcc0-490d8a12c5ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:49.318919 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e85d41-2d08-487e-bcc0-490d8a12c5ca None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:49.328764 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 490/993] 10.222.0.40 () {56 vars in 1122 bytes} [Mon Jul 11 20:48:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:49.329991 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2cb4c6-5ea8-4958-be67-74831e7e3816 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:49.381954 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:49.433406 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2cb4c6-5ea8-4958-be67-74831e7e3816 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:49.466169 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd775f-7a77-444d-b3de-d3fac0e1eea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:49.466841 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd775f-7a77-444d-b3de-d3fac0e1eea5 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:49.467130 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd775f-7a77-444d-b3de-d3fac0e1eea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:49.467404 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd775f-7a77-444d-b3de-d3fac0e1eea5 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:49.468130 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd775f-7a77-444d-b3de-d3fac0e1eea5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:49.468440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd775f-7a77-444d-b3de-d3fac0e1eea5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:49.469803 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd775f-7a77-444d-b3de-d3fac0e1eea5 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:49.474810 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 504/994] 10.222.0.40 () {56 vars in 1122 bytes} [Mon Jul 11 20:48:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:49.481393 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e85d41-2d08-487e-bcc0-490d8a12c5ca None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:49.545623 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:49.579698 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e85d41-2d08-487e-bcc0-490d8a12c5ca None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:49.614089 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72982e82-568f-417f-91ef-44ba3ecaf734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:49.614755 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72982e82-568f-417f-91ef-44ba3ecaf734 None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:49.615039 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72982e82-568f-417f-91ef-44ba3ecaf734 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:49.615315 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72982e82-568f-417f-91ef-44ba3ecaf734 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:49.616095 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72982e82-568f-417f-91ef-44ba3ecaf734 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:49.617993 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72982e82-568f-417f-91ef-44ba3ecaf734 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:49.657327 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f5ea8-40ab-41aa-b0ca-afde772e2f5a None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:49.657648 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f5ea8-40ab-41aa-b0ca-afde772e2f5a None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:49.657991 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f5ea8-40ab-41aa-b0ca-afde772e2f5a None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:49.659381 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 505/995] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:49.665020 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ddb38-ef5f-4e70-b37f-afffc77953e5 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:49.665445 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ddb38-ef5f-4e70-b37f-afffc77953e5 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:49.666044 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ddb38-ef5f-4e70-b37f-afffc77953e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:49.678631 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 491/996] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 11 20:48:49 2022] POST /identity/v3/endpoints => generated 325 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:48:49.690052 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-703ddb38-ef5f-4e70-b37f-afffc77953e5 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:49.691188 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-703ddb38-ef5f-4e70-b37f-afffc77953e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:49.776271 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 506/997] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:49 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:48:49.799458 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72982e82-568f-417f-91ef-44ba3ecaf734 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:49.908383 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72982e82-568f-417f-91ef-44ba3ecaf734 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:49.935163 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:49.943817 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077e806-8c63-4ebd-bec6-edf6e851c0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:49.944658 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077e806-8c63-4ebd-bec6-edf6e851c0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:49.944950 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077e806-8c63-4ebd-bec6-edf6e851c0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:49.945294 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077e806-8c63-4ebd-bec6-edf6e851c0f3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:49.945959 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2077e806-8c63-4ebd-bec6-edf6e851c0f3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:49.947410 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2077e806-8c63-4ebd-bec6-edf6e851c0f3 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:49.959285 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-2077e806-8c63-4ebd-bec6-edf6e851c0f3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 20:48:49.959285 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:49.959285 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:48:49.959285 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:48:49.959285 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:48:49.959285 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:48:49.959285 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:48:49.959285 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:49.959285 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 20:48:49.959285 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:49.959285 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:48:49.959285 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:49.959285 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:49.959285 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:49.959285 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:49.959285 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:49.959285 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:49.960570 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:49.960570 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:49.960570 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:49.960570 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:49.960570 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:49.960570 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:49.960570 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:48:49.960570 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:48:49.960570 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:48:49.960570 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:48:49.960570 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:49.960570 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:49.960570 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:49.960570 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:49.960570 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:49.960570 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:49.962239 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:49.962239 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:49.962239 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:49.962239 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:49.962239 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:49.962239 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:49.962239 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:49.962239 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:49.962239 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:49.962239 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:49.962239 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:48:49.962239 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:49.962239 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 20:48:49.962239 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:49.962239 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 492/998] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:48:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:49.966968 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ddb38-ef5f-4e70-b37f-afffc77953e5 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:50.013139 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:50.045601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795836f4-72da-4aa8-a00a-2a9277f36af2 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:50.045922 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795836f4-72da-4aa8-a00a-2a9277f36af2 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:50.046183 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795836f4-72da-4aa8-a00a-2a9277f36af2 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:50.047561 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 493/999] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:48:50.052429 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fb1b6-b7a5-45b1-9f35-a952cd2f5e84 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:50.052723 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fb1b6-b7a5-45b1-9f35-a952cd2f5e84 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:50.053007 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fb1b6-b7a5-45b1-9f35-a952cd2f5e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:50.070023 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-fa4fb1b6-b7a5-45b1-9f35-a952cd2f5e84 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:50.071514 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-fa4fb1b6-b7a5-45b1-9f35-a952cd2f5e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:50.073701 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ddb38-ef5f-4e70-b37f-afffc77953e5 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:50.110602 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531b28b-5beb-4dbf-8b0a-2901742c661f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:50.111275 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531b28b-5beb-4dbf-8b0a-2901742c661f None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:50.111567 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531b28b-5beb-4dbf-8b0a-2901742c661f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:50.111850 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531b28b-5beb-4dbf-8b0a-2901742c661f None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:50.112741 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531b28b-5beb-4dbf-8b0a-2901742c661f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:50.113063 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531b28b-5beb-4dbf-8b0a-2901742c661f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:50.114439 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531b28b-5beb-4dbf-8b0a-2901742c661f None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:50.124012 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 507/1000] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Jul 11 20:48:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:50.126177 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531b28b-5beb-4dbf-8b0a-2901742c661f None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:50.145727 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 494/1001] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:50 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 20:48:50.167819 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4fb1b6-b7a5-45b1-9f35-a952cd2f5e84 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:50.232704 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531b28b-5beb-4dbf-8b0a-2901742c661f None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:50.235512 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:50.270019 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e054eb-57ed-4a15-b659-e80601541195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:50.270223 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4fb1b6-b7a5-45b1-9f35-a952cd2f5e84 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:50.270697 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e054eb-57ed-4a15-b659-e80601541195 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:50.270982 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e054eb-57ed-4a15-b659-e80601541195 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:50.271260 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e054eb-57ed-4a15-b659-e80601541195 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:50.271983 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e054eb-57ed-4a15-b659-e80601541195 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:50.272346 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e054eb-57ed-4a15-b659-e80601541195 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:50.274412 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e054eb-57ed-4a15-b659-e80601541195 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:50.279189 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 508/1002] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Jul 11 20:48:50 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:50.284788 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e054eb-57ed-4a15-b659-e80601541195 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:50.349919 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:50.366737 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf05181-6a57-4c34-98d1-918d7c71b8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:50.368524 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf05181-6a57-4c34-98d1-918d7c71b8c6 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:50.368818 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf05181-6a57-4c34-98d1-918d7c71b8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:50.369540 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf05181-6a57-4c34-98d1-918d7c71b8c6 None admin] PATH_INFO: `/v3/services/image` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:50.370216 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf05181-6a57-4c34-98d1-918d7c71b8c6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:50.371951 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf05181-6a57-4c34-98d1-918d7c71b8c6 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:50.388763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-7cf05181-6a57-4c34-98d1-918d7c71b8c6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 20:48:50.388763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:50.388763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:48:50.388763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:48:50.388763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:48:50.388763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:48:50.388763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:48:50.388763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:50.388763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 20:48:50.388763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:50.388763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:48:50.388763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:50.388763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:50.388763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:50.388763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:50.388763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:50.388763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:50.389800 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:50.389800 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:50.389800 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:50.389800 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:50.389800 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:50.389800 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:50.389800 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:48:50.389800 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:48:50.389800 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:48:50.389800 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:48:50.389800 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:50.389800 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:50.389800 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:50.389800 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:50.389800 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:50.389800 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:50.390714 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:50.390714 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:50.390714 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:50.390714 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:50.390714 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:50.390714 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:50.390714 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:50.390714 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:50.390714 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:50.390714 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:50.390714 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:48:50.390714 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:50.390714 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 20:48:50.390714 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:50.390714 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 495/1003] 10.222.0.40 () {56 vars in 1105 bytes} [Mon Jul 11 20:48:50 2022] GET /identity/v3/services/image => generated 86 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:48:50.396510 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf05181-6a57-4c34-98d1-918d7c71b8c6 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:50.437644 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e054eb-57ed-4a15-b659-e80601541195 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:50.472585 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437ede7-3bbc-4534-a71c-81ba1c2b35c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:50.473250 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437ede7-3bbc-4534-a71c-81ba1c2b35c3 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:50.473535 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437ede7-3bbc-4534-a71c-81ba1c2b35c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:50.473816 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437ede7-3bbc-4534-a71c-81ba1c2b35c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:50.474589 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1437ede7-3bbc-4534-a71c-81ba1c2b35c3 None admin] RBAC: Adding query filter params (interface=public, service_id=a75129a506644a70bdcd1b468d3f6d14, region_id=RegionOne) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:50.474901 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1437ede7-3bbc-4534-a71c-81ba1c2b35c3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:50.476298 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1437ede7-3bbc-4534-a71c-81ba1c2b35c3 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:50.482243 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 509/1004] 10.222.0.40 () {56 vars in 1251 bytes} [Mon Jul 11 20:48:50 2022] GET /identity/v3/endpoints?service_id=a75129a506644a70bdcd1b468d3f6d14&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:50.487533 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437ede7-3bbc-4534-a71c-81ba1c2b35c3 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:50.509512 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf05181-6a57-4c34-98d1-918d7c71b8c6 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:50.527816 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:50.544852 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b271f-eed6-476d-abcb-2b78352ee13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:50.545531 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b271f-eed6-476d-abcb-2b78352ee13a None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:50.545827 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b271f-eed6-476d-abcb-2b78352ee13a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:50.546101 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b271f-eed6-476d-abcb-2b78352ee13a None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:50.546808 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b271f-eed6-476d-abcb-2b78352ee13a None admin] RBAC: Adding query filter params (name=image) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:50.547122 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b271f-eed6-476d-abcb-2b78352ee13a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:50.548520 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b271f-eed6-476d-abcb-2b78352ee13a None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:50.553682 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 496/1005] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:50.559384 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b271f-eed6-476d-abcb-2b78352ee13a None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:50.603157 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437ede7-3bbc-4534-a71c-81ba1c2b35c3 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:50.611016 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:50.638851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777aeb79-3549-4f2f-aa2e-ec853c0f3cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:50.639525 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777aeb79-3549-4f2f-aa2e-ec853c0f3cba None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:50.639818 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777aeb79-3549-4f2f-aa2e-ec853c0f3cba None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:50.640135 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777aeb79-3549-4f2f-aa2e-ec853c0f3cba None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:50.640817 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777aeb79-3549-4f2f-aa2e-ec853c0f3cba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:50.642192 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777aeb79-3549-4f2f-aa2e-ec853c0f3cba None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:50.648987 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 510/1006] 10.222.0.40 () {56 vars in 1087 bytes} [Mon Jul 11 20:48:50 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 20:48:50.682555 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b271f-eed6-476d-abcb-2b78352ee13a None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:50.721594 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713515ed-3d21-4e67-81e1-66fda985c977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:50.722285 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713515ed-3d21-4e67-81e1-66fda985c977 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:50.722572 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713515ed-3d21-4e67-81e1-66fda985c977 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:50.722849 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713515ed-3d21-4e67-81e1-66fda985c977 None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:50.723572 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713515ed-3d21-4e67-81e1-66fda985c977 None admin] RBAC: Adding query filter params (type=image) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:50.723887 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713515ed-3d21-4e67-81e1-66fda985c977 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:50.725316 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713515ed-3d21-4e67-81e1-66fda985c977 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:50.740632 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 497/1007] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:50 2022] GET /identity/v3/services?type=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:51.753340 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf30f2-aa77-4d8c-a1a1-e132fca614b5 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:51.753845 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf30f2-aa77-4d8c-a1a1-e132fca614b5 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:51.753955 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf30f2-aa77-4d8c-a1a1-e132fca614b5 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:51.755331 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 511/1008] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:51.761230 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97153ce4-a700-48f1-8c70-a98e214648e0 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:51.761648 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97153ce4-a700-48f1-8c70-a98e214648e0 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:51.761826 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97153ce4-a700-48f1-8c70-a98e214648e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:51.778768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-97153ce4-a700-48f1-8c70-a98e214648e0 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:51.779950 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-97153ce4-a700-48f1-8c70-a98e214648e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:51.850296 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 498/1009] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:51 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:48:51.875549 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf30f2-aa77-4d8c-a1a1-e132fca614b5 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:51.970904 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:51.978550 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf30f2-aa77-4d8c-a1a1-e132fca614b5 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:52.012313 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335314d6-5a2f-4cf2-8971-4e3144620bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:52.013113 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335314d6-5a2f-4cf2-8971-4e3144620bef None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:52.013450 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335314d6-5a2f-4cf2-8971-4e3144620bef None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:52.013733 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335314d6-5a2f-4cf2-8971-4e3144620bef None admin] PATH_INFO: `/v3/domains/default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:52.014904 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335314d6-5a2f-4cf2-8971-4e3144620bef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:52.016511 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335314d6-5a2f-4cf2-8971-4e3144620bef None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:52.020058 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 512/1010] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:52.024468 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97153ce4-a700-48f1-8c70-a98e214648e0 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:52.066513 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:52.122883 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97153ce4-a700-48f1-8c70-a98e214648e0 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:52.156490 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9cc848-c346-4055-9113-4804156bd7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:52.157162 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9cc848-c346-4055-9113-4804156bd7d9 None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:52.157449 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9cc848-c346-4055-9113-4804156bd7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:52.157725 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9cc848-c346-4055-9113-4804156bd7d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:52.158433 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9cc848-c346-4055-9113-4804156bd7d9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:52.159855 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9cc848-c346-4055-9113-4804156bd7d9 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:52.248385 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 499/1011] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Jul 11 20:48:52 2022] POST /identity/v3/projects => generated 311 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:48:52.751672 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd664ddd-04d3-4caa-8e09-2dddd8476561 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:52.752015 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd664ddd-04d3-4caa-8e09-2dddd8476561 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:52.752268 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd664ddd-04d3-4caa-8e09-2dddd8476561 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:52.753687 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 513/1012] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:52.759550 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef512762-9074-48ad-b4ba-7b31b09b2ec7 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:52.759848 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef512762-9074-48ad-b4ba-7b31b09b2ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:52.760172 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef512762-9074-48ad-b4ba-7b31b09b2ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:52.777662 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-ef512762-9074-48ad-b4ba-7b31b09b2ec7 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:52.778863 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-ef512762-9074-48ad-b4ba-7b31b09b2ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:52.801001 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036a611-1242-4d92-b990-49996ac062a8 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:52.801298 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036a611-1242-4d92-b990-49996ac062a8 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:52.801562 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036a611-1242-4d92-b990-49996ac062a8 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:52.802963 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 514/1013] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:52.807985 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466c632-e3c0-48f4-a505-ea92600a3b51 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:52.808352 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466c632-e3c0-48f4-a505-ea92600a3b51 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:52.808641 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466c632-e3c0-48f4-a505-ea92600a3b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:52.826305 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-b466c632-e3c0-48f4-a505-ea92600a3b51 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:52.827485 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-b466c632-e3c0-48f4-a505-ea92600a3b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:52.861257 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 500/1014] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:52 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:48:52.886579 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef512762-9074-48ad-b4ba-7b31b09b2ec7 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:52.903783 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 515/1015] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:52 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 20:48:52.920655 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:52.926160 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466c632-e3c0-48f4-a505-ea92600a3b51 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:53.001851 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef512762-9074-48ad-b4ba-7b31b09b2ec7 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:53.028649 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:53.036158 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466c632-e3c0-48f4-a505-ea92600a3b51 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:53.046000 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da5f6a-077f-4c14-bc74-a154ed9c0358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:53.046816 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da5f6a-077f-4c14-bc74-a154ed9c0358 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:53.047103 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da5f6a-077f-4c14-bc74-a154ed9c0358 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:53.047387 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da5f6a-077f-4c14-bc74-a154ed9c0358 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:53.048082 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da5f6a-077f-4c14-bc74-a154ed9c0358 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:53.049456 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da5f6a-077f-4c14-bc74-a154ed9c0358 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:53.063556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-f1da5f6a-077f-4c14-bc74-a154ed9c0358 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 20:48:53.063556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:53.063556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:48:53.063556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:48:53.063556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:48:53.063556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:48:53.063556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:48:53.063556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:53.063556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 20:48:53.063556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:53.063556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:48:53.063556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:53.063556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:53.063556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:53.063556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:53.063556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:53.063556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:53.064803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:53.064803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:53.064803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:53.064803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:53.064803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:53.064803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:53.064803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:48:53.064803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:48:53.064803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:48:53.064803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:48:53.064803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:53.064803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:53.064803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:53.064803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:53.064803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:53.064803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:53.065846 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:53.065846 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:53.065846 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:53.065846 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:53.065846 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:53.065846 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:53.065846 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:53.065846 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:53.065846 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:53.065846 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:53.065846 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:48:53.065846 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:53.065846 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 20:48:53.065846 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:53.065846 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 501/1016] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:48:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:48:53.072422 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da5f6a-077f-4c14-bc74-a154ed9c0358 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:53.080473 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36903e0c-a62e-41c9-8803-28602af34d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:53.081444 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36903e0c-a62e-41c9-8803-28602af34d3a None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:53.081745 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36903e0c-a62e-41c9-8803-28602af34d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:53.082020 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36903e0c-a62e-41c9-8803-28602af34d3a None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:53.082729 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36903e0c-a62e-41c9-8803-28602af34d3a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:53.084127 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36903e0c-a62e-41c9-8803-28602af34d3a None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:53.174658 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 516/1017] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Jul 11 20:48:52 2022] POST /identity/v3/services => generated 242 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 20:48:53.203079 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:53.220686 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da5f6a-077f-4c14-bc74-a154ed9c0358 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:53.307674 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac2d75-e2c6-49cb-8d46-6d6016982df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:53.308395 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac2d75-e2c6-49cb-8d46-6d6016982df7 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:53.308683 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac2d75-e2c6-49cb-8d46-6d6016982df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:53.308961 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac2d75-e2c6-49cb-8d46-6d6016982df7 None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:53.309675 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac2d75-e2c6-49cb-8d46-6d6016982df7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:53.309984 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac2d75-e2c6-49cb-8d46-6d6016982df7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:53.311372 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac2d75-e2c6-49cb-8d46-6d6016982df7 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:53.322889 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 502/1018] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Jul 11 20:48:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:53.324016 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36903e0c-a62e-41c9-8803-28602af34d3a None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:53.435778 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36903e0c-a62e-41c9-8803-28602af34d3a None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:53.479316 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e752b0-c1d0-412f-b9b1-3cb5a764727c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:53.480037 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e752b0-c1d0-412f-b9b1-3cb5a764727c None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:53.480335 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e752b0-c1d0-412f-b9b1-3cb5a764727c None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:53.480619 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e752b0-c1d0-412f-b9b1-3cb5a764727c None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:53.481344 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e752b0-c1d0-412f-b9b1-3cb5a764727c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:53.481663 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e752b0-c1d0-412f-b9b1-3cb5a764727c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:53.483058 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e752b0-c1d0-412f-b9b1-3cb5a764727c None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:53.493723 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 517/1019] 10.222.0.40 () {56 vars in 1112 bytes} [Mon Jul 11 20:48:53 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:53.495235 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac2d75-e2c6-49cb-8d46-6d6016982df7 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:53.603863 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac2d75-e2c6-49cb-8d46-6d6016982df7 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:53.638845 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49554e52-09b3-462c-aeb2-0731fa3a8e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:53.639522 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49554e52-09b3-462c-aeb2-0731fa3a8e74 None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:53.639814 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49554e52-09b3-462c-aeb2-0731fa3a8e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:53.640132 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49554e52-09b3-462c-aeb2-0731fa3a8e74 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:53.640894 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49554e52-09b3-462c-aeb2-0731fa3a8e74 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:53.642495 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49554e52-09b3-462c-aeb2-0731fa3a8e74 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:53.724007 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 503/1020] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 11 20:48:53 2022] POST /identity/v3/endpoints => generated 334 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:48:54.410316 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae657c86-27ec-444e-b13d-afef25d74190 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:54.410839 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae657c86-27ec-444e-b13d-afef25d74190 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:54.410920 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae657c86-27ec-444e-b13d-afef25d74190 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:54.412436 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 518/1021] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:54.418905 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15952f-7c8b-49da-8ae9-61f160b6399a None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:54.419319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15952f-7c8b-49da-8ae9-61f160b6399a None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:54.419490 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15952f-7c8b-49da-8ae9-61f160b6399a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:54.425422 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:54.437054 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-2c15952f-7c8b-49da-8ae9-61f160b6399a None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:54.438234 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-2c15952f-7c8b-49da-8ae9-61f160b6399a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:54.516212 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 504/1022] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:48:54.542430 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae657c86-27ec-444e-b13d-afef25d74190 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:54.562409 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:54.665311 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae657c86-27ec-444e-b13d-afef25d74190 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:54.701006 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614ffe4-9b68-4033-97b5-f08cf085c629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:54.701803 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614ffe4-9b68-4033-97b5-f08cf085c629 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:54.702087 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614ffe4-9b68-4033-97b5-f08cf085c629 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:54.702363 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614ffe4-9b68-4033-97b5-f08cf085c629 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:54.703544 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614ffe4-9b68-4033-97b5-f08cf085c629 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:54.705008 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614ffe4-9b68-4033-97b5-f08cf085c629 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:54.711534 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 519/1023] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:54.712805 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15952f-7c8b-49da-8ae9-61f160b6399a None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:54.821172 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15952f-7c8b-49da-8ae9-61f160b6399a None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:54.851947 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:54.858591 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a90aea-cdbd-4765-866e-c50faead3fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:54.862563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a90aea-cdbd-4765-866e-c50faead3fa3 None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:54.862563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a90aea-cdbd-4765-866e-c50faead3fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:54.862563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a90aea-cdbd-4765-866e-c50faead3fa3 None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:54.862563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a90aea-cdbd-4765-866e-c50faead3fa3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:54.862563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a90aea-cdbd-4765-866e-c50faead3fa3 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:54.963310 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 505/1024] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jul 11 20:48:54 2022] POST /identity/v3/users => generated 285 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:48:55.287110 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac791a-6b8b-4fca-83c3-5bd4ba73b884 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:55.287456 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac791a-6b8b-4fca-83c3-5bd4ba73b884 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:55.287636 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac791a-6b8b-4fca-83c3-5bd4ba73b884 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:55.289177 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 520/1025] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:55.294374 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c16a3a-6d00-42c0-9c24-19f04ef6c3b8 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:55.294681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c16a3a-6d00-42c0-9c24-19f04ef6c3b8 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:55.294962 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c16a3a-6d00-42c0-9c24-19f04ef6c3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:55.312547 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-68c16a3a-6d00-42c0-9c24-19f04ef6c3b8 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:55.313736 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-68c16a3a-6d00-42c0-9c24-19f04ef6c3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:55.381882 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 506/1026] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:48:55.404794 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac791a-6b8b-4fca-83c3-5bd4ba73b884 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:55.492930 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:55.510489 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac791a-6b8b-4fca-83c3-5bd4ba73b884 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:55.546728 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a23ab-ef05-4abe-99d5-51761f48c15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:55.547452 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a23ab-ef05-4abe-99d5-51761f48c15f None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:55.547736 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a23ab-ef05-4abe-99d5-51761f48c15f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:55.548034 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a23ab-ef05-4abe-99d5-51761f48c15f None admin] PATH_INFO: `/v3/services/image` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:55.548691 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a23ab-ef05-4abe-99d5-51761f48c15f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:55.550056 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a23ab-ef05-4abe-99d5-51761f48c15f None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:55.562001 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-a23a23ab-ef05-4abe-99d5-51761f48c15f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 20:48:55.562001 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:55.562001 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:48:55.562001 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:48:55.562001 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:48:55.562001 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:48:55.562001 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:48:55.562001 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:55.562001 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 20:48:55.562001 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:55.562001 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:48:55.562001 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:55.562001 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:55.562001 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:55.562001 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:55.562001 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:55.562001 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:55.563004 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:55.563004 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:55.563004 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:55.563004 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:55.563004 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:55.563004 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:55.563004 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:48:55.563004 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:48:55.563004 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:48:55.563004 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:48:55.563004 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:55.563004 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:55.563004 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:55.563004 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:55.563004 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:55.563004 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:55.563860 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:55.563860 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:55.563860 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:55.563860 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:55.563860 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:55.563860 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:55.563860 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:55.563860 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:55.563860 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:55.563860 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:55.563860 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:48:55.563860 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:55.563860 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 20:48:55.563860 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:55.572003 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 521/1027] 10.222.0.40 () {56 vars in 1105 bytes} [Mon Jul 11 20:48:55 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:55.572184 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c16a3a-6d00-42c0-9c24-19f04ef6c3b8 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:55.690014 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c16a3a-6d00-42c0-9c24-19f04ef6c3b8 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:55.708737 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:55.730914 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3170f-e939-4a5a-83dc-a7b715568e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:55.732380 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3170f-e939-4a5a-83dc-a7b715568e18 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:55.733295 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3170f-e939-4a5a-83dc-a7b715568e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:55.733959 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d3170f-e939-4a5a-83dc-a7b715568e18 None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:55.735237 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d3170f-e939-4a5a-83dc-a7b715568e18 None admin] RBAC: Adding query filter params (name=image) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:55.735820 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d3170f-e939-4a5a-83dc-a7b715568e18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:55.737227 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d3170f-e939-4a5a-83dc-a7b715568e18 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:55.743091 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 507/1028] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:55.748609 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a23ab-ef05-4abe-99d5-51761f48c15f None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:55.858998 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a23ab-ef05-4abe-99d5-51761f48c15f None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:55.893526 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706343b-8f06-418c-90a5-4cdc032d093f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:55.894205 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706343b-8f06-418c-90a5-4cdc032d093f None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:55.894493 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706343b-8f06-418c-90a5-4cdc032d093f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:55.894776 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706343b-8f06-418c-90a5-4cdc032d093f None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:55.895484 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706343b-8f06-418c-90a5-4cdc032d093f None admin] RBAC: Adding query filter params (type=image) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:55.895798 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706343b-8f06-418c-90a5-4cdc032d093f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:55.897198 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706343b-8f06-418c-90a5-4cdc032d093f None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:55.906989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 522/1029] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:55 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:55.908331 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3170f-e939-4a5a-83dc-a7b715568e18 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:55.946597 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea9849-6710-4fec-8694-6aa13ab082ef None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:55.946906 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea9849-6710-4fec-8694-6aa13ab082ef None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:55.947173 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea9849-6710-4fec-8694-6aa13ab082ef None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:55.948785 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 523/1030] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:55.953339 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604540c-4ba1-4bb2-90cd-598669ab26be None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:55.953637 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604540c-4ba1-4bb2-90cd-598669ab26be None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:55.953922 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604540c-4ba1-4bb2-90cd-598669ab26be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:55.971896 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-9604540c-4ba1-4bb2-90cd-598669ab26be None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:55.973122 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-9604540c-4ba1-4bb2-90cd-598669ab26be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:55.982778 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:56.012802 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d3170f-e939-4a5a-83dc-a7b715568e18 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:56.043707 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 524/1031] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 20:48:56.051868 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864e45b-ff24-4b4f-9f97-c59d53b1905e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:56.052718 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864e45b-ff24-4b4f-9f97-c59d53b1905e None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:56.053154 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864e45b-ff24-4b4f-9f97-c59d53b1905e None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:56.053614 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864e45b-ff24-4b4f-9f97-c59d53b1905e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:56.055086 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b864e45b-ff24-4b4f-9f97-c59d53b1905e None admin] RBAC: Adding query filter params (interface=public, service_id=88088459526c49b2b75815c502ba955a, region_id=RegionOne) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:56.055654 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b864e45b-ff24-4b4f-9f97-c59d53b1905e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:56.057184 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b864e45b-ff24-4b4f-9f97-c59d53b1905e None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:56.066836 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 508/1032] 10.222.0.40 () {56 vars in 1251 bytes} [Mon Jul 11 20:48:55 2022] GET /identity/v3/endpoints?service_id=88088459526c49b2b75815c502ba955a&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:56.067994 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9604540c-4ba1-4bb2-90cd-598669ab26be None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:56.070899 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864e45b-ff24-4b4f-9f97-c59d53b1905e None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:56.123271 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:56.183702 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9604540c-4ba1-4bb2-90cd-598669ab26be None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:56.184366 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864e45b-ff24-4b4f-9f97-c59d53b1905e None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:56.220540 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb44f41-e2b4-420b-930c-d50edd273c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:56.221037 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42377428-c6ec-4978-8998-89d631e89f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:56.221242 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb44f41-e2b4-420b-930c-d50edd273c3f None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:56.221507 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb44f41-e2b4-420b-930c-d50edd273c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:56.221817 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb44f41-e2b4-420b-930c-d50edd273c3f None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:56.221926 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42377428-c6ec-4978-8998-89d631e89f01 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:56.222178 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42377428-c6ec-4978-8998-89d631e89f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:56.222449 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42377428-c6ec-4978-8998-89d631e89f01 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:56.222573 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb44f41-e2b4-420b-930c-d50edd273c3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:56.223879 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb44f41-e2b4-420b-930c-d50edd273c3f None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:56.239998 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 525/1033] 10.222.0.40 () {56 vars in 1087 bytes} [Mon Jul 11 20:48:56 2022] GET /identity/v3/services => generated 1957 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 20:48:56.240247 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42377428-c6ec-4978-8998-89d631e89f01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:48:56.241653 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-42377428-c6ec-4978-8998-89d631e89f01 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 20:48:56.241653 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:56.241653 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:56.241653 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:56.241653 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:56.241653 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:56.241653 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:56.241653 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:56.241653 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:56.241653 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:56.241653 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:56.241653 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:56.241653 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:48:56.241653 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:48:56.241653 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:48:56.241653 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:48:56.243804 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:48:56.243804 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:48:56.243804 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:48:56.243804 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:48:56.243804 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:56.243804 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:56.243804 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:56.243804 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:56.243804 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:56.243804 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:56.243804 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:56.243804 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:56.243804 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:56.243804 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:56.243804 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:56.243804 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:56.244746 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:56.244746 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:56.244746 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:56.244746 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:56.244746 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:48:56.244746 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:48:56.244746 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:48:56.244746 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:48:56.244746 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:48:56.244746 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:48:56.244746 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 20:48:56.244746 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:56.244746 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 509/1034] 10.222.0.40 () {56 vars in 1120 bytes} [Mon Jul 11 20:48:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:48:56.252024 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb44f41-e2b4-420b-930c-d50edd273c3f None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:56.262510 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:56.359067 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb44f41-e2b4-420b-930c-d50edd273c3f None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:56.400626 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2a161-39b2-4b90-b20e-dfa1a60a8bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:56.401600 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2a161-39b2-4b90-b20e-dfa1a60a8bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:56.402067 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2a161-39b2-4b90-b20e-dfa1a60a8bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:56.402543 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2a161-39b2-4b90-b20e-dfa1a60a8bc2 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:56.403472 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad2a161-39b2-4b90-b20e-dfa1a60a8bc2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:56.403993 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad2a161-39b2-4b90-b20e-dfa1a60a8bc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:56.405685 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad2a161-39b2-4b90-b20e-dfa1a60a8bc2 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:56.414683 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 526/1035] 10.222.0.40 () {56 vars in 1115 bytes} [Mon Jul 11 20:48:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:56.420360 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42377428-c6ec-4978-8998-89d631e89f01 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:56.522343 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42377428-c6ec-4978-8998-89d631e89f01 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:56.525545 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:56.561354 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950eb14-d623-4767-ab7f-27d0eefd719f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:56.562154 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950eb14-d623-4767-ab7f-27d0eefd719f None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:56.562440 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950eb14-d623-4767-ab7f-27d0eefd719f None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:56.562715 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950eb14-d623-4767-ab7f-27d0eefd719f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:56.574139 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c950eb14-d623-4767-ab7f-27d0eefd719f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:56.575573 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c950eb14-d623-4767-ab7f-27d0eefd719f None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:56.592900 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-c950eb14-d623-4767-ab7f-27d0eefd719f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:56.592900 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:56.592900 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:56.592900 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:56.592900 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:56.592900 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:56.592900 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:56.592900 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:56.592900 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:56.592900 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:56.592900 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:56.592900 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:56.592900 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:56.592900 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:56.592900 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:56.593841 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:56.593841 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:56.593841 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:56.593841 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:56.593841 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:56.593841 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:56.593841 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:56.593841 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:56.593841 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:56.593841 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:56.593841 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:56.593841 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:56.593841 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:56.593841 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:56.593841 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:56.593841 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:56.593841 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:56.594857 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:56.594857 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:56.594857 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:56.594857 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:56.598760 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 510/1036] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:56.600201 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2a161-39b2-4b90-b20e-dfa1a60a8bc2 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:56.677416 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:56.712576 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2a161-39b2-4b90-b20e-dfa1a60a8bc2 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:56.763255 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfccde28-8f19-4d13-802e-c4e7484a133b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:56.763937 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccde28-8f19-4d13-802e-c4e7484a133b None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:56.764259 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccde28-8f19-4d13-802e-c4e7484a133b None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:56.764543 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccde28-8f19-4d13-802e-c4e7484a133b None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:56.765273 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfccde28-8f19-4d13-802e-c4e7484a133b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:56.765592 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfccde28-8f19-4d13-802e-c4e7484a133b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:56.766969 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfccde28-8f19-4d13-802e-c4e7484a133b None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:56.784053 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 527/1037] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:56.785643 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950eb14-d623-4767-ab7f-27d0eefd719f None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:56.888502 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950eb14-d623-4767-ab7f-27d0eefd719f None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:56.922083 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7e620-f24a-4b48-98cf-d722d1ed32a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:56.922801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7e620-f24a-4b48-98cf-d722d1ed32a0 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:56.923085 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7e620-f24a-4b48-98cf-d722d1ed32a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:56.923363 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7e620-f24a-4b48-98cf-d722d1ed32a0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:56.931475 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf7e620-f24a-4b48-98cf-d722d1ed32a0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:56.932926 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf7e620-f24a-4b48-98cf-d722d1ed32a0 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:56.948131 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-eaf7e620-f24a-4b48-98cf-d722d1ed32a0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 20:48:56.948131 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:56.948131 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:56.948131 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:56.948131 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:56.948131 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:56.948131 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:56.948131 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:56.948131 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:56.948131 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:56.948131 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:56.948131 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:56.948131 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:48:56.948131 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:48:56.948131 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:48:56.948131 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:48:56.949118 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:56.949118 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:56.949118 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:48:56.949118 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:56.949118 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:48:56.949118 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:48:56.949118 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:56.949118 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:56.949118 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:56.949118 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:56.949118 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:56.949118 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:56.949118 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:56.949118 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:56.949118 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:56.949118 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:56.949118 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:56.949118 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:56.950072 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:56.950072 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:56.950072 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:48:56.950072 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:48:56.950072 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:48:56.950072 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:48:56.950072 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:48:56.950072 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:48:56.950072 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 20:48:56.950072 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:56.952058 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 511/1038] 10.222.0.40 () {56 vars in 1093 bytes} [Mon Jul 11 20:48:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:48:56.955429 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfccde28-8f19-4d13-802e-c4e7484a133b None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:57.062480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfccde28-8f19-4d13-802e-c4e7484a133b None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:57.091498 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:57.097731 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134261c4-db1e-460f-803e-1a2616915d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:57.098411 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134261c4-db1e-460f-803e-1a2616915d3c None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:57.098699 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134261c4-db1e-460f-803e-1a2616915d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:57.098976 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134261c4-db1e-460f-803e-1a2616915d3c None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:57.099812 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134261c4-db1e-460f-803e-1a2616915d3c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:57.100158 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134261c4-db1e-460f-803e-1a2616915d3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:57.102102 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134261c4-db1e-460f-803e-1a2616915d3c None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:57.119679 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 528/1039] 10.222.0.40 () {56 vars in 1133 bytes} [Mon Jul 11 20:48:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:57.125432 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7e620-f24a-4b48-98cf-d722d1ed32a0 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:57.131668 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b3759-849b-4634-8bb0-1ac258cc6da8 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:57.131960 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b3759-849b-4634-8bb0-1ac258cc6da8 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:57.132259 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b3759-849b-4634-8bb0-1ac258cc6da8 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:57.134006 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 529/1040] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:48:57.138895 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab186867-f34c-465f-bff4-2ed9915d041b None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:57.139185 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab186867-f34c-465f-bff4-2ed9915d041b None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:57.139466 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab186867-f34c-465f-bff4-2ed9915d041b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:57.145059 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:57.156178 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-ab186867-f34c-465f-bff4-2ed9915d041b None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:57.157364 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-ab186867-f34c-465f-bff4-2ed9915d041b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:57.233958 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 530/1041] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 20:48:57.240184 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7e620-f24a-4b48-98cf-d722d1ed32a0 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:57.258259 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab186867-f34c-465f-bff4-2ed9915d041b None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:57.275255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c7959e-3f01-4aa0-a38a-0c6c3a1e05bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:57.283417 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7959e-3f01-4aa0-a38a-0c6c3a1e05bd None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:57.283417 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7959e-3f01-4aa0-a38a-0c6c3a1e05bd None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:57.283417 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7959e-3f01-4aa0-a38a-0c6c3a1e05bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:57.350259 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c7959e-3f01-4aa0-a38a-0c6c3a1e05bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:57.352233 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c7959e-3f01-4aa0-a38a-0c6c3a1e05bd None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:57.371297 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:57.375816 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab186867-f34c-465f-bff4-2ed9915d041b None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:57.394680 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:57.413433 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7c30f-db25-4c7e-b7f0-910a48989f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:57.414745 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7c30f-db25-4c7e-b7f0-910a48989f8f None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:57.415171 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7c30f-db25-4c7e-b7f0-910a48989f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:57.415452 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7c30f-db25-4c7e-b7f0-910a48989f8f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:57.425938 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e7c30f-db25-4c7e-b7f0-910a48989f8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:48:57.434037 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-f0e7c30f-db25-4c7e-b7f0-910a48989f8f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:48:57.434037 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:57.434037 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:57.434037 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:57.434037 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:57.434037 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:57.434037 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:57.434037 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:57.434037 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:57.434037 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:57.434037 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:57.434037 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:57.434037 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:48:57.434037 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:48:57.434037 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:48:57.434037 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:48:57.435013 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:48:57.435013 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:48:57.435013 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:48:57.435013 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:48:57.435013 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:57.435013 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:57.435013 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:57.435013 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:57.435013 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:57.435013 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:57.435013 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:57.435013 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:57.435013 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:57.435013 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:57.435013 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:57.435013 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:57.435866 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:57.435866 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:57.435866 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:57.435866 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:57.435866 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:48:57.435866 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:48:57.435866 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:48:57.435866 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:48:57.435866 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:48:57.435866 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:48:57.435866 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:48:57.435866 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:48:57.435866 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 531/1042] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 11 20:48:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:48:57.441103 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7c30f-db25-4c7e-b7f0-910a48989f8f None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:57.465464 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 512/1043] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:48:57 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 20:48:57.470911 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c7959e-3f01-4aa0-a38a-0c6c3a1e05bd None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:57.564022 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7c30f-db25-4c7e-b7f0-910a48989f8f None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:57.574970 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c7959e-3f01-4aa0-a38a-0c6c3a1e05bd None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:57.593727 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:57.598870 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065970d-bcc9-4757-bd5c-a31350c035c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:57.599544 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065970d-bcc9-4757-bd5c-a31350c035c3 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:57.604063 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065970d-bcc9-4757-bd5c-a31350c035c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:57.604063 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065970d-bcc9-4757-bd5c-a31350c035c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:57.604063 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2065970d-bcc9-4757-bd5c-a31350c035c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:57.604063 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2065970d-bcc9-4757-bd5c-a31350c035c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:57.604063 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2065970d-bcc9-4757-bd5c-a31350c035c3 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:57.611358 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 532/1044] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:48:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:57.613028 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7e1fc-f58c-45b4-a7f4-a044daaf3351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:57.613835 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7e1fc-f58c-45b4-a7f4-a044daaf3351 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:57.614120 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7e1fc-f58c-45b4-a7f4-a044daaf3351 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:57.614399 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7e1fc-f58c-45b4-a7f4-a044daaf3351 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:57.617553 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065970d-bcc9-4757-bd5c-a31350c035c3 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:57.627198 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc7e1fc-f58c-45b4-a7f4-a044daaf3351 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:57.629056 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc7e1fc-f58c-45b4-a7f4-a044daaf3351 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:57.648011 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-cfc7e1fc-f58c-45b4-a7f4-a044daaf3351 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:57.648011 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:57.648011 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:57.648011 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:57.648011 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:57.648011 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:57.648011 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:57.648011 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:57.648011 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:57.648011 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:57.648011 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:57.648011 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:57.648011 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:48:57.648011 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:48:57.648011 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:48:57.649026 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:48:57.649026 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:57.649026 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:57.649026 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:57.649026 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:57.649026 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:57.649026 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:57.649026 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:57.649026 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:57.649026 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:57.649026 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:57.649026 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:57.649026 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:57.649026 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:57.649026 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:57.649026 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:57.649026 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:57.649941 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:48:57.649941 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:48:57.649941 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:48:57.649941 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:57.652143 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 513/1045] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:48:57.657842 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7e1fc-f58c-45b4-a7f4-a044daaf3351 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:57.676300 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:57.740162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065970d-bcc9-4757-bd5c-a31350c035c3 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:57.761031 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7e1fc-f58c-45b4-a7f4-a044daaf3351 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:57.777625 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3218a9-cba6-4950-ac68-5e70c19f55d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:57.778518 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3218a9-cba6-4950-ac68-5e70c19f55d2 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:57.778812 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3218a9-cba6-4950-ac68-5e70c19f55d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:57.779089 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3218a9-cba6-4950-ac68-5e70c19f55d2 None admin] PATH_INFO: `/v3/users/dba92036343d4ba7836b20f89f18d046` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:57.792896 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3218a9-cba6-4950-ac68-5e70c19f55d2 None admin] RBAC: Authorizing `identity:get_user(user_id=dba92036343d4ba7836b20f89f18d046)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:57.794347 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3218a9-cba6-4950-ac68-5e70c19f55d2 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:57.800731 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 533/1046] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:48:57 2022] GET /identity/v3/users/dba92036343d4ba7836b20f89f18d046 => generated 285 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:57.801390 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dda6b9-b507-4748-9de9-b36aa540e978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:57.801529 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3218a9-cba6-4950-ac68-5e70c19f55d2 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:57.802071 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dda6b9-b507-4748-9de9-b36aa540e978 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:57.802362 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dda6b9-b507-4748-9de9-b36aa540e978 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:57.802648 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dda6b9-b507-4748-9de9-b36aa540e978 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:57.803379 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dda6b9-b507-4748-9de9-b36aa540e978 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:57.803692 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dda6b9-b507-4748-9de9-b36aa540e978 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:57.805623 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dda6b9-b507-4748-9de9-b36aa540e978 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:57.818236 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 514/1047] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:48:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:57.823495 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dda6b9-b507-4748-9de9-b36aa540e978 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:57.852744 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:57.910013 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:57.914942 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3218a9-cba6-4950-ac68-5e70c19f55d2 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:57.927160 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dda6b9-b507-4748-9de9-b36aa540e978 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:57.952941 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572962c2-d9f6-4b3a-b0ed-1d543229b18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:57.953910 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572962c2-d9f6-4b3a-b0ed-1d543229b18d None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:57.954356 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572962c2-d9f6-4b3a-b0ed-1d543229b18d None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:57.954791 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572962c2-d9f6-4b3a-b0ed-1d543229b18d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:57.960987 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636da14d-f36d-48a0-89cd-b1cb1177910b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:57.961930 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636da14d-f36d-48a0-89cd-b1cb1177910b None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:57.962220 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636da14d-f36d-48a0-89cd-b1cb1177910b None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:57.962502 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636da14d-f36d-48a0-89cd-b1cb1177910b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:57.969467 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636da14d-f36d-48a0-89cd-b1cb1177910b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:57.970909 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636da14d-f36d-48a0-89cd-b1cb1177910b None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:57.985710 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-636da14d-f36d-48a0-89cd-b1cb1177910b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:57.985710 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:57.985710 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:57.985710 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:57.985710 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:57.985710 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:57.985710 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:57.985710 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:57.985710 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:57.985710 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:57.985710 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:57.985710 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:57.985710 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:48:57.985710 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:48:57.985710 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:48:57.986838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:48:57.986838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:57.986838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:57.986838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:57.986838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:57.986838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:57.986838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:57.986838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:57.986838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:57.986838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:57.986838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:57.986838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:57.986838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:57.986838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:57.986838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:57.986838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:57.986838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:57.987771 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:48:57.987771 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:48:57.987771 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:48:57.987771 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:48:57.987771 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:48:57.987771 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:48:57.987771 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:48:57.987771 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:57.987771 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 515/1048] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:48:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:48:57.992614 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636da14d-f36d-48a0-89cd-b1cb1177910b None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:58.039384 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572962c2-d9f6-4b3a-b0ed-1d543229b18d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:58.040871 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572962c2-d9f6-4b3a-b0ed-1d543229b18d None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:58.084918 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:58.098548 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636da14d-f36d-48a0-89cd-b1cb1177910b None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:58.139562 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177260e2-c160-4a3f-9a7e-f30afa13364e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:58.140280 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177260e2-c160-4a3f-9a7e-f30afa13364e None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:58.140569 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177260e2-c160-4a3f-9a7e-f30afa13364e None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:58.140852 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177260e2-c160-4a3f-9a7e-f30afa13364e None admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:58.141648 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177260e2-c160-4a3f-9a7e-f30afa13364e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:58.141967 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177260e2-c160-4a3f-9a7e-f30afa13364e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:58.143410 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177260e2-c160-4a3f-9a7e-f30afa13364e None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:58.144465 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:58.156657 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 534/1049] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:48:57 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 20:48:58.156841 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 516/1050] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 11 20:48:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:58.158280 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572962c2-d9f6-4b3a-b0ed-1d543229b18d None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:58.161764 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177260e2-c160-4a3f-9a7e-f30afa13364e None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:58.262700 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572962c2-d9f6-4b3a-b0ed-1d543229b18d None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:58.266991 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177260e2-c160-4a3f-9a7e-f30afa13364e None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:58.299302 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142cf58-bd8a-4576-b51f-52c62d983f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:58.300207 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142cf58-bd8a-4576-b51f-52c62d983f09 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:58.300500 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142cf58-bd8a-4576-b51f-52c62d983f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:58.300784 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142cf58-bd8a-4576-b51f-52c62d983f09 None admin] PATH_INFO: `/v3/projects/011d2f62fb8f4bf5929502923e4b4155` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:58.301955 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6142cf58-bd8a-4576-b51f-52c62d983f09 None admin] RBAC: Authorizing `identity:get_project(project_id=011d2f62fb8f4bf5929502923e4b4155)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:58.302921 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e277e02-5178-489b-9cee-d52078f9188c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:58.303407 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6142cf58-bd8a-4576-b51f-52c62d983f09 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:58.303582 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e277e02-5178-489b-9cee-d52078f9188c None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:58.303872 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e277e02-5178-489b-9cee-d52078f9188c None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:58.304177 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e277e02-5178-489b-9cee-d52078f9188c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:58.305540 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e277e02-5178-489b-9cee-d52078f9188c None admin] RBAC: Adding query filter params (role.id=1400a904c27a413fa8b7c591773b08cf, scope.project.id=eca3ef2561fa435e80ff451aeab14f3b, user.id=8ac15411c75f4bd4a86f6753c9240a5b) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:58.305759 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 535/1051] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:48:58 2022] GET /identity/v3/projects/011d2f62fb8f4bf5929502923e4b4155 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:58.305848 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e277e02-5178-489b-9cee-d52078f9188c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:58.306939 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa55638-bef0-4250-91b8-ef621a77ec8a None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:58.307233 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa55638-bef0-4250-91b8-ef621a77ec8a None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:58.307329 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e277e02-5178-489b-9cee-d52078f9188c None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:58.307516 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa55638-bef0-4250-91b8-ef621a77ec8a None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:58.308937 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 536/1052] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:48:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:48:58.311351 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa55638-bef0-4250-91b8-ef621a77ec8a None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:58.315029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 517/1053] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:48:58 2022] GET /identity/v3/role_assignments?user.id=8ac15411c75f4bd4a86f6753c9240a5b&scope.project.id=eca3ef2561fa435e80ff451aeab14f3b&role.id=1400a904c27a413fa8b7c591773b08cf => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:58.316354 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d8f57-33d9-45f8-9a75-a80be3a36733 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:58.316653 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d8f57-33d9-45f8-9a75-a80be3a36733 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:58.316938 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d8f57-33d9-45f8-9a75-a80be3a36733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:58.336792 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-d23d8f57-33d9-45f8-9a75-a80be3a36733 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:48:58.338295 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d23d8f57-33d9-45f8-9a75-a80be3a36733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:48:58.346716 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:58.396208 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:58.414047 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 518/1054] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:48:58 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:48:58.438246 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d8f57-33d9-45f8-9a75-a80be3a36733 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:58.441206 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa55638-bef0-4250-91b8-ef621a77ec8a None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:58.485331 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c50a5-8241-4805-8ee5-2f905d8fe7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:58.486007 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c50a5-8241-4805-8ee5-2f905d8fe7bd None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:58.486297 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c50a5-8241-4805-8ee5-2f905d8fe7bd None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:58.486579 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c50a5-8241-4805-8ee5-2f905d8fe7bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:58.487413 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c50a5-8241-4805-8ee5-2f905d8fe7bd None admin] RBAC: Adding query filter params (role.id=86273ff072f3438d822e870272491768, scope.project.id=011d2f62fb8f4bf5929502923e4b4155, user.id=dba92036343d4ba7836b20f89f18d046) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:58.487732 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c50a5-8241-4805-8ee5-2f905d8fe7bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:58.489226 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c50a5-8241-4805-8ee5-2f905d8fe7bd None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:58.504043 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 537/1055] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:48:58 2022] GET /identity/v3/role_assignments?user.id=dba92036343d4ba7836b20f89f18d046&scope.project.id=011d2f62fb8f4bf5929502923e4b4155&role.id=86273ff072f3438d822e870272491768 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:58.556732 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d8f57-33d9-45f8-9a75-a80be3a36733 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:58.593894 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ae6d7-1c79-4d68-95d3-5ccef21b148a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:58.594612 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ae6d7-1c79-4d68-95d3-5ccef21b148a None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:58.594902 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ae6d7-1c79-4d68-95d3-5ccef21b148a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:58.595175 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ae6d7-1c79-4d68-95d3-5ccef21b148a None admin] PATH_INFO: `/v3/services/image` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:58.595831 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ae6d7-1c79-4d68-95d3-5ccef21b148a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:58.597247 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ae6d7-1c79-4d68-95d3-5ccef21b148a None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:58.610221 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-911ae6d7-1c79-4d68-95d3-5ccef21b148a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 20:48:58.610221 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:58.610221 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:48:58.610221 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:48:58.610221 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:48:58.610221 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:48:58.610221 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:48:58.610221 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:58.610221 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 20:48:58.610221 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:58.610221 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:48:58.610221 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:58.610221 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:48:58.610221 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:48:58.610221 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:48:58.610221 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:48:58.610221 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:48:58.611311 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:48:58.611311 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:48:58.611311 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:48:58.611311 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:48:58.611311 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:48:58.611311 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:48:58.611311 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:48:58.611311 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:48:58.611311 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:48:58.611311 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:48:58.611311 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:48:58.611311 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:48:58.611311 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:48:58.611311 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:48:58.611311 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:48:58.611311 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:48:58.612190 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:48:58.612190 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:48:58.612190 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:48:58.612190 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:48:58.612190 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:48:58.612190 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:48:58.612190 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:48:58.612190 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:48:58.612190 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:48:58.612190 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:48:58.612190 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:48:58.612190 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:48:58.612190 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 20:48:58.612190 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:48:58.612190 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 519/1056] 10.222.0.40 () {56 vars in 1105 bytes} [Mon Jul 11 20:48:58 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:48:58.618341 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c50a5-8241-4805-8ee5-2f905d8fe7bd None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:58.727253 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c50a5-8241-4805-8ee5-2f905d8fe7bd None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:58.756486 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:58.762693 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6131fd-10b5-4721-8a11-3b3b24647248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:58.763366 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6131fd-10b5-4721-8a11-3b3b24647248 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:58.763650 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6131fd-10b5-4721-8a11-3b3b24647248 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:58.763927 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6131fd-10b5-4721-8a11-3b3b24647248 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:58.764677 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6131fd-10b5-4721-8a11-3b3b24647248 None admin] RBAC: Adding query filter params (name=image) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:58.764988 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6131fd-10b5-4721-8a11-3b3b24647248 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:58.766362 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6131fd-10b5-4721-8a11-3b3b24647248 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:58.775398 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 538/1057] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:48:58.777995 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ae6d7-1c79-4d68-95d3-5ccef21b148a None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:58.787371 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:48:58.882408 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ae6d7-1c79-4d68-95d3-5ccef21b148a None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:58.917040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112e6c0-4e25-4b55-9893-425e74aabe44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:58.917711 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112e6c0-4e25-4b55-9893-425e74aabe44 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:58.917996 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112e6c0-4e25-4b55-9893-425e74aabe44 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:58.918274 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112e6c0-4e25-4b55-9893-425e74aabe44 None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:58.918978 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0112e6c0-4e25-4b55-9893-425e74aabe44 None admin] RBAC: Adding query filter params (type=image) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:48:58.919290 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0112e6c0-4e25-4b55-9893-425e74aabe44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:58.920677 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0112e6c0-4e25-4b55-9893-425e74aabe44 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:58.926025 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 520/1058] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:48:58 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:48:58.932059 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6131fd-10b5-4721-8a11-3b3b24647248 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:48:59.034277 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6131fd-10b5-4721-8a11-3b3b24647248 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:48:59.067074 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54235257-b734-4a1f-bdf4-6e771581b8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:48:59.067740 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54235257-b734-4a1f-bdf4-6e771581b8d2 None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:48:59.068052 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54235257-b734-4a1f-bdf4-6e771581b8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:48:59.068326 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54235257-b734-4a1f-bdf4-6e771581b8d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:48:59.069072 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54235257-b734-4a1f-bdf4-6e771581b8d2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:48:59.070634 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54235257-b734-4a1f-bdf4-6e771581b8d2 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:48:59.144086 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 539/1059] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 11 20:48:58 2022] POST /identity/v3/endpoints => generated 327 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 20:49:00.352339 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e4301-1e3d-4196-9407-6713fd8f41c7 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:00.352891 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e4301-1e3d-4196-9407-6713fd8f41c7 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:00.352891 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e4301-1e3d-4196-9407-6713fd8f41c7 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:00.354408 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 521/1060] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:49:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:49:00.359450 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e408809-f699-4114-95da-2f0488be102b None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:00.359842 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e408809-f699-4114-95da-2f0488be102b None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:00.360066 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e408809-f699-4114-95da-2f0488be102b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:00.377022 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-0e408809-f699-4114-95da-2f0488be102b None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:49:00.378207 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-0e408809-f699-4114-95da-2f0488be102b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:49:00.425725 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:00.453247 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 540/1061] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:49:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:49:00.478663 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e4301-1e3d-4196-9407-6713fd8f41c7 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:00.549179 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:00.554018 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8fd87-f1ea-4e8f-b0e9-454e868e0e92 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:00.554365 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8fd87-f1ea-4e8f-b0e9-454e868e0e92 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:00.554847 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8fd87-f1ea-4e8f-b0e9-454e868e0e92 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:00.556301 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 541/1062] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:49:00.561306 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9394bfb-1c06-48d1-a1eb-00e908902425 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:00.563398 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9394bfb-1c06-48d1-a1eb-00e908902425 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:00.563398 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9394bfb-1c06-48d1-a1eb-00e908902425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:00.580097 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-d9394bfb-1c06-48d1-a1eb-00e908902425 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:49:00.581282 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-d9394bfb-1c06-48d1-a1eb-00e908902425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:49:00.582129 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e4301-1e3d-4196-9407-6713fd8f41c7 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:00.620219 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02e839-4bd3-4890-ae71-dd08247bf0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:00.620968 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02e839-4bd3-4890-ae71-dd08247bf0de None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:00.621312 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02e839-4bd3-4890-ae71-dd08247bf0de None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:00.621606 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02e839-4bd3-4890-ae71-dd08247bf0de None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:00.633870 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd02e839-4bd3-4890-ae71-dd08247bf0de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:49:00.642019 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-dd02e839-4bd3-4890-ae71-dd08247bf0de None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 20:49:00.642019 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:49:00.642019 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:49:00.642019 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:49:00.642019 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:49:00.642019 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:49:00.642019 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:49:00.642019 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:49:00.642019 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:49:00.642019 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:49:00.642019 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:49:00.642019 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:49:00.642019 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:49:00.642019 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:49:00.642019 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:49:00.642019 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:49:00.642970 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:49:00.642970 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:49:00.642970 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:49:00.642970 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:49:00.642970 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:49:00.642970 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:49:00.642970 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:49:00.642970 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:49:00.642970 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:49:00.642970 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:49:00.642970 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:49:00.642970 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:49:00.642970 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:49:00.642970 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:49:00.642970 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:49:00.642970 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:49:00.643851 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:49:00.643851 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:49:00.643851 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:49:00.643851 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:49:00.643851 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:49:00.643851 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:49:00.643851 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:49:00.643851 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:49:00.643851 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:49:00.643851 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:49:00.643851 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 20:49:00.643851 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:49:00.643851 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 522/1063] 10.222.0.40 () {56 vars in 1120 bytes} [Mon Jul 11 20:49:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:49:00.649878 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02e839-4bd3-4890-ae71-dd08247bf0de None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:00.671636 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 542/1064] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:49:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 20:49:00.695752 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9394bfb-1c06-48d1-a1eb-00e908902425 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:00.760569 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02e839-4bd3-4890-ae71-dd08247bf0de None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:00.793885 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:00.799899 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da065530-534e-4b6c-a013-5424a359e36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:00.803634 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da065530-534e-4b6c-a013-5424a359e36f None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:00.803634 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da065530-534e-4b6c-a013-5424a359e36f None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:00.803634 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da065530-534e-4b6c-a013-5424a359e36f None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:00.803634 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da065530-534e-4b6c-a013-5424a359e36f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:49:00.803634 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da065530-534e-4b6c-a013-5424a359e36f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:00.804068 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9394bfb-1c06-48d1-a1eb-00e908902425 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:00.804172 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da065530-534e-4b6c-a013-5424a359e36f None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:00.812365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 523/1065] 10.222.0.40 () {56 vars in 1115 bytes} [Mon Jul 11 20:49:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:49:00.813238 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:00.817889 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da065530-534e-4b6c-a013-5424a359e36f None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:00.850002 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9f684-13a8-4a7e-b63f-aba0efc1a90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:00.851328 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9f684-13a8-4a7e-b63f-aba0efc1a90c None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:00.852348 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9f684-13a8-4a7e-b63f-aba0efc1a90c None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:00.852997 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9f684-13a8-4a7e-b63f-aba0efc1a90c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:00.867141 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba9f684-13a8-4a7e-b63f-aba0efc1a90c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:49:00.877571 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-3ba9f684-13a8-4a7e-b63f-aba0efc1a90c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:49:00.877571 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:49:00.877571 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:49:00.877571 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:49:00.877571 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:49:00.877571 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:49:00.877571 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:49:00.877571 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:49:00.877571 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:49:00.877571 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:49:00.877571 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:49:00.877571 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:49:00.877571 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:49:00.877571 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:49:00.877571 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:49:00.877571 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:49:00.878476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:49:00.878476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:49:00.878476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:49:00.878476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:49:00.878476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:49:00.878476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:49:00.878476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:49:00.878476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:49:00.878476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:49:00.878476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:49:00.878476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:49:00.878476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:49:00.878476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:49:00.878476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:49:00.878476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:49:00.878476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:49:00.885093 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:49:00.885093 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:49:00.885093 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:49:00.885093 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:49:00.885093 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:49:00.885093 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:49:00.885093 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:49:00.885093 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:49:00.885093 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:49:00.885093 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:49:00.885093 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:49:00.885093 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:49:00.885093 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 543/1066] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 11 20:49:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:49:00.885804 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9f684-13a8-4a7e-b63f-aba0efc1a90c None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:00.924086 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da065530-534e-4b6c-a013-5424a359e36f None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:00.962458 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861a8cc-ce65-41fa-a051-2d37847746ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:00.963266 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861a8cc-ce65-41fa-a051-2d37847746ee None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:00.963553 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861a8cc-ce65-41fa-a051-2d37847746ee None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:00.963832 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861a8cc-ce65-41fa-a051-2d37847746ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:00.974799 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8861a8cc-ce65-41fa-a051-2d37847746ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:00.976788 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8861a8cc-ce65-41fa-a051-2d37847746ee None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:00.994516 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9f684-13a8-4a7e-b63f-aba0efc1a90c None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:00.994668 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-8861a8cc-ce65-41fa-a051-2d37847746ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:49:00.994668 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:49:00.994668 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:49:00.994668 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:49:00.994668 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:49:00.994668 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:49:00.994668 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:49:00.994668 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:49:00.994668 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:49:00.994668 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:49:00.994668 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:49:00.994668 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:49:00.994668 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:49:00.994668 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:49:00.994668 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:49:00.995496 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:49:00.995496 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:49:00.995496 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:49:00.995496 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:49:00.995496 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:49:00.995496 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:49:00.995496 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:49:00.995496 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:49:00.995496 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:49:00.995496 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:49:00.995496 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:49:00.995496 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:49:00.995496 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:49:00.995496 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:49:00.995496 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:49:00.995496 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:49:00.995496 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:49:01.001435 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:49:01.001435 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:49:01.001435 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:49:01.001435 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:49:01.001435 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 524/1067] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:49:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:49:01.001731 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861a8cc-ce65-41fa-a051-2d37847746ee None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:01.038435 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f9169-2237-4b8f-955c-37b8df8cf1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:01.040640 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f9169-2237-4b8f-955c-37b8df8cf1ef None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:01.040640 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f9169-2237-4b8f-955c-37b8df8cf1ef None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:01.040640 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f9169-2237-4b8f-955c-37b8df8cf1ef None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:01.041230 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f9169-2237-4b8f-955c-37b8df8cf1ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:49:01.041547 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f9169-2237-4b8f-955c-37b8df8cf1ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:01.042945 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f9169-2237-4b8f-955c-37b8df8cf1ef None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:01.052402 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:01.052845 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 544/1068] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:49:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:01.058859 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f9169-2237-4b8f-955c-37b8df8cf1ef None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:01.090095 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:01.114288 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861a8cc-ce65-41fa-a051-2d37847746ee None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:01.152647 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3bb5e-b31c-4fc7-bcd9-1563b299e799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:01.153408 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3bb5e-b31c-4fc7-bcd9-1563b299e799 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:01.153700 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3bb5e-b31c-4fc7-bcd9-1563b299e799 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:01.153984 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3bb5e-b31c-4fc7-bcd9-1563b299e799 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:01.154714 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff3bb5e-b31c-4fc7-bcd9-1563b299e799 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:49:01.155041 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff3bb5e-b31c-4fc7-bcd9-1563b299e799 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:01.156538 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff3bb5e-b31c-4fc7-bcd9-1563b299e799 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:01.166193 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f9169-2237-4b8f-955c-37b8df8cf1ef None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:01.170604 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 525/1069] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:49:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:01.176515 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3bb5e-b31c-4fc7-bcd9-1563b299e799 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:01.201517 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8fb66-3b87-4096-ae2f-5f4b740ccd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:01.202392 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8fb66-3b87-4096-ae2f-5f4b740ccd97 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:01.202686 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8fb66-3b87-4096-ae2f-5f4b740ccd97 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:01.202968 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8fb66-3b87-4096-ae2f-5f4b740ccd97 None admin] PATH_INFO: `/v3/users/dba92036343d4ba7836b20f89f18d046` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:01.204279 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8fb66-3b87-4096-ae2f-5f4b740ccd97 None admin] RBAC: Authorizing `identity:get_user(user_id=dba92036343d4ba7836b20f89f18d046)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:01.205896 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8fb66-3b87-4096-ae2f-5f4b740ccd97 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:01.207556 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 545/1070] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:49:01 2022] GET /identity/v3/users/dba92036343d4ba7836b20f89f18d046 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:49:01.208826 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094a960-76c0-4d67-9d38-a9910645c012 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:01.209119 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094a960-76c0-4d67-9d38-a9910645c012 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:01.209399 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094a960-76c0-4d67-9d38-a9910645c012 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:01.211171 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 546/1071] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:49:01.214386 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094a960-76c0-4d67-9d38-a9910645c012 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:01.277977 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3bb5e-b31c-4fc7-bcd9-1563b299e799 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:01.280718 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:01.310678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:01.310899 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60ebbb-352e-4741-be21-4457e331a553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:01.311671 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60ebbb-352e-4741-be21-4457e331a553 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:01.311953 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60ebbb-352e-4741-be21-4457e331a553 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:01.312253 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60ebbb-352e-4741-be21-4457e331a553 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:01.317656 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094a960-76c0-4d67-9d38-a9910645c012 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:01.320078 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe60ebbb-352e-4741-be21-4457e331a553 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:01.321572 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe60ebbb-352e-4741-be21-4457e331a553 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:01.336229 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-fe60ebbb-352e-4741-be21-4457e331a553 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 20:49:01.336229 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:49:01.336229 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:49:01.336229 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:49:01.336229 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:49:01.336229 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:49:01.336229 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:49:01.336229 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:49:01.336229 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:49:01.336229 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:49:01.336229 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:49:01.336229 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:49:01.336229 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:49:01.336229 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:49:01.336229 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:49:01.336229 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:49:01.337301 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:49:01.337301 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:49:01.337301 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:49:01.337301 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:49:01.337301 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:49:01.337301 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:49:01.337301 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:49:01.337301 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:49:01.337301 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:49:01.337301 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:49:01.337301 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:49:01.337301 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:49:01.337301 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:49:01.337301 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:49:01.337301 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:49:01.337301 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:49:01.337301 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:49:01.337301 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:49:01.338258 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:49:01.338258 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:49:01.338258 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:49:01.338258 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:49:01.338258 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:49:01.338258 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:49:01.338258 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:49:01.338258 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:49:01.338258 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 20:49:01.338258 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:49:01.338258 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 526/1072] 10.222.0.40 () {56 vars in 1093 bytes} [Mon Jul 11 20:49:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:49:01.338893 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625d85c-5af7-453d-9ecc-23fc316012d7 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:01.338964 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625d85c-5af7-453d-9ecc-23fc316012d7 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:01.339328 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625d85c-5af7-453d-9ecc-23fc316012d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:01.356799 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-7625d85c-5af7-453d-9ecc-23fc316012d7 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:49:01.357977 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-7625d85c-5af7-453d-9ecc-23fc316012d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:49:01.358115 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c4225f-7e4b-416a-9b6e-9a546dd5b5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:01.358995 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4225f-7e4b-416a-9b6e-9a546dd5b5a6 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:01.359355 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4225f-7e4b-416a-9b6e-9a546dd5b5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:01.359659 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4225f-7e4b-416a-9b6e-9a546dd5b5a6 None admin] PATH_INFO: `/v3/projects/011d2f62fb8f4bf5929502923e4b4155` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:01.360902 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c4225f-7e4b-416a-9b6e-9a546dd5b5a6 None admin] RBAC: Authorizing `identity:get_project(project_id=011d2f62fb8f4bf5929502923e4b4155)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:01.362340 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c4225f-7e4b-416a-9b6e-9a546dd5b5a6 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:01.364084 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 547/1073] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:49:01 2022] GET /identity/v3/projects/011d2f62fb8f4bf5929502923e4b4155 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:49:01.364927 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c4225f-7e4b-416a-9b6e-9a546dd5b5a6 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:01.490324 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 527/1074] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:49:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:49:01.491139 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625d85c-5af7-453d-9ecc-23fc316012d7 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:01.556306 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c4225f-7e4b-416a-9b6e-9a546dd5b5a6 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:01.584764 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:01.590336 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646fb79-968f-4c7e-b62c-348c399a62d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:01.591011 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646fb79-968f-4c7e-b62c-348c399a62d0 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:01.591298 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646fb79-968f-4c7e-b62c-348c399a62d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:01.591579 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646fb79-968f-4c7e-b62c-348c399a62d0 None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:01.591677 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625d85c-5af7-453d-9ecc-23fc316012d7 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:01.592447 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4646fb79-968f-4c7e-b62c-348c399a62d0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:49:01.592765 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4646fb79-968f-4c7e-b62c-348c399a62d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:01.594192 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4646fb79-968f-4c7e-b62c-348c399a62d0 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:01.611385 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 548/1075] 10.222.0.40 () {56 vars in 1133 bytes} [Mon Jul 11 20:49:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:01.612309 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646fb79-968f-4c7e-b62c-348c399a62d0 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:01.629968 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d25b7-ba76-404c-aa40-abb2e41c879c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:01.630979 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d25b7-ba76-404c-aa40-abb2e41c879c None admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:01.631338 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d25b7-ba76-404c-aa40-abb2e41c879c None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:01.631688 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d25b7-ba76-404c-aa40-abb2e41c879c None admin] PATH_INFO: `/v3/projects/011d2f62fb8f4bf5929502923e4b4155/users/dba92036343d4ba7836b20f89f18d046/roles/86273ff072f3438d822e870272491768` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:01.634247 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d25b7-ba76-404c-aa40-abb2e41c879c None admin] RBAC: Authorizing `identity:create_grant(project_id=011d2f62fb8f4bf5929502923e4b4155, user_id=dba92036343d4ba7836b20f89f18d046, role_id=86273ff072f3438d822e870272491768)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:01.635665 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d25b7-ba76-404c-aa40-abb2e41c879c None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:01.637400 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:01.708729 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 528/1076] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 11 20:49:01 2022] PUT /identity/v3/projects/011d2f62fb8f4bf5929502923e4b4155/users/dba92036343d4ba7836b20f89f18d046/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:49:01.709556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d25b7-ba76-404c-aa40-abb2e41c879c None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:01.709663 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646fb79-968f-4c7e-b62c-348c399a62d0 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:01.749237 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b091622d-27aa-43e2-aa1e-b20e87c4b522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:01.749854 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091622d-27aa-43e2-aa1e-b20e87c4b522 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:01.750112 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091622d-27aa-43e2-aa1e-b20e87c4b522 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:01.750645 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091622d-27aa-43e2-aa1e-b20e87c4b522 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:01.829330 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b091622d-27aa-43e2-aa1e-b20e87c4b522 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:01.830819 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b091622d-27aa-43e2-aa1e-b20e87c4b522 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:01.838451 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d25b7-ba76-404c-aa40-abb2e41c879c None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:01.856437 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:01.878721 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d72bb2-ebe4-4917-9c27-a04dc6ba568c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:01.879536 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d72bb2-ebe4-4917-9c27-a04dc6ba568c None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:01.879827 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d72bb2-ebe4-4917-9c27-a04dc6ba568c None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:01.880137 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d72bb2-ebe4-4917-9c27-a04dc6ba568c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:01.892274 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d72bb2-ebe4-4917-9c27-a04dc6ba568c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:01.894050 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d72bb2-ebe4-4917-9c27-a04dc6ba568c None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:01.912439 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-d2d72bb2-ebe4-4917-9c27-a04dc6ba568c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:49:01.912439 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:49:01.912439 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:49:01.912439 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:49:01.912439 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:49:01.912439 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:49:01.912439 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:49:01.912439 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:49:01.912439 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:49:01.912439 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:49:01.912439 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:49:01.912439 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:49:01.912439 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:49:01.912439 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:49:01.912439 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:49:01.913569 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:49:01.913569 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:49:01.913569 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:49:01.913569 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:49:01.913569 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:49:01.913569 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:49:01.913569 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:49:01.913569 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:49:01.913569 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:49:01.913569 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:49:01.913569 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:49:01.913569 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:49:01.913569 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:49:01.913569 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:49:01.913569 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:49:01.913569 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:49:01.913569 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:49:01.915299 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:49:01.915299 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:49:01.915299 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:49:01.915299 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:49:01.916938 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 529/1077] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:49:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:49:01.924285 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d72bb2-ebe4-4917-9c27-a04dc6ba568c None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:01.934128 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:01.953792 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 549/1078] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:49:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 20:49:01.954977 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b091622d-27aa-43e2-aa1e-b20e87c4b522 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:02.033653 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d72bb2-ebe4-4917-9c27-a04dc6ba568c None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:02.060884 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b091622d-27aa-43e2-aa1e-b20e87c4b522 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:02.074090 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc9d3d-d8e2-4e79-8568-9b8290c4b0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:02.075012 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc9d3d-d8e2-4e79-8568-9b8290c4b0f8 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:02.075516 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc9d3d-d8e2-4e79-8568-9b8290c4b0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:02.075866 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc9d3d-d8e2-4e79-8568-9b8290c4b0f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:02.076682 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc9d3d-d8e2-4e79-8568-9b8290c4b0f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:49:02.076930 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc9d3d-d8e2-4e79-8568-9b8290c4b0f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:02.078281 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc9d3d-d8e2-4e79-8568-9b8290c4b0f8 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:02.084338 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:02.095712 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 530/1079] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:49:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:49:02.096864 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc9d3d-d8e2-4e79-8568-9b8290c4b0f8 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:02.096977 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4106506a-28a0-4ed7-b7ff-7d5fdbf33f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:02.102027 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106506a-28a0-4ed7-b7ff-7d5fdbf33f00 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:02.102027 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106506a-28a0-4ed7-b7ff-7d5fdbf33f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:02.102027 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106506a-28a0-4ed7-b7ff-7d5fdbf33f00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:02.112696 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4106506a-28a0-4ed7-b7ff-7d5fdbf33f00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:02.114160 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4106506a-28a0-4ed7-b7ff-7d5fdbf33f00 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:02.132987 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-4106506a-28a0-4ed7-b7ff-7d5fdbf33f00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:49:02.132987 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:49:02.132987 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:49:02.132987 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:49:02.132987 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:49:02.132987 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:49:02.132987 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:49:02.132987 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:49:02.132987 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:49:02.132987 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:49:02.132987 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:49:02.132987 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:49:02.132987 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:49:02.132987 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:49:02.132987 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:49:02.133926 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:49:02.133926 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:49:02.133926 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:49:02.133926 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:49:02.133926 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:49:02.133926 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:49:02.133926 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:49:02.133926 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:49:02.133926 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:49:02.133926 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:49:02.133926 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:49:02.133926 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:49:02.133926 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:49:02.133926 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:49:02.133926 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:49:02.133926 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:49:02.133926 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:49:02.134812 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:49:02.134812 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:49:02.134812 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:49:02.134812 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:49:02.134812 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 550/1080] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:49:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:49:02.140367 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4106506a-28a0-4ed7-b7ff-7d5fdbf33f00 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:02.173697 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:02.212804 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc9d3d-d8e2-4e79-8568-9b8290c4b0f8 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:02.248339 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4106506a-28a0-4ed7-b7ff-7d5fdbf33f00 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:02.248957 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72f901-281f-452b-b098-5247db917baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:02.249772 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72f901-281f-452b-b098-5247db917baf None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:02.250057 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72f901-281f-452b-b098-5247db917baf None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:02.250595 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72f901-281f-452b-b098-5247db917baf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:02.257532 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c72f901-281f-452b-b098-5247db917baf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:02.259117 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c72f901-281f-452b-b098-5247db917baf None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:02.274966 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-3c72f901-281f-452b-b098-5247db917baf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:49:02.274966 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:49:02.274966 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:49:02.274966 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:49:02.274966 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:49:02.274966 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:49:02.274966 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:49:02.274966 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:49:02.274966 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:49:02.274966 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:49:02.274966 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:49:02.274966 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:49:02.274966 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:49:02.274966 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:49:02.274966 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:49:02.276381 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:49:02.276381 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:49:02.276381 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:49:02.276381 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:49:02.276381 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:49:02.276381 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:49:02.276381 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:49:02.276381 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:49:02.276381 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:49:02.276381 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:49:02.276381 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:49:02.276381 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:49:02.276381 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:49:02.276381 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:49:02.276381 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:49:02.276381 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:49:02.276381 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:49:02.277564 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:49:02.277564 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:49:02.277564 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:49:02.277564 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:49:02.277564 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:49:02.277564 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:49:02.277564 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:49:02.277564 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:49:02.277564 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 531/1081] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:49:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:49:02.281973 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72f901-281f-452b-b098-5247db917baf None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:02.287114 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529cfd1d-cd24-4c28-81d9-62f0a9314d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:02.288138 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529cfd1d-cd24-4c28-81d9-62f0a9314d85 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:02.288609 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529cfd1d-cd24-4c28-81d9-62f0a9314d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:02.289689 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529cfd1d-cd24-4c28-81d9-62f0a9314d85 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:02.290626 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529cfd1d-cd24-4c28-81d9-62f0a9314d85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:49:02.291186 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529cfd1d-cd24-4c28-81d9-62f0a9314d85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:02.292901 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529cfd1d-cd24-4c28-81d9-62f0a9314d85 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:02.305882 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 551/1082] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:49:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:49:02.405954 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72f901-281f-452b-b098-5247db917baf None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:02.433990 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:02.443551 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c43bad-0102-4cd8-a43e-be5a20fb1d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:02.444279 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c43bad-0102-4cd8-a43e-be5a20fb1d5a None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:02.451168 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c43bad-0102-4cd8-a43e-be5a20fb1d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:02.451168 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c43bad-0102-4cd8-a43e-be5a20fb1d5a None admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:02.451168 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c43bad-0102-4cd8-a43e-be5a20fb1d5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:49:02.451168 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c43bad-0102-4cd8-a43e-be5a20fb1d5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:02.451168 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c43bad-0102-4cd8-a43e-be5a20fb1d5a None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:02.461313 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 532/1083] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 11 20:49:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:02.467227 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529cfd1d-cd24-4c28-81d9-62f0a9314d85 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:02.509422 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:02.580776 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529cfd1d-cd24-4c28-81d9-62f0a9314d85 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:02.615447 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a275fc7-dcd3-4c0a-9642-c766b18313f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:02.616367 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a275fc7-dcd3-4c0a-9642-c766b18313f7 None admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:02.616656 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a275fc7-dcd3-4c0a-9642-c766b18313f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:02.616962 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a275fc7-dcd3-4c0a-9642-c766b18313f7 None admin] PATH_INFO: `/v3/projects/eca3ef2561fa435e80ff451aeab14f3b/users/8ac15411c75f4bd4a86f6753c9240a5b/roles/1400a904c27a413fa8b7c591773b08cf` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:02.619318 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a275fc7-dcd3-4c0a-9642-c766b18313f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=eca3ef2561fa435e80ff451aeab14f3b, user_id=8ac15411c75f4bd4a86f6753c9240a5b, role_id=1400a904c27a413fa8b7c591773b08cf)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:02.620779 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a275fc7-dcd3-4c0a-9642-c766b18313f7 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:02.682528 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 552/1084] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 11 20:49:02 2022] PUT /identity/v3/projects/eca3ef2561fa435e80ff451aeab14f3b/users/8ac15411c75f4bd4a86f6753c9240a5b/roles/1400a904c27a413fa8b7c591773b08cf => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:49:03.750705 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426c870-7245-451a-8078-12253a6af1b6 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:03.751218 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426c870-7245-451a-8078-12253a6af1b6 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:03.751337 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426c870-7245-451a-8078-12253a6af1b6 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:03.752648 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 533/1085] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:49:03.758588 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1617a-ae9a-4316-9239-9f92b70a0368 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:03.759125 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1617a-ae9a-4316-9239-9f92b70a0368 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:03.759241 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1617a-ae9a-4316-9239-9f92b70a0368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:03.782693 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-aac1617a-ae9a-4316-9239-9f92b70a0368 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:49:03.783885 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-aac1617a-ae9a-4316-9239-9f92b70a0368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:49:03.850862 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 553/1086] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:49:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:49:03.874123 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426c870-7245-451a-8078-12253a6af1b6 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:03.973431 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426c870-7245-451a-8078-12253a6af1b6 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:04.005906 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb0a0e-cad4-4eb9-9ce6-4489b14750fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:04.006687 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb0a0e-cad4-4eb9-9ce6-4489b14750fc None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:04.006970 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb0a0e-cad4-4eb9-9ce6-4489b14750fc None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:04.007245 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb0a0e-cad4-4eb9-9ce6-4489b14750fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:04.018064 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fb0a0e-cad4-4eb9-9ce6-4489b14750fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:49:04.026128 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-09fb0a0e-cad4-4eb9-9ce6-4489b14750fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:49:04.026128 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:49:04.026128 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:49:04.026128 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:49:04.026128 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:49:04.026128 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:49:04.026128 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:49:04.026128 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:49:04.026128 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:49:04.026128 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:49:04.026128 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:49:04.026128 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:49:04.026128 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:49:04.026128 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:49:04.026128 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:49:04.026128 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:49:04.027282 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:49:04.027282 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:49:04.027282 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:49:04.027282 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:49:04.027282 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:49:04.027282 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:49:04.027282 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:49:04.027282 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:49:04.027282 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:49:04.027282 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:49:04.027282 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:49:04.027282 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:49:04.027282 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:49:04.027282 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:49:04.027282 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:49:04.027282 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:49:04.028219 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:49:04.028219 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:49:04.028219 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:49:04.028219 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:49:04.028219 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:49:04.028219 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:49:04.028219 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:49:04.028219 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:49:04.028219 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:49:04.028219 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:49:04.028219 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:49:04.028219 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:49:04.028219 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 534/1087] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 11 20:49:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:49:04.033392 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1617a-ae9a-4316-9239-9f92b70a0368 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:04.057189 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:04.130736 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1617a-ae9a-4316-9239-9f92b70a0368 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:04.164675 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a231e-d67a-4a75-8f0e-63ad99458a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:04.165380 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a231e-d67a-4a75-8f0e-63ad99458a36 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:04.165665 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a231e-d67a-4a75-8f0e-63ad99458a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:04.165946 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a231e-d67a-4a75-8f0e-63ad99458a36 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:04.166691 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a231e-d67a-4a75-8f0e-63ad99458a36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:49:04.167000 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a231e-d67a-4a75-8f0e-63ad99458a36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:04.168406 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07a231e-d67a-4a75-8f0e-63ad99458a36 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:04.176378 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 554/1088] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:49:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:04.183032 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb0a0e-cad4-4eb9-9ce6-4489b14750fc None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:04.228970 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:04.282873 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb0a0e-cad4-4eb9-9ce6-4489b14750fc None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:04.316376 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed58ed-cb5b-4c46-a90c-f95ef0cc3d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:04.317245 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed58ed-cb5b-4c46-a90c-f95ef0cc3d12 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:04.317528 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed58ed-cb5b-4c46-a90c-f95ef0cc3d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:04.317805 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed58ed-cb5b-4c46-a90c-f95ef0cc3d12 None admin] PATH_INFO: `/v3/users/dba92036343d4ba7836b20f89f18d046` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:04.318981 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed58ed-cb5b-4c46-a90c-f95ef0cc3d12 None admin] RBAC: Authorizing `identity:get_user(user_id=dba92036343d4ba7836b20f89f18d046)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:04.321050 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed58ed-cb5b-4c46-a90c-f95ef0cc3d12 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:04.322691 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 535/1089] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:49:04 2022] GET /identity/v3/users/dba92036343d4ba7836b20f89f18d046 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:04.328327 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a231e-d67a-4a75-8f0e-63ad99458a36 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:04.411822 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:04.426217 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a231e-d67a-4a75-8f0e-63ad99458a36 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:04.461397 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2858f-ed64-4e64-8f99-a3ff378a7b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:04.462048 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2858f-ed64-4e64-8f99-a3ff378a7b4c None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:04.462331 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2858f-ed64-4e64-8f99-a3ff378a7b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:04.462608 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2858f-ed64-4e64-8f99-a3ff378a7b4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:04.528043 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2858f-ed64-4e64-8f99-a3ff378a7b4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:04.529451 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2858f-ed64-4e64-8f99-a3ff378a7b4c None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:04.610147 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:04.625191 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 555/1090] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:49:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 20:49:04.631309 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed58ed-cb5b-4c46-a90c-f95ef0cc3d12 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:04.696656 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babace51-f632-44d0-8252-7a3b87671565 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:04.696952 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babace51-f632-44d0-8252-7a3b87671565 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:04.697233 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babace51-f632-44d0-8252-7a3b87671565 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:04.698593 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 556/1091] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:49:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:49:04.703259 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4b027-f114-487c-9f39-a6c9010b95a0 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:04.703547 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4b027-f114-487c-9f39-a6c9010b95a0 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:04.703825 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4b027-f114-487c-9f39-a6c9010b95a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:04.720499 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-b6a4b027-f114-487c-9f39-a6c9010b95a0 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:49:04.721689 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-b6a4b027-f114-487c-9f39-a6c9010b95a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:49:04.736573 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed58ed-cb5b-4c46-a90c-f95ef0cc3d12 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:04.750887 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:04.770731 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1ad76-de0b-443b-b239-d544e3f73d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:04.771593 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1ad76-de0b-443b-b239-d544e3f73d36 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:04.771884 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1ad76-de0b-443b-b239-d544e3f73d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:04.772187 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1ad76-de0b-443b-b239-d544e3f73d36 None admin] PATH_INFO: `/v3/projects/011d2f62fb8f4bf5929502923e4b4155` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:04.773399 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f1ad76-de0b-443b-b239-d544e3f73d36 None admin] RBAC: Authorizing `identity:get_project(project_id=011d2f62fb8f4bf5929502923e4b4155)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:04.774865 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f1ad76-de0b-443b-b239-d544e3f73d36 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:04.776570 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 536/1092] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:49:04 2022] GET /identity/v3/projects/011d2f62fb8f4bf5929502923e4b4155 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:04.782666 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1ad76-de0b-443b-b239-d544e3f73d36 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:04.791376 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 557/1093] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:49:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:49:04.812615 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4b027-f114-487c-9f39-a6c9010b95a0 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:04.881812 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1ad76-de0b-443b-b239-d544e3f73d36 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:04.910530 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4b027-f114-487c-9f39-a6c9010b95a0 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:04.916165 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff165348-6f41-4ddb-944f-ff35d9926259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:04.916835 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff165348-6f41-4ddb-944f-ff35d9926259 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:04.917125 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff165348-6f41-4ddb-944f-ff35d9926259 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:04.917407 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff165348-6f41-4ddb-944f-ff35d9926259 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:04.918234 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff165348-6f41-4ddb-944f-ff35d9926259 None admin] RBAC: Adding query filter params (role.id=86273ff072f3438d822e870272491768, scope.project.id=011d2f62fb8f4bf5929502923e4b4155, user.id=dba92036343d4ba7836b20f89f18d046) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:49:04.918552 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff165348-6f41-4ddb-944f-ff35d9926259 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:04.919987 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff165348-6f41-4ddb-944f-ff35d9926259 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:04.925938 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 537/1094] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:49:04 2022] GET /identity/v3/role_assignments?user.id=dba92036343d4ba7836b20f89f18d046&scope.project.id=011d2f62fb8f4bf5929502923e4b4155&role.id=86273ff072f3438d822e870272491768 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:49:04.928231 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:04.948583 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59129c81-a065-4b03-9fb1-aeeb0874a4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:04.949595 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59129c81-a065-4b03-9fb1-aeeb0874a4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:04.949888 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59129c81-a065-4b03-9fb1-aeeb0874a4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:04.950173 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59129c81-a065-4b03-9fb1-aeeb0874a4a2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:04.963574 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59129c81-a065-4b03-9fb1-aeeb0874a4a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:49:04.972265 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-59129c81-a065-4b03-9fb1-aeeb0874a4a2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 20:49:04.972265 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:49:04.972265 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:49:04.972265 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:49:04.972265 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:49:04.972265 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:49:04.972265 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:49:04.972265 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:49:04.972265 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:49:04.972265 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:49:04.972265 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:49:04.972265 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:49:04.972265 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:49:04.972265 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:49:04.972265 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:49:04.972265 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:49:04.973437 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:49:04.973437 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:49:04.973437 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:49:04.973437 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:49:04.973437 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:49:04.973437 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:49:04.973437 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:49:04.973437 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:49:04.973437 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:49:04.973437 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:49:04.973437 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:49:04.973437 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:49:04.973437 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:49:04.973437 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:49:04.973437 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:49:04.973437 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:49:04.974373 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:49:04.974373 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:49:04.974373 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:49:04.974373 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:49:04.974373 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:49:04.974373 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:49:04.974373 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:49:04.974373 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:49:04.974373 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:49:04.974373 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:49:04.974373 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 20:49:04.974373 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:49:04.974373 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 558/1095] 10.222.0.40 () {56 vars in 1120 bytes} [Mon Jul 11 20:49:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:49:04.981017 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff165348-6f41-4ddb-944f-ff35d9926259 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:05.032872 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:05.088267 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff165348-6f41-4ddb-944f-ff35d9926259 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:05.122897 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16abd325-6792-4bfc-b924-e7f4f6bfb123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:05.123574 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16abd325-6792-4bfc-b924-e7f4f6bfb123 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:05.123856 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16abd325-6792-4bfc-b924-e7f4f6bfb123 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:05.124160 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16abd325-6792-4bfc-b924-e7f4f6bfb123 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:05.124901 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16abd325-6792-4bfc-b924-e7f4f6bfb123 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:49:05.125207 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16abd325-6792-4bfc-b924-e7f4f6bfb123 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:05.126805 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16abd325-6792-4bfc-b924-e7f4f6bfb123 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:05.134934 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 538/1096] 10.222.0.40 () {56 vars in 1115 bytes} [Mon Jul 11 20:49:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:05.140767 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59129c81-a065-4b03-9fb1-aeeb0874a4a2 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:05.240943 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59129c81-a065-4b03-9fb1-aeeb0874a4a2 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:05.277371 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d55b8-99ed-4621-93fa-1abb0258cfb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:05.278179 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d55b8-99ed-4621-93fa-1abb0258cfb1 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:05.278472 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d55b8-99ed-4621-93fa-1abb0258cfb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:05.278754 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d55b8-99ed-4621-93fa-1abb0258cfb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:05.290048 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d55b8-99ed-4621-93fa-1abb0258cfb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:05.291449 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d55b8-99ed-4621-93fa-1abb0258cfb1 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:05.309526 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-294d55b8-99ed-4621-93fa-1abb0258cfb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:49:05.309526 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:49:05.309526 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:49:05.309526 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:49:05.309526 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:49:05.309526 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:49:05.309526 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:49:05.309526 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:49:05.309526 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:49:05.309526 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:49:05.309526 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:49:05.309526 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:49:05.309526 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:49:05.309526 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:49:05.309526 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:49:05.310643 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:49:05.310643 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:49:05.310643 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:49:05.310643 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:49:05.310643 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:49:05.310643 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:49:05.310643 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:49:05.310643 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:49:05.310643 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:49:05.310643 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:49:05.310643 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:49:05.310643 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:49:05.310643 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:49:05.310643 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:49:05.310643 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:49:05.310643 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:49:05.310643 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:49:05.311772 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:49:05.311772 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:49:05.311772 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:49:05.311772 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:49:05.315707 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 559/1097] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:49:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:49:05.316661 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16abd325-6792-4bfc-b924-e7f4f6bfb123 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:05.415666 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16abd325-6792-4bfc-b924-e7f4f6bfb123 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:05.424528 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:05.448558 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d915b9-69ba-4ad9-84f7-b785b25c6db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:05.449223 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d915b9-69ba-4ad9-84f7-b785b25c6db8 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:05.449507 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d915b9-69ba-4ad9-84f7-b785b25c6db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:05.449782 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d915b9-69ba-4ad9-84f7-b785b25c6db8 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:05.450502 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d915b9-69ba-4ad9-84f7-b785b25c6db8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:49:05.450813 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d915b9-69ba-4ad9-84f7-b785b25c6db8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:05.452411 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d915b9-69ba-4ad9-84f7-b785b25c6db8 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:05.464814 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 539/1098] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:49:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:05.470496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d55b8-99ed-4621-93fa-1abb0258cfb1 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:05.498200 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:05.568829 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d55b8-99ed-4621-93fa-1abb0258cfb1 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:05.602681 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298e139-f69b-4e85-b03c-28e9128875e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:05.603479 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298e139-f69b-4e85-b03c-28e9128875e3 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:05.603762 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298e139-f69b-4e85-b03c-28e9128875e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:05.604065 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298e139-f69b-4e85-b03c-28e9128875e3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:05.610940 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298e139-f69b-4e85-b03c-28e9128875e3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:05.612417 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298e139-f69b-4e85-b03c-28e9128875e3 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:05.626639 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-d298e139-f69b-4e85-b03c-28e9128875e3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 20:49:05.626639 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:49:05.626639 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:49:05.626639 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:49:05.626639 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:49:05.626639 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:49:05.626639 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:49:05.626639 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:49:05.626639 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:49:05.626639 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:49:05.626639 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:49:05.626639 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:49:05.626639 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:49:05.626639 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:49:05.626639 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:49:05.626639 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:49:05.627744 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:49:05.627744 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:49:05.627744 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:49:05.627744 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:49:05.627744 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:49:05.627744 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:49:05.627744 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:49:05.627744 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:49:05.627744 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:49:05.627744 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:49:05.627744 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:49:05.627744 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:49:05.627744 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:49:05.627744 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:49:05.627744 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:49:05.627744 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:49:05.627744 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:49:05.627744 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:49:05.628831 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:49:05.628831 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:49:05.628831 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:49:05.628831 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:49:05.628831 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:49:05.628831 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:49:05.628831 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:49:05.628831 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:49:05.628831 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 20:49:05.628831 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:49:05.628831 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 560/1099] 10.222.0.40 () {56 vars in 1093 bytes} [Mon Jul 11 20:49:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:49:05.634523 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d915b9-69ba-4ad9-84f7-b785b25c6db8 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:05.733240 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d915b9-69ba-4ad9-84f7-b785b25c6db8 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:05.766735 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5c5da-e3f8-49d3-8f7d-27639d597c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:05.767400 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5c5da-e3f8-49d3-8f7d-27639d597c45 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:05.767683 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5c5da-e3f8-49d3-8f7d-27639d597c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:05.767959 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5c5da-e3f8-49d3-8f7d-27639d597c45 None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:05.768809 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc5c5da-e3f8-49d3-8f7d-27639d597c45 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:49:05.769121 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc5c5da-e3f8-49d3-8f7d-27639d597c45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:05.770528 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc5c5da-e3f8-49d3-8f7d-27639d597c45 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:05.786873 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 540/1100] 10.222.0.40 () {56 vars in 1133 bytes} [Mon Jul 11 20:49:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:05.793408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298e139-f69b-4e85-b03c-28e9128875e3 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:05.877730 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:05.889432 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298e139-f69b-4e85-b03c-28e9128875e3 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:05.923311 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9e60d-1a55-49ba-a78f-dfdf5e0e7db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:05.923962 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9e60d-1a55-49ba-a78f-dfdf5e0e7db0 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:05.924271 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9e60d-1a55-49ba-a78f-dfdf5e0e7db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:05.924553 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9e60d-1a55-49ba-a78f-dfdf5e0e7db0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:05.989672 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9e60d-1a55-49ba-a78f-dfdf5e0e7db0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:05.991119 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9e60d-1a55-49ba-a78f-dfdf5e0e7db0 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:06.077767 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:06.091213 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 561/1101] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:49:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 20:49:06.096951 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5c5da-e3f8-49d3-8f7d-27639d597c45 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:06.123507 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:06.195656 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5c5da-e3f8-49d3-8f7d-27639d597c45 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:06.230044 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff54bb-beb3-479c-b91b-e17b5b70978a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:06.230848 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff54bb-beb3-479c-b91b-e17b5b70978a None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:06.231133 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff54bb-beb3-479c-b91b-e17b5b70978a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:06.231410 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff54bb-beb3-479c-b91b-e17b5b70978a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:06.241595 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff54bb-beb3-479c-b91b-e17b5b70978a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:06.243057 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff54bb-beb3-479c-b91b-e17b5b70978a None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:06.261236 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-16ff54bb-beb3-479c-b91b-e17b5b70978a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:49:06.261236 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:49:06.261236 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:49:06.261236 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:49:06.261236 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:49:06.261236 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:49:06.261236 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:49:06.261236 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:49:06.261236 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:49:06.261236 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:49:06.261236 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:49:06.261236 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:49:06.261236 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:49:06.261236 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:49:06.261236 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:49:06.262136 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:49:06.262136 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:49:06.262136 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:49:06.262136 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:49:06.262136 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:49:06.262136 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:49:06.262136 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:49:06.262136 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:49:06.262136 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:49:06.262136 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:49:06.262136 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:49:06.262136 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:49:06.262136 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:49:06.262136 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:49:06.262136 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:49:06.262136 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:49:06.262136 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:49:06.263028 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:49:06.263028 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:49:06.263028 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:49:06.263028 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:49:06.263028 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 541/1102] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:49:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:49:06.268241 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9e60d-1a55-49ba-a78f-dfdf5e0e7db0 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:06.366284 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9e60d-1a55-49ba-a78f-dfdf5e0e7db0 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:06.399960 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8debd-f8fb-4e6d-bd12-090c76de5c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:06.400651 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8debd-f8fb-4e6d-bd12-090c76de5c77 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:06.400938 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8debd-f8fb-4e6d-bd12-090c76de5c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:06.401214 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8debd-f8fb-4e6d-bd12-090c76de5c77 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:06.401929 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c8debd-f8fb-4e6d-bd12-090c76de5c77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:49:06.402268 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c8debd-f8fb-4e6d-bd12-090c76de5c77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:06.403627 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c8debd-f8fb-4e6d-bd12-090c76de5c77 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:06.414647 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 562/1103] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:49:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:06.420193 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff54bb-beb3-479c-b91b-e17b5b70978a None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:06.498344 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:06.519877 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff54bb-beb3-479c-b91b-e17b5b70978a None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:06.553244 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a6607-3be9-4963-86c2-432a3c7598f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:06.554043 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a6607-3be9-4963-86c2-432a3c7598f8 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:06.554821 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a6607-3be9-4963-86c2-432a3c7598f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:06.555095 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a6607-3be9-4963-86c2-432a3c7598f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:06.561796 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a6607-3be9-4963-86c2-432a3c7598f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:06.563225 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a6607-3be9-4963-86c2-432a3c7598f8 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:06.577394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-ee3a6607-3be9-4963-86c2-432a3c7598f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:49:06.577394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:49:06.577394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:49:06.577394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:49:06.577394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:49:06.577394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:49:06.577394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:49:06.577394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:49:06.577394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:49:06.577394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:49:06.577394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:49:06.577394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:49:06.577394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:49:06.577394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:49:06.577394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:49:06.578276 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:49:06.578276 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:49:06.578276 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:49:06.578276 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:49:06.578276 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:49:06.578276 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:49:06.578276 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:49:06.578276 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:49:06.578276 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:49:06.578276 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:49:06.578276 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:49:06.578276 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:49:06.578276 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:49:06.578276 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:49:06.578276 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:49:06.578276 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:49:06.578276 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:49:06.579170 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:49:06.579170 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:49:06.579170 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:49:06.579170 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:49:06.579170 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:49:06.579170 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:49:06.579170 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:49:06.579170 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:49:06.580121 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 542/1104] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:49:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:49:06.584329 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8debd-f8fb-4e6d-bd12-090c76de5c77 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:06.633301 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:06.684868 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8debd-f8fb-4e6d-bd12-090c76de5c77 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:06.718081 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e39c47-1bb2-435d-86dd-ed5ac8c0785f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:06.718754 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e39c47-1bb2-435d-86dd-ed5ac8c0785f None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:06.719044 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e39c47-1bb2-435d-86dd-ed5ac8c0785f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:06.719324 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e39c47-1bb2-435d-86dd-ed5ac8c0785f None admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:06.720156 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e39c47-1bb2-435d-86dd-ed5ac8c0785f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:49:06.720475 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e39c47-1bb2-435d-86dd-ed5ac8c0785f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:06.721908 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e39c47-1bb2-435d-86dd-ed5ac8c0785f None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:06.734894 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 563/1105] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 11 20:49:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:06.740845 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a6607-3be9-4963-86c2-432a3c7598f8 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:06.840960 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a6607-3be9-4963-86c2-432a3c7598f8 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:06.874865 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63eb01d-38f3-42d8-9f0c-f987191c86ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:06.875788 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63eb01d-38f3-42d8-9f0c-f987191c86ae None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:06.876108 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63eb01d-38f3-42d8-9f0c-f987191c86ae None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:06.876386 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63eb01d-38f3-42d8-9f0c-f987191c86ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:06.877216 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63eb01d-38f3-42d8-9f0c-f987191c86ae None admin] RBAC: Adding query filter params (role.id=1400a904c27a413fa8b7c591773b08cf, scope.project.id=eca3ef2561fa435e80ff451aeab14f3b, user.id=8ac15411c75f4bd4a86f6753c9240a5b) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:49:06.877535 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63eb01d-38f3-42d8-9f0c-f987191c86ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:06.878955 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63eb01d-38f3-42d8-9f0c-f987191c86ae None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:06.884884 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 543/1106] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:49:06 2022] GET /identity/v3/role_assignments?user.id=8ac15411c75f4bd4a86f6753c9240a5b&scope.project.id=eca3ef2561fa435e80ff451aeab14f3b&role.id=1400a904c27a413fa8b7c591773b08cf => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:06.964304 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071909e8-fd75-4992-85ea-03cb90bde4c7 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:06.964842 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071909e8-fd75-4992-85ea-03cb90bde4c7 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:06.964842 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071909e8-fd75-4992-85ea-03cb90bde4c7 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:06.966470 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 564/1107] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:49:06.972004 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd067d-ff2d-44f2-8df5-5ff44d3678ae None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:06.972393 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd067d-ff2d-44f2-8df5-5ff44d3678ae None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:06.972739 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd067d-ff2d-44f2-8df5-5ff44d3678ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:06.978168 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:06.991157 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-00cd067d-ff2d-44f2-8df5-5ff44d3678ae None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:49:06.992578 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-00cd067d-ff2d-44f2-8df5-5ff44d3678ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:49:07.062732 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 544/1108] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:49:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:49:07.088226 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071909e8-fd75-4992-85ea-03cb90bde4c7 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:07.189384 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071909e8-fd75-4992-85ea-03cb90bde4c7 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:07.198879 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:07.223267 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b93fd6-e208-4817-9073-1d55865e31bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:07.224094 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b93fd6-e208-4817-9073-1d55865e31bf None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:07.224387 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b93fd6-e208-4817-9073-1d55865e31bf None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:07.224670 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b93fd6-e208-4817-9073-1d55865e31bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:07.225882 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b93fd6-e208-4817-9073-1d55865e31bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:07.228087 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b93fd6-e208-4817-9073-1d55865e31bf None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:07.230174 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 565/1109] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:49:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:07.236273 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd067d-ff2d-44f2-8df5-5ff44d3678ae None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:07.341521 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd067d-ff2d-44f2-8df5-5ff44d3678ae None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:07.370565 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:07.375796 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641f75e-5e72-4041-a456-7b46b7bd8bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:07.376512 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641f75e-5e72-4041-a456-7b46b7bd8bc2 None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:07.376801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641f75e-5e72-4041-a456-7b46b7bd8bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:07.381619 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641f75e-5e72-4041-a456-7b46b7bd8bc2 None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:07.381619 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1641f75e-5e72-4041-a456-7b46b7bd8bc2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:07.381619 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1641f75e-5e72-4041-a456-7b46b7bd8bc2 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:07.477897 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 545/1110] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jul 11 20:49:07 2022] POST /identity/v3/users => generated 286 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:49:09.641799 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c10b0-e61d-49f3-ac00-a2f5f2c0e0f5 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:09.642366 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c10b0-e61d-49f3-ac00-a2f5f2c0e0f5 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:09.642366 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c10b0-e61d-49f3-ac00-a2f5f2c0e0f5 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:09.643740 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 566/1111] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:49:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:49:09.649089 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bede40-e0c0-4f10-8a40-a097b15f9a0c None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:09.649540 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bede40-e0c0-4f10-8a40-a097b15f9a0c None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:09.649648 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bede40-e0c0-4f10-8a40-a097b15f9a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:09.666943 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-42bede40-e0c0-4f10-8a40-a097b15f9a0c None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:49:09.668178 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-42bede40-e0c0-4f10-8a40-a097b15f9a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:49:09.735001 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 546/1112] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:49:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:49:09.760208 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c10b0-e61d-49f3-ac00-a2f5f2c0e0f5 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:09.859818 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c10b0-e61d-49f3-ac00-a2f5f2c0e0f5 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:09.892984 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d3b0b-fb77-4c9f-b7ae-094533c08a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:09.893776 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d3b0b-fb77-4c9f-b7ae-094533c08a79 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:09.894067 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d3b0b-fb77-4c9f-b7ae-094533c08a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:09.894347 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d3b0b-fb77-4c9f-b7ae-094533c08a79 None admin] PATH_INFO: `/v3/roles/c2117c810f7b4e6aaf684c3d37b0ea3e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:09.895806 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d3b0b-fb77-4c9f-b7ae-094533c08a79 None admin] RBAC: Authorizing `identity:get_role(role_id=c2117c810f7b4e6aaf684c3d37b0ea3e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:09.897218 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d3b0b-fb77-4c9f-b7ae-094533c08a79 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:09.898619 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 567/1113] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:49:09 2022] GET /identity/v3/roles/c2117c810f7b4e6aaf684c3d37b0ea3e => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:09.904606 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bede40-e0c0-4f10-8a40-a097b15f9a0c None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:10.001284 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bede40-e0c0-4f10-8a40-a097b15f9a0c None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:10.017807 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:10.034225 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5beb300-5150-439a-ab96-9569486e1fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:10.035089 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5beb300-5150-439a-ab96-9569486e1fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:10.035379 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5beb300-5150-439a-ab96-9569486e1fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:10.036486 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5beb300-5150-439a-ab96-9569486e1fb1 None admin] PATH_INFO: `/v3/users/c0e3b136c90f46e397d2ce88d2acce0a` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:10.048924 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5beb300-5150-439a-ab96-9569486e1fb1 None admin] RBAC: Authorizing `identity:get_user(user_id=c0e3b136c90f46e397d2ce88d2acce0a)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:10.050400 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5beb300-5150-439a-ab96-9569486e1fb1 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:10.052040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 547/1114] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:49:09 2022] GET /identity/v3/users/c0e3b136c90f46e397d2ce88d2acce0a => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:10.058279 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d3b0b-fb77-4c9f-b7ae-094533c08a79 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:10.103081 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:10.155924 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d3b0b-fb77-4c9f-b7ae-094533c08a79 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:10.188972 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945db9b-c9b6-45b5-a12d-9229160b18f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:10.189618 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945db9b-c9b6-45b5-a12d-9229160b18f0 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:10.189903 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945db9b-c9b6-45b5-a12d-9229160b18f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:10.190177 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945db9b-c9b6-45b5-a12d-9229160b18f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:10.254980 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945db9b-c9b6-45b5-a12d-9229160b18f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:10.256463 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945db9b-c9b6-45b5-a12d-9229160b18f0 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:10.298575 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:10.352675 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 568/1115] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:49:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 20:49:10.358647 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5beb300-5150-439a-ab96-9569486e1fb1 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:10.454663 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5beb300-5150-439a-ab96-9569486e1fb1 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:10.488798 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233be4e2-0a31-4749-83aa-97631ed7b9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:10.489657 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233be4e2-0a31-4749-83aa-97631ed7b9d9 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:10.489941 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233be4e2-0a31-4749-83aa-97631ed7b9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:10.490218 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233be4e2-0a31-4749-83aa-97631ed7b9d9 None admin] PATH_INFO: `/v3/projects/011d2f62fb8f4bf5929502923e4b4155` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:10.491370 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233be4e2-0a31-4749-83aa-97631ed7b9d9 None admin] RBAC: Authorizing `identity:get_project(project_id=011d2f62fb8f4bf5929502923e4b4155)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:10.493382 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233be4e2-0a31-4749-83aa-97631ed7b9d9 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:10.495128 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 548/1116] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:49:10 2022] GET /identity/v3/projects/011d2f62fb8f4bf5929502923e4b4155 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:10.501476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945db9b-c9b6-45b5-a12d-9229160b18f0 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:10.598604 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945db9b-c9b6-45b5-a12d-9229160b18f0 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:10.632872 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956fdb3-28aa-4f56-bb95-0f29d834ede2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:10.633557 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956fdb3-28aa-4f56-bb95-0f29d834ede2 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:10.633849 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956fdb3-28aa-4f56-bb95-0f29d834ede2 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:10.634133 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956fdb3-28aa-4f56-bb95-0f29d834ede2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:10.634953 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7956fdb3-28aa-4f56-bb95-0f29d834ede2 None admin] RBAC: Adding query filter params (role.id=c2117c810f7b4e6aaf684c3d37b0ea3e, scope.project.id=011d2f62fb8f4bf5929502923e4b4155, user.id=c0e3b136c90f46e397d2ce88d2acce0a) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:49:10.635273 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7956fdb3-28aa-4f56-bb95-0f29d834ede2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:10.636730 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7956fdb3-28aa-4f56-bb95-0f29d834ede2 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:10.642103 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 569/1117] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:49:10 2022] GET /identity/v3/role_assignments?user.id=c0e3b136c90f46e397d2ce88d2acce0a&scope.project.id=011d2f62fb8f4bf5929502923e4b4155&role.id=c2117c810f7b4e6aaf684c3d37b0ea3e => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:12.633227 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b7313-8aff-4a71-b41e-c7805d9f1283 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:12.633852 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b7313-8aff-4a71-b41e-c7805d9f1283 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:12.633953 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b7313-8aff-4a71-b41e-c7805d9f1283 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:12.636042 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 549/1118] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:49:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:49:12.641403 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98df5d9-9e72-4eb6-9573-ebd1184ddf43 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:12.641865 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98df5d9-9e72-4eb6-9573-ebd1184ddf43 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:12.641966 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98df5d9-9e72-4eb6-9573-ebd1184ddf43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:12.659289 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-a98df5d9-9e72-4eb6-9573-ebd1184ddf43 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:49:12.660520 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a98df5d9-9e72-4eb6-9573-ebd1184ddf43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:49:12.662496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:12.726240 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 570/1119] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:49:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:49:12.748563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b7313-8aff-4a71-b41e-c7805d9f1283 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:12.794218 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:12.846606 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b7313-8aff-4a71-b41e-c7805d9f1283 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:12.879002 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a49174-4cef-4f6c-a440-fe1b5caf907a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:12.879850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a49174-4cef-4f6c-a440-fe1b5caf907a None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:12.880164 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a49174-4cef-4f6c-a440-fe1b5caf907a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:12.880441 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a49174-4cef-4f6c-a440-fe1b5caf907a None admin] PATH_INFO: `/v3/roles/c2117c810f7b4e6aaf684c3d37b0ea3e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:12.881880 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a49174-4cef-4f6c-a440-fe1b5caf907a None admin] RBAC: Authorizing `identity:get_role(role_id=c2117c810f7b4e6aaf684c3d37b0ea3e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:12.883806 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a49174-4cef-4f6c-a440-fe1b5caf907a None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:12.885123 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 550/1120] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:49:12 2022] GET /identity/v3/roles/c2117c810f7b4e6aaf684c3d37b0ea3e => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:12.890858 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98df5d9-9e72-4eb6-9573-ebd1184ddf43 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:12.988559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98df5d9-9e72-4eb6-9573-ebd1184ddf43 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:13.021808 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777443e-5afa-43b7-894b-b87e7cea2c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:13.022670 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777443e-5afa-43b7-894b-b87e7cea2c66 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:13.023122 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777443e-5afa-43b7-894b-b87e7cea2c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:13.023504 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777443e-5afa-43b7-894b-b87e7cea2c66 None admin] PATH_INFO: `/v3/users/c0e3b136c90f46e397d2ce88d2acce0a` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:13.024723 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777443e-5afa-43b7-894b-b87e7cea2c66 None admin] RBAC: Authorizing `identity:get_user(user_id=c0e3b136c90f46e397d2ce88d2acce0a)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:13.026165 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777443e-5afa-43b7-894b-b87e7cea2c66 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:13.027786 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 571/1121] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:49:12 2022] GET /identity/v3/users/c0e3b136c90f46e397d2ce88d2acce0a => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:13.033536 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a49174-4cef-4f6c-a440-fe1b5caf907a None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:13.129597 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a49174-4cef-4f6c-a440-fe1b5caf907a None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:13.142146 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:13.161763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4787b98-1056-4908-a425-2f7bec73e6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:13.162610 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4787b98-1056-4908-a425-2f7bec73e6b4 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:13.162893 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4787b98-1056-4908-a425-2f7bec73e6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:13.163261 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4787b98-1056-4908-a425-2f7bec73e6b4 None admin] PATH_INFO: `/v3/projects/011d2f62fb8f4bf5929502923e4b4155` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:13.165248 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4787b98-1056-4908-a425-2f7bec73e6b4 None admin] RBAC: Authorizing `identity:get_project(project_id=011d2f62fb8f4bf5929502923e4b4155)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:13.166657 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4787b98-1056-4908-a425-2f7bec73e6b4 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:13.168331 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 551/1122] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:49:13 2022] GET /identity/v3/projects/011d2f62fb8f4bf5929502923e4b4155 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:13.174432 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777443e-5afa-43b7-894b-b87e7cea2c66 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:13.183195 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:13.270382 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777443e-5afa-43b7-894b-b87e7cea2c66 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:13.303289 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7725774-3756-492b-b4fd-a448559dacef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:13.304199 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7725774-3756-492b-b4fd-a448559dacef None admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:13.304613 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7725774-3756-492b-b4fd-a448559dacef None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:13.304901 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7725774-3756-492b-b4fd-a448559dacef None admin] PATH_INFO: `/v3/projects/011d2f62fb8f4bf5929502923e4b4155/users/c0e3b136c90f46e397d2ce88d2acce0a/roles/c2117c810f7b4e6aaf684c3d37b0ea3e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:13.307079 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7725774-3756-492b-b4fd-a448559dacef None admin] RBAC: Authorizing `identity:create_grant(project_id=011d2f62fb8f4bf5929502923e4b4155, user_id=c0e3b136c90f46e397d2ce88d2acce0a, role_id=c2117c810f7b4e6aaf684c3d37b0ea3e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:13.308536 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7725774-3756-492b-b4fd-a448559dacef None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:13.364995 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 572/1123] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 11 20:49:13 2022] PUT /identity/v3/projects/011d2f62fb8f4bf5929502923e4b4155/users/c0e3b136c90f46e397d2ce88d2acce0a/roles/c2117c810f7b4e6aaf684c3d37b0ea3e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:49:15.364913 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1a29f-e5c8-4d47-bd52-0d3d9ab4badb None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:15.365459 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1a29f-e5c8-4d47-bd52-0d3d9ab4badb None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:15.365459 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1a29f-e5c8-4d47-bd52-0d3d9ab4badb None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:15.366833 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 552/1124] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:49:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:49:15.372126 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036b017-4d45-43e1-8dba-4b37ba664332 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:15.372509 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036b017-4d45-43e1-8dba-4b37ba664332 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:15.372703 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036b017-4d45-43e1-8dba-4b37ba664332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:15.390395 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-4036b017-4d45-43e1-8dba-4b37ba664332 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:49:15.391587 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-4036b017-4d45-43e1-8dba-4b37ba664332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:49:15.450447 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:15.457697 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 573/1125] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:49:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:49:15.481363 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1a29f-e5c8-4d47-bd52-0d3d9ab4badb None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:15.580966 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1a29f-e5c8-4d47-bd52-0d3d9ab4badb None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:15.613098 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c856ffe-7198-4045-9d46-8b5af2f48cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:15.613951 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c856ffe-7198-4045-9d46-8b5af2f48cfe None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:15.614236 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c856ffe-7198-4045-9d46-8b5af2f48cfe None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:15.614510 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c856ffe-7198-4045-9d46-8b5af2f48cfe None admin] PATH_INFO: `/v3/roles/c2117c810f7b4e6aaf684c3d37b0ea3e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:15.616038 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c856ffe-7198-4045-9d46-8b5af2f48cfe None admin] RBAC: Authorizing `identity:get_role(role_id=c2117c810f7b4e6aaf684c3d37b0ea3e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:15.617863 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c856ffe-7198-4045-9d46-8b5af2f48cfe None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:15.619203 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 553/1126] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:49:15 2022] GET /identity/v3/roles/c2117c810f7b4e6aaf684c3d37b0ea3e => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:15.624970 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4036b017-4d45-43e1-8dba-4b37ba664332 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:15.720690 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4036b017-4d45-43e1-8dba-4b37ba664332 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:15.753087 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d37b59-6e83-4709-9b09-3b60dab53511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:15.753954 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d37b59-6e83-4709-9b09-3b60dab53511 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:15.754241 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d37b59-6e83-4709-9b09-3b60dab53511 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:15.754515 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d37b59-6e83-4709-9b09-3b60dab53511 None admin] PATH_INFO: `/v3/users/c0e3b136c90f46e397d2ce88d2acce0a` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:15.755683 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d37b59-6e83-4709-9b09-3b60dab53511 None admin] RBAC: Authorizing `identity:get_user(user_id=c0e3b136c90f46e397d2ce88d2acce0a)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:15.757845 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d37b59-6e83-4709-9b09-3b60dab53511 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:15.759538 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 574/1127] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:49:15 2022] GET /identity/v3/users/c0e3b136c90f46e397d2ce88d2acce0a => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:15.765265 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c856ffe-7198-4045-9d46-8b5af2f48cfe None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:15.813290 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:15.863018 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c856ffe-7198-4045-9d46-8b5af2f48cfe None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:15.896410 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fd7dcc-9d6a-497d-8e55-a0f2de2129e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:15.896998 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd7dcc-9d6a-497d-8e55-a0f2de2129e1 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:15.897286 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd7dcc-9d6a-497d-8e55-a0f2de2129e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:15.897567 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd7dcc-9d6a-497d-8e55-a0f2de2129e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:15.961899 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fd7dcc-9d6a-497d-8e55-a0f2de2129e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:15.963321 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fd7dcc-9d6a-497d-8e55-a0f2de2129e1 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:16.009579 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:16.059204 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 554/1128] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:49:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 20:49:16.065019 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d37b59-6e83-4709-9b09-3b60dab53511 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:16.124556 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:16.163689 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d37b59-6e83-4709-9b09-3b60dab53511 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:16.196937 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c43b6-fa4f-400c-9edc-d9139f35b119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:16.197790 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c43b6-fa4f-400c-9edc-d9139f35b119 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:16.198081 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c43b6-fa4f-400c-9edc-d9139f35b119 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:16.198364 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c43b6-fa4f-400c-9edc-d9139f35b119 None admin] PATH_INFO: `/v3/projects/011d2f62fb8f4bf5929502923e4b4155` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:16.199539 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c43b6-fa4f-400c-9edc-d9139f35b119 None admin] RBAC: Authorizing `identity:get_project(project_id=011d2f62fb8f4bf5929502923e4b4155)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:16.201025 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c43b6-fa4f-400c-9edc-d9139f35b119 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:16.202721 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 575/1129] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:49:16 2022] GET /identity/v3/projects/011d2f62fb8f4bf5929502923e4b4155 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:16.208934 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fd7dcc-9d6a-497d-8e55-a0f2de2129e1 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:16.305530 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fd7dcc-9d6a-497d-8e55-a0f2de2129e1 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:16.338158 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de9d41-83ee-4f99-9d96-5574dbbf90ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:16.338805 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de9d41-83ee-4f99-9d96-5574dbbf90ea None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:16.339093 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de9d41-83ee-4f99-9d96-5574dbbf90ea None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:16.339372 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de9d41-83ee-4f99-9d96-5574dbbf90ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:16.340342 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de9d41-83ee-4f99-9d96-5574dbbf90ea None admin] RBAC: Adding query filter params (role.id=c2117c810f7b4e6aaf684c3d37b0ea3e, scope.project.id=011d2f62fb8f4bf5929502923e4b4155, user.id=c0e3b136c90f46e397d2ce88d2acce0a) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:49:16.340662 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de9d41-83ee-4f99-9d96-5574dbbf90ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:16.342076 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de9d41-83ee-4f99-9d96-5574dbbf90ea None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:16.347711 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 555/1130] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:49:16 2022] GET /identity/v3/role_assignments?user.id=c0e3b136c90f46e397d2ce88d2acce0a&scope.project.id=011d2f62fb8f4bf5929502923e4b4155&role.id=c2117c810f7b4e6aaf684c3d37b0ea3e => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:18.379250 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8dc81-da15-4b8c-b3f1-0a7559e708b3 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:18.379808 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8dc81-da15-4b8c-b3f1-0a7559e708b3 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:18.379808 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8dc81-da15-4b8c-b3f1-0a7559e708b3 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:18.381227 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 576/1131] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:49:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:49:18.386992 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c5ce5-9d1e-448b-8256-fe75cf54cb21 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:18.387415 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c5ce5-9d1e-448b-8256-fe75cf54cb21 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:18.387547 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c5ce5-9d1e-448b-8256-fe75cf54cb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:18.404402 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-f14c5ce5-9d1e-448b-8256-fe75cf54cb21 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:49:18.405578 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-f14c5ce5-9d1e-448b-8256-fe75cf54cb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:49:18.412559 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:18.470390 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 556/1132] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:49:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:49:18.497016 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8dc81-da15-4b8c-b3f1-0a7559e708b3 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:18.596991 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8dc81-da15-4b8c-b3f1-0a7559e708b3 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:18.625375 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:18.630300 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4f082-7a6c-4d71-ab61-532b91a3971f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:18.631034 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4f082-7a6c-4d71-ab61-532b91a3971f None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:18.631322 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4f082-7a6c-4d71-ab61-532b91a3971f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:18.631600 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4f082-7a6c-4d71-ab61-532b91a3971f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:18.632946 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a4f082-7a6c-4d71-ab61-532b91a3971f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:18.636105 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a4f082-7a6c-4d71-ab61-532b91a3971f None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:18.636105 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 577/1133] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:49:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:18.641836 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c5ce5-9d1e-448b-8256-fe75cf54cb21 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:18.737479 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c5ce5-9d1e-448b-8256-fe75cf54cb21 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:18.769783 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631504e1-eb6d-4486-b6bf-51f445673bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:18.770437 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631504e1-eb6d-4486-b6bf-51f445673bde None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:18.770719 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631504e1-eb6d-4486-b6bf-51f445673bde None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:18.770993 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631504e1-eb6d-4486-b6bf-51f445673bde None admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:18.771692 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631504e1-eb6d-4486-b6bf-51f445673bde None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:18.773715 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631504e1-eb6d-4486-b6bf-51f445673bde None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:18.786067 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:18.847915 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 557/1134] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Jul 11 20:49:18 2022] POST /identity/v3/projects => generated 311 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:49:20.897375 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021f963-c6d6-4992-89bb-a5c96e0b16c3 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:20.897966 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021f963-c6d6-4992-89bb-a5c96e0b16c3 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:20.897966 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021f963-c6d6-4992-89bb-a5c96e0b16c3 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:20.899365 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 578/1135] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:49:20.904401 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf540f-cd09-4ac8-8182-bfadd17e9136 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:20.904802 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf540f-cd09-4ac8-8182-bfadd17e9136 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:20.904980 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf540f-cd09-4ac8-8182-bfadd17e9136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:20.921716 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-b4bf540f-cd09-4ac8-8182-bfadd17e9136 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:49:20.922856 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b4bf540f-cd09-4ac8-8182-bfadd17e9136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:49:20.987289 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 558/1136] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:49:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:49:21.013432 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a021f963-c6d6-4992-89bb-a5c96e0b16c3 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:21.111542 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a021f963-c6d6-4992-89bb-a5c96e0b16c3 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:21.144310 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772c575-ccff-47c0-bc07-3d03d32e81dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:21.145091 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772c575-ccff-47c0-bc07-3d03d32e81dc None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:21.145377 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772c575-ccff-47c0-bc07-3d03d32e81dc None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:21.145655 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772c575-ccff-47c0-bc07-3d03d32e81dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:21.146821 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1772c575-ccff-47c0-bc07-3d03d32e81dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:21.148530 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1772c575-ccff-47c0-bc07-3d03d32e81dc None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:21.150124 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 579/1137] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:49:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:21.155616 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf540f-cd09-4ac8-8182-bfadd17e9136 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:21.251513 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf540f-cd09-4ac8-8182-bfadd17e9136 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:21.274321 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:21.284516 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248fa4a4-ec18-4af6-849f-f1c6d95d49df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:21.285699 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fa4a4-ec18-4af6-849f-f1c6d95d49df None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:21.285699 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fa4a4-ec18-4af6-849f-f1c6d95d49df None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:21.285699 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fa4a4-ec18-4af6-849f-f1c6d95d49df None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:21.286419 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248fa4a4-ec18-4af6-849f-f1c6d95d49df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:21.287838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248fa4a4-ec18-4af6-849f-f1c6d95d49df None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:21.407038 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 559/1138] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jul 11 20:49:21 2022] POST /identity/v3/users => generated 286 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:49:23.455932 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6b42c-a0da-4256-866e-a693759094e0 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:23.456513 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6b42c-a0da-4256-866e-a693759094e0 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:23.456513 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6b42c-a0da-4256-866e-a693759094e0 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:23.457889 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 580/1139] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:49:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:49:23.463669 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0723c7a-46ef-426a-8a79-d3d835d1af86 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:23.464076 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0723c7a-46ef-426a-8a79-d3d835d1af86 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:23.464260 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0723c7a-46ef-426a-8a79-d3d835d1af86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:23.480591 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-b0723c7a-46ef-426a-8a79-d3d835d1af86 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:49:23.481764 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b0723c7a-46ef-426a-8a79-d3d835d1af86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:49:23.545495 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 560/1140] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:49:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:49:23.568199 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6b42c-a0da-4256-866e-a693759094e0 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:23.634659 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:23.667769 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6b42c-a0da-4256-866e-a693759094e0 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:23.700909 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70966ca-19db-49c8-a33f-2cf3da008043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:23.701692 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70966ca-19db-49c8-a33f-2cf3da008043 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:23.701976 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70966ca-19db-49c8-a33f-2cf3da008043 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:23.702253 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70966ca-19db-49c8-a33f-2cf3da008043 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:23.712004 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70966ca-19db-49c8-a33f-2cf3da008043 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:49:23.719440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-c70966ca-19db-49c8-a33f-2cf3da008043 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:49:23.719440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:49:23.719440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:49:23.719440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:49:23.719440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:49:23.719440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:49:23.719440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:49:23.719440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:49:23.719440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:49:23.719440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:49:23.719440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:49:23.719440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:49:23.719440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:49:23.719440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:49:23.719440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:49:23.719440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:49:23.720634 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:49:23.720634 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:49:23.720634 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:49:23.720634 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:49:23.720634 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:49:23.720634 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:49:23.720634 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:49:23.720634 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:49:23.720634 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:49:23.720634 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:49:23.720634 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:49:23.720634 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:49:23.720634 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:49:23.720634 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:49:23.720634 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:49:23.720634 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:49:23.721910 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:49:23.721910 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:49:23.721910 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:49:23.721910 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:49:23.721910 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:49:23.721910 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:49:23.721910 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:49:23.721910 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:49:23.721910 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:49:23.721910 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:49:23.721910 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:49:23.721910 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:49:23.721910 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 581/1141] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 11 20:49:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:49:23.726772 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0723c7a-46ef-426a-8a79-d3d835d1af86 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:23.823413 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0723c7a-46ef-426a-8a79-d3d835d1af86 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:23.833810 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:23.856329 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a7051-ee1d-4819-8138-d1be594497ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:23.857021 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a7051-ee1d-4819-8138-d1be594497ae None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:23.857307 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a7051-ee1d-4819-8138-d1be594497ae None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:23.857598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a7051-ee1d-4819-8138-d1be594497ae None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:23.858544 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a7051-ee1d-4819-8138-d1be594497ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:49:23.859030 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a7051-ee1d-4819-8138-d1be594497ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:23.860918 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a7051-ee1d-4819-8138-d1be594497ae None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:23.869300 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 561/1142] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:49:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:23.875099 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70966ca-19db-49c8-a33f-2cf3da008043 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:23.972532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70966ca-19db-49c8-a33f-2cf3da008043 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:23.997469 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:24.005138 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b5690-f99f-4664-a8cd-4890e51c764a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:24.008117 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b5690-f99f-4664-a8cd-4890e51c764a None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:24.008117 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b5690-f99f-4664-a8cd-4890e51c764a None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:24.008117 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b5690-f99f-4664-a8cd-4890e51c764a None admin] PATH_INFO: `/v3/users/374011df16024ac6a4c35a038d239723` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:24.019663 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b5690-f99f-4664-a8cd-4890e51c764a None admin] RBAC: Authorizing `identity:get_user(user_id=374011df16024ac6a4c35a038d239723)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:24.021214 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b5690-f99f-4664-a8cd-4890e51c764a None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:24.022893 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 582/1143] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:49:23 2022] GET /identity/v3/users/374011df16024ac6a4c35a038d239723 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:24.028586 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a7051-ee1d-4819-8138-d1be594497ae None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:24.125395 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a7051-ee1d-4819-8138-d1be594497ae None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:24.157753 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e429ac-19f1-4532-a6a0-6f09dda9e37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:24.158397 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e429ac-19f1-4532-a6a0-6f09dda9e37a None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:24.158687 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e429ac-19f1-4532-a6a0-6f09dda9e37a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:24.158968 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e429ac-19f1-4532-a6a0-6f09dda9e37a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:24.199019 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:24.224196 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e429ac-19f1-4532-a6a0-6f09dda9e37a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:24.226211 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e429ac-19f1-4532-a6a0-6f09dda9e37a None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:24.320934 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 562/1144] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:49:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 20:49:24.326730 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b5690-f99f-4664-a8cd-4890e51c764a None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:24.423080 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b5690-f99f-4664-a8cd-4890e51c764a None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:24.455311 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab73367-4eb1-48c5-b59d-1b6c17f6cecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:24.456191 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab73367-4eb1-48c5-b59d-1b6c17f6cecd None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:24.456730 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab73367-4eb1-48c5-b59d-1b6c17f6cecd None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:24.456730 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab73367-4eb1-48c5-b59d-1b6c17f6cecd None admin] PATH_INFO: `/v3/projects/efa48662cf5740ca8379d47d526f28ce` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:24.457877 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab73367-4eb1-48c5-b59d-1b6c17f6cecd None admin] RBAC: Authorizing `identity:get_project(project_id=efa48662cf5740ca8379d47d526f28ce)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:24.459311 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab73367-4eb1-48c5-b59d-1b6c17f6cecd None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:24.461536 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 583/1145] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:49:24 2022] GET /identity/v3/projects/efa48662cf5740ca8379d47d526f28ce => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:24.467547 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e429ac-19f1-4532-a6a0-6f09dda9e37a None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:24.535512 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:24.564199 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e429ac-19f1-4532-a6a0-6f09dda9e37a None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:24.597570 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c090b-22a9-4fde-a82e-de736e7b55ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:24.598218 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c090b-22a9-4fde-a82e-de736e7b55ce None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:24.598510 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c090b-22a9-4fde-a82e-de736e7b55ce None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:24.598791 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c090b-22a9-4fde-a82e-de736e7b55ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:24.599621 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c090b-22a9-4fde-a82e-de736e7b55ce None admin] RBAC: Adding query filter params (role.id=86273ff072f3438d822e870272491768, scope.project.id=efa48662cf5740ca8379d47d526f28ce, user.id=374011df16024ac6a4c35a038d239723) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:49:24.599942 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c090b-22a9-4fde-a82e-de736e7b55ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:24.601475 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c090b-22a9-4fde-a82e-de736e7b55ce None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:24.606795 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 563/1146] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:49:24 2022] GET /identity/v3/role_assignments?user.id=374011df16024ac6a4c35a038d239723&scope.project.id=efa48662cf5740ca8379d47d526f28ce&role.id=86273ff072f3438d822e870272491768 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:26.592444 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5913d65-575d-4441-b7ba-7d1551e0fe0d None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:26.593002 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5913d65-575d-4441-b7ba-7d1551e0fe0d None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:26.593002 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5913d65-575d-4441-b7ba-7d1551e0fe0d None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:26.594372 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 584/1147] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:49:26.599472 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd736f-bf0a-40e6-abd4-3a9c105f8e1c None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:26.599908 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd736f-bf0a-40e6-abd4-3a9c105f8e1c None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:26.600053 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd736f-bf0a-40e6-abd4-3a9c105f8e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:26.617604 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-3cdd736f-bf0a-40e6-abd4-3a9c105f8e1c None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:49:26.618782 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-3cdd736f-bf0a-40e6-abd4-3a9c105f8e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:49:26.684350 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 564/1148] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:49:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:49:26.706388 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5913d65-575d-4441-b7ba-7d1551e0fe0d None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:26.761942 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:26.811085 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5913d65-575d-4441-b7ba-7d1551e0fe0d None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:26.851002 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72442e2-7b98-4260-bed1-6326ee4edea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:26.851721 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72442e2-7b98-4260-bed1-6326ee4edea0 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:26.852033 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72442e2-7b98-4260-bed1-6326ee4edea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:26.852310 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72442e2-7b98-4260-bed1-6326ee4edea0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:26.862230 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72442e2-7b98-4260-bed1-6326ee4edea0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:49:26.870476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-a72442e2-7b98-4260-bed1-6326ee4edea0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:49:26.870476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:49:26.870476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:49:26.870476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:49:26.870476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:49:26.870476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:49:26.870476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:49:26.870476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:49:26.870476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:49:26.870476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:49:26.870476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:49:26.870476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:49:26.870476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:49:26.870476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:49:26.870476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:49:26.870476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:49:26.871576 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:49:26.871576 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:49:26.871576 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:49:26.871576 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:49:26.871576 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:49:26.871576 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:49:26.871576 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:49:26.871576 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:49:26.871576 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:49:26.871576 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:49:26.871576 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:49:26.871576 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:49:26.871576 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:49:26.871576 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:49:26.871576 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:49:26.871576 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:49:26.872639 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:49:26.872639 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:49:26.872639 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:49:26.872639 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:49:26.872639 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:49:26.872639 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:49:26.872639 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:49:26.872639 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:49:26.872639 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:49:26.872639 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:49:26.872639 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:49:26.872639 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:49:26.872639 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 585/1149] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 11 20:49:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:49:26.878238 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd736f-bf0a-40e6-abd4-3a9c105f8e1c None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:26.940731 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:26.973823 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd736f-bf0a-40e6-abd4-3a9c105f8e1c None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:27.007580 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f67ec7-0140-4537-b76f-4321266854cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:27.008262 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f67ec7-0140-4537-b76f-4321266854cd None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:27.008547 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f67ec7-0140-4537-b76f-4321266854cd None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:27.008821 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f67ec7-0140-4537-b76f-4321266854cd None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:27.009557 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f67ec7-0140-4537-b76f-4321266854cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:49:27.009865 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f67ec7-0140-4537-b76f-4321266854cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:27.011216 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f67ec7-0140-4537-b76f-4321266854cd None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:27.018991 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 565/1150] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:49:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:27.025506 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72442e2-7b98-4260-bed1-6326ee4edea0 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:27.124283 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72442e2-7b98-4260-bed1-6326ee4edea0 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:27.138522 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:27.162508 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc893c8-b33f-4fe6-ac71-8fb9c629d618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:27.163480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc893c8-b33f-4fe6-ac71-8fb9c629d618 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:27.163770 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc893c8-b33f-4fe6-ac71-8fb9c629d618 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:27.164081 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc893c8-b33f-4fe6-ac71-8fb9c629d618 None admin] PATH_INFO: `/v3/users/374011df16024ac6a4c35a038d239723` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:27.165263 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc893c8-b33f-4fe6-ac71-8fb9c629d618 None admin] RBAC: Authorizing `identity:get_user(user_id=374011df16024ac6a4c35a038d239723)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:27.166695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc893c8-b33f-4fe6-ac71-8fb9c629d618 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:27.168351 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 586/1151] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:49:27 2022] GET /identity/v3/users/374011df16024ac6a4c35a038d239723 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:27.174143 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f67ec7-0140-4537-b76f-4321266854cd None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:27.270794 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f67ec7-0140-4537-b76f-4321266854cd None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:27.295957 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:27.303428 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30fc1a-8662-4ed2-9dfa-b236957c0257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:27.306415 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30fc1a-8662-4ed2-9dfa-b236957c0257 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:27.306415 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30fc1a-8662-4ed2-9dfa-b236957c0257 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:27.306415 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30fc1a-8662-4ed2-9dfa-b236957c0257 None admin] PATH_INFO: `/v3/projects/efa48662cf5740ca8379d47d526f28ce` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:27.306415 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30fc1a-8662-4ed2-9dfa-b236957c0257 None admin] RBAC: Authorizing `identity:get_project(project_id=efa48662cf5740ca8379d47d526f28ce)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:27.307492 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30fc1a-8662-4ed2-9dfa-b236957c0257 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:27.309192 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 566/1152] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:49:27 2022] GET /identity/v3/projects/efa48662cf5740ca8379d47d526f28ce => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:27.315015 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc893c8-b33f-4fe6-ac71-8fb9c629d618 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:27.412245 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc893c8-b33f-4fe6-ac71-8fb9c629d618 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:27.446694 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900d2f2-9adb-44c2-a457-81b0c9e4a341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:27.447587 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900d2f2-9adb-44c2-a457-81b0c9e4a341 None admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:27.447874 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900d2f2-9adb-44c2-a457-81b0c9e4a341 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:27.448190 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900d2f2-9adb-44c2-a457-81b0c9e4a341 None admin] PATH_INFO: `/v3/projects/efa48662cf5740ca8379d47d526f28ce/users/374011df16024ac6a4c35a038d239723/roles/86273ff072f3438d822e870272491768` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:27.450131 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900d2f2-9adb-44c2-a457-81b0c9e4a341 None admin] RBAC: Authorizing `identity:create_grant(project_id=efa48662cf5740ca8379d47d526f28ce, user_id=374011df16024ac6a4c35a038d239723, role_id=86273ff072f3438d822e870272491768)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:27.451556 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900d2f2-9adb-44c2-a457-81b0c9e4a341 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:27.536302 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 587/1153] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 11 20:49:27 2022] PUT /identity/v3/projects/efa48662cf5740ca8379d47d526f28ce/users/374011df16024ac6a4c35a038d239723/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:49:29.517779 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25d2b8-6754-4dd6-b880-9af36002d587 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:29.518335 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25d2b8-6754-4dd6-b880-9af36002d587 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:29.518335 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25d2b8-6754-4dd6-b880-9af36002d587 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:29.519689 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 567/1154] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:49:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:49:29.525765 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77dbec4-6c14-4f37-a6bb-5f465574ac39 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:29.526140 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77dbec4-6c14-4f37-a6bb-5f465574ac39 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:29.526342 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77dbec4-6c14-4f37-a6bb-5f465574ac39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:29.542797 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-e77dbec4-6c14-4f37-a6bb-5f465574ac39 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:49:29.544014 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-e77dbec4-6c14-4f37-a6bb-5f465574ac39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:49:29.578597 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:29.608880 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 588/1155] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:49:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:49:29.633143 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a25d2b8-6754-4dd6-b880-9af36002d587 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:29.732060 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a25d2b8-6754-4dd6-b880-9af36002d587 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:29.764727 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb16a0-b1ad-42b7-8f0b-dc0a5936c9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:29.765513 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb16a0-b1ad-42b7-8f0b-dc0a5936c9b0 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:29.765795 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb16a0-b1ad-42b7-8f0b-dc0a5936c9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:29.766067 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb16a0-b1ad-42b7-8f0b-dc0a5936c9b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:29.776231 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb16a0-b1ad-42b7-8f0b-dc0a5936c9b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:49:29.783862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-80cb16a0-b1ad-42b7-8f0b-dc0a5936c9b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:49:29.783862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:49:29.783862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:49:29.783862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:49:29.783862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:49:29.783862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:49:29.783862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:49:29.783862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:49:29.783862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:49:29.783862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:49:29.783862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:49:29.783862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:49:29.783862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:49:29.783862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:49:29.783862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:49:29.783862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:49:29.784994 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:49:29.784994 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:49:29.784994 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:49:29.784994 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:49:29.784994 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:49:29.784994 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:49:29.784994 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:49:29.784994 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:49:29.784994 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:49:29.784994 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:49:29.784994 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:49:29.784994 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:49:29.784994 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:49:29.784994 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:49:29.784994 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:49:29.784994 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:49:29.786036 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:49:29.786036 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:49:29.786036 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:49:29.786036 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:49:29.786036 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:49:29.786036 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:49:29.786036 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:49:29.786036 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:49:29.786036 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:49:29.786036 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:49:29.786036 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:49:29.786036 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:49:29.786036 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 568/1156] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 11 20:49:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:49:29.791057 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77dbec4-6c14-4f37-a6bb-5f465574ac39 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:29.886568 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77dbec4-6c14-4f37-a6bb-5f465574ac39 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:29.918984 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65f319-1dc7-40d3-8b0b-a8c6f9481f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:29.919650 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65f319-1dc7-40d3-8b0b-a8c6f9481f8d None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:29.919959 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65f319-1dc7-40d3-8b0b-a8c6f9481f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:29.920250 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65f319-1dc7-40d3-8b0b-a8c6f9481f8d None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:29.920993 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a65f319-1dc7-40d3-8b0b-a8c6f9481f8d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:49:29.921306 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a65f319-1dc7-40d3-8b0b-a8c6f9481f8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:29.922669 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a65f319-1dc7-40d3-8b0b-a8c6f9481f8d None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:29.931097 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 589/1157] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:49:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:29.936841 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb16a0-b1ad-42b7-8f0b-dc0a5936c9b0 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:29.993670 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:30.037325 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb16a0-b1ad-42b7-8f0b-dc0a5936c9b0 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:30.072068 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db0a13-32f9-44d4-b52e-707752b6ffb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:30.072935 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db0a13-32f9-44d4-b52e-707752b6ffb8 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:30.073226 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db0a13-32f9-44d4-b52e-707752b6ffb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:30.073510 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db0a13-32f9-44d4-b52e-707752b6ffb8 None admin] PATH_INFO: `/v3/users/374011df16024ac6a4c35a038d239723` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:30.074687 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db0a13-32f9-44d4-b52e-707752b6ffb8 None admin] RBAC: Authorizing `identity:get_user(user_id=374011df16024ac6a4c35a038d239723)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:30.076157 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db0a13-32f9-44d4-b52e-707752b6ffb8 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:30.077762 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 569/1158] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:49:29 2022] GET /identity/v3/users/374011df16024ac6a4c35a038d239723 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:30.083483 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65f319-1dc7-40d3-8b0b-a8c6f9481f8d None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:30.117627 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:30.181163 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65f319-1dc7-40d3-8b0b-a8c6f9481f8d None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:30.213884 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964d548-6244-417c-8c83-e5a7c9f898d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:30.214520 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964d548-6244-417c-8c83-e5a7c9f898d5 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:30.214804 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964d548-6244-417c-8c83-e5a7c9f898d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:30.215078 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964d548-6244-417c-8c83-e5a7c9f898d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:30.280776 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964d548-6244-417c-8c83-e5a7c9f898d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:30.282217 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964d548-6244-417c-8c83-e5a7c9f898d5 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:30.314273 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:30.377525 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 590/1159] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:49:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 20:49:30.383476 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db0a13-32f9-44d4-b52e-707752b6ffb8 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:30.479657 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db0a13-32f9-44d4-b52e-707752b6ffb8 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:30.502212 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:30.512890 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14de0b9-f62b-42a8-84be-b6038eb17f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:30.513798 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14de0b9-f62b-42a8-84be-b6038eb17f06 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:30.514078 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14de0b9-f62b-42a8-84be-b6038eb17f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:30.514357 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14de0b9-f62b-42a8-84be-b6038eb17f06 None admin] PATH_INFO: `/v3/projects/efa48662cf5740ca8379d47d526f28ce` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:30.515511 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14de0b9-f62b-42a8-84be-b6038eb17f06 None admin] RBAC: Authorizing `identity:get_project(project_id=efa48662cf5740ca8379d47d526f28ce)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:30.516958 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14de0b9-f62b-42a8-84be-b6038eb17f06 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:30.518631 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 570/1160] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:49:30 2022] GET /identity/v3/projects/efa48662cf5740ca8379d47d526f28ce => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:30.525382 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964d548-6244-417c-8c83-e5a7c9f898d5 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:30.620320 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964d548-6244-417c-8c83-e5a7c9f898d5 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:30.652403 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888dfb94-814a-4c2e-b5bd-b3001c049b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:30.653060 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888dfb94-814a-4c2e-b5bd-b3001c049b93 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:30.653345 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888dfb94-814a-4c2e-b5bd-b3001c049b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:30.653623 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888dfb94-814a-4c2e-b5bd-b3001c049b93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:30.654441 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888dfb94-814a-4c2e-b5bd-b3001c049b93 None admin] RBAC: Adding query filter params (role.id=86273ff072f3438d822e870272491768, scope.project.id=efa48662cf5740ca8379d47d526f28ce, user.id=374011df16024ac6a4c35a038d239723) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:49:30.654755 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888dfb94-814a-4c2e-b5bd-b3001c049b93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:30.656202 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888dfb94-814a-4c2e-b5bd-b3001c049b93 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:30.658055 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:30.662624 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 591/1161] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:49:30 2022] GET /identity/v3/role_assignments?user.id=374011df16024ac6a4c35a038d239723&scope.project.id=efa48662cf5740ca8379d47d526f28ce&role.id=86273ff072f3438d822e870272491768 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:32.696640 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677cfa7-3833-407e-94c5-7379472c609d None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:32.697086 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677cfa7-3833-407e-94c5-7379472c609d None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:32.697202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677cfa7-3833-407e-94c5-7379472c609d None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:32.698583 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 571/1162] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:49:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:49:32.703874 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a3bef-ff2b-4c76-b0ac-e5fabdb21923 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:32.704283 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a3bef-ff2b-4c76-b0ac-e5fabdb21923 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:32.704462 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a3bef-ff2b-4c76-b0ac-e5fabdb21923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:32.721534 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-613a3bef-ff2b-4c76-b0ac-e5fabdb21923 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:49:32.722727 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-613a3bef-ff2b-4c76-b0ac-e5fabdb21923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:49:32.787320 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 592/1163] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:49:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:49:32.809456 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677cfa7-3833-407e-94c5-7379472c609d None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:32.907570 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677cfa7-3833-407e-94c5-7379472c609d None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:32.940172 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b671d1-5b7b-4efd-832f-23793a24f4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:32.940752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b671d1-5b7b-4efd-832f-23793a24f4a5 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:32.941038 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b671d1-5b7b-4efd-832f-23793a24f4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:32.941321 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b671d1-5b7b-4efd-832f-23793a24f4a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:32.998058 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:33.007787 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b671d1-5b7b-4efd-832f-23793a24f4a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:33.009291 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b671d1-5b7b-4efd-832f-23793a24f4a5 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:33.103572 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 572/1164] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:49:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 20:49:33.109563 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a3bef-ff2b-4c76-b0ac-e5fabdb21923 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:33.205575 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a3bef-ff2b-4c76-b0ac-e5fabdb21923 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:33.231653 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:33.239208 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1509f0d-3ce8-4063-89c7-ff9be202026c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:33.244988 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1509f0d-3ce8-4063-89c7-ff9be202026c None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:33.244988 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1509f0d-3ce8-4063-89c7-ff9be202026c None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:33.244988 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1509f0d-3ce8-4063-89c7-ff9be202026c None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:33.247241 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1509f0d-3ce8-4063-89c7-ff9be202026c None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:33.248723 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1509f0d-3ce8-4063-89c7-ff9be202026c None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:33.264232 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-c1509f0d-3ce8-4063-89c7-ff9be202026c None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 11 20:49:33.264232 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:49:33.264232 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 11 20:49:33.264232 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 11 20:49:33.264232 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:49:33.264232 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:49:33.264232 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:49:33.264232 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:49:33.264232 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 11 20:49:33.264232 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:49:33.264232 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:49:33.264232 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:49:33.264232 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:49:33.264232 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:49:33.264232 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:49:33.264232 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:49:33.264232 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:49:33.265454 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:49:33.265454 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:49:33.265454 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:49:33.265454 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:49:33.265454 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:49:33.265454 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:49:33.265454 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:49:33.265454 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:49:33.265454 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:49:33.265454 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:49:33.265454 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:49:33.265454 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:49:33.265454 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:49:33.265454 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:49:33.265454 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:49:33.265454 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:49:33.266555 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:49:33.266555 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:49:33.266555 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:49:33.266555 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:49:33.266555 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:49:33.266555 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:49:33.266555 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:49:33.266555 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:49:33.266555 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:49:33.266555 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:49:33.266555 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 11 20:49:33.266555 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:49:33.266555 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 11 20:49:33.266555 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:49:33.266555 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 593/1165] 10.222.0.40 () {56 vars in 1117 bytes} [Mon Jul 11 20:49:33 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:49:33.271259 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b671d1-5b7b-4efd-832f-23793a24f4a5 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:33.358684 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:33.367177 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b671d1-5b7b-4efd-832f-23793a24f4a5 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:33.401549 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21042c3d-83d9-4c54-9f15-54f78094afea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:33.402207 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21042c3d-83d9-4c54-9f15-54f78094afea None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:33.402496 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21042c3d-83d9-4c54-9f15-54f78094afea None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:33.402774 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21042c3d-83d9-4c54-9f15-54f78094afea None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:33.403491 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21042c3d-83d9-4c54-9f15-54f78094afea None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:49:33.403802 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21042c3d-83d9-4c54-9f15-54f78094afea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:33.405214 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21042c3d-83d9-4c54-9f15-54f78094afea None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:33.412164 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 573/1166] 10.222.0.40 () {56 vars in 1115 bytes} [Mon Jul 11 20:49:33 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:35.404121 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea6b21-a895-41a7-822a-7da256272066 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:35.404652 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea6b21-a895-41a7-822a-7da256272066 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:35.404744 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea6b21-a895-41a7-822a-7da256272066 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:35.406068 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 594/1167] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:49:35.411221 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcc57f-9fe0-4c8f-8c11-6118fc7374ea None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:35.411645 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcc57f-9fe0-4c8f-8c11-6118fc7374ea None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:35.411797 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcc57f-9fe0-4c8f-8c11-6118fc7374ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:35.429271 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-d7fcc57f-9fe0-4c8f-8c11-6118fc7374ea None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:49:35.430595 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d7fcc57f-9fe0-4c8f-8c11-6118fc7374ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:49:35.496061 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 574/1168] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:49:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:49:35.519126 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea6b21-a895-41a7-822a-7da256272066 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:35.617380 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea6b21-a895-41a7-822a-7da256272066 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:35.650228 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ed29e-5aa5-48a7-b96a-4d87c40d6ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:35.650876 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ed29e-5aa5-48a7-b96a-4d87c40d6ae1 None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:35.651607 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ed29e-5aa5-48a7-b96a-4d87c40d6ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:35.651880 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ed29e-5aa5-48a7-b96a-4d87c40d6ae1 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:35.652644 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ed29e-5aa5-48a7-b96a-4d87c40d6ae1 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:35.654017 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ed29e-5aa5-48a7-b96a-4d87c40d6ae1 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:35.739317 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 595/1169] 10.222.0.40 () {60 vars in 1138 bytes} [Mon Jul 11 20:49:35 2022] POST /identity/v3/domains => generated 267 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:49:37.755483 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d6693-85f9-4a59-b40d-98be02c12740 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:37.756038 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d6693-85f9-4a59-b40d-98be02c12740 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:37.756143 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d6693-85f9-4a59-b40d-98be02c12740 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:37.757548 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 575/1170] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:49:37.762618 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2a387-3c2b-46f0-aeca-7afe6ea3f8b3 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:37.762985 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2a387-3c2b-46f0-aeca-7afe6ea3f8b3 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:37.763179 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2a387-3c2b-46f0-aeca-7afe6ea3f8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:37.779363 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-76e2a387-3c2b-46f0-aeca-7afe6ea3f8b3 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:49:37.780570 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-76e2a387-3c2b-46f0-aeca-7afe6ea3f8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:49:37.822954 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:37.844685 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 596/1171] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:49:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:49:37.868714 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d6693-85f9-4a59-b40d-98be02c12740 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:37.952296 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:37.967685 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d6693-85f9-4a59-b40d-98be02c12740 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:38.001017 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90bcc3b-19a6-4249-8dca-d686039f1bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:38.001863 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90bcc3b-19a6-4249-8dca-d686039f1bba None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:38.002154 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90bcc3b-19a6-4249-8dca-d686039f1bba None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:38.002436 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90bcc3b-19a6-4249-8dca-d686039f1bba None admin] PATH_INFO: `/v3/domains/0a9b2e9642cb40b7986bd1e9e2ac047c` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:38.013242 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90bcc3b-19a6-4249-8dca-d686039f1bba None admin] RBAC: Authorizing `identity:get_domain(domain_id=0a9b2e9642cb40b7986bd1e9e2ac047c)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:38.014677 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90bcc3b-19a6-4249-8dca-d686039f1bba None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:38.016312 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 576/1172] 10.222.0.40 () {56 vars in 1183 bytes} [Mon Jul 11 20:49:37 2022] GET /identity/v3/domains/0a9b2e9642cb40b7986bd1e9e2ac047c => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:38.022148 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2a387-3c2b-46f0-aeca-7afe6ea3f8b3 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:38.118493 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2a387-3c2b-46f0-aeca-7afe6ea3f8b3 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:38.151522 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af1b053-cc13-45af-aba1-a2fe5a8a9191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:38.152195 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1b053-cc13-45af-aba1-a2fe5a8a9191 None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:38.152500 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1b053-cc13-45af-aba1-a2fe5a8a9191 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:38.152758 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1b053-cc13-45af-aba1-a2fe5a8a9191 None admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:38.153459 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af1b053-cc13-45af-aba1-a2fe5a8a9191 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:38.154872 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af1b053-cc13-45af-aba1-a2fe5a8a9191 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:38.233919 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 597/1173] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Jul 11 20:49:38 2022] POST /identity/v3/projects => generated 361 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:49:40.294074 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0bc35-cc86-45b1-b2f5-0988ee20c003 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:40.294634 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0bc35-cc86-45b1-b2f5-0988ee20c003 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:40.294634 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0bc35-cc86-45b1-b2f5-0988ee20c003 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:40.296033 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 577/1174] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:49:40.301027 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3d8ba-7893-4dbe-91b4-f5f3ac408662 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:40.301392 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3d8ba-7893-4dbe-91b4-f5f3ac408662 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:40.301593 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3d8ba-7893-4dbe-91b4-f5f3ac408662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:40.318455 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-27a3d8ba-7893-4dbe-91b4-f5f3ac408662 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:49:40.320293 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-27a3d8ba-7893-4dbe-91b4-f5f3ac408662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:49:40.342642 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:40.384735 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 598/1175] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:49:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:49:40.409423 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0bc35-cc86-45b1-b2f5-0988ee20c003 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:40.508730 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0bc35-cc86-45b1-b2f5-0988ee20c003 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:40.540671 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d4c40-0d11-4ebc-9faa-c62bc33d8f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:40.541524 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d4c40-0d11-4ebc-9faa-c62bc33d8f02 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:40.541808 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d4c40-0d11-4ebc-9faa-c62bc33d8f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:40.542086 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d4c40-0d11-4ebc-9faa-c62bc33d8f02 None admin] PATH_INFO: `/v3/domains/0a9b2e9642cb40b7986bd1e9e2ac047c` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:40.543245 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d4c40-0d11-4ebc-9faa-c62bc33d8f02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0a9b2e9642cb40b7986bd1e9e2ac047c)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:40.544735 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d4c40-0d11-4ebc-9faa-c62bc33d8f02 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:40.546268 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 578/1176] 10.222.0.40 () {56 vars in 1183 bytes} [Mon Jul 11 20:49:40 2022] GET /identity/v3/domains/0a9b2e9642cb40b7986bd1e9e2ac047c => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:40.551915 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3d8ba-7893-4dbe-91b4-f5f3ac408662 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:40.646782 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3d8ba-7893-4dbe-91b4-f5f3ac408662 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:40.680281 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e7443-774f-432a-8ed0-1cbe63aa3896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:40.680950 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e7443-774f-432a-8ed0-1cbe63aa3896 None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:40.681237 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e7443-774f-432a-8ed0-1cbe63aa3896 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:40.681516 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e7443-774f-432a-8ed0-1cbe63aa3896 None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:40.682213 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e7443-774f-432a-8ed0-1cbe63aa3896 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:40.683640 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e7443-774f-432a-8ed0-1cbe63aa3896 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:40.760984 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 599/1177] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jul 11 20:49:40 2022] POST /identity/v3/users => generated 311 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:49:42.872007 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f293e-2bac-40a8-8fae-72df043e7d8a None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:42.872528 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f293e-2bac-40a8-8fae-72df043e7d8a None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:42.872528 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f293e-2bac-40a8-8fae-72df043e7d8a None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:42.873912 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 579/1178] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:49:42.879422 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834ab8b-e8cc-49c7-b413-c3cb51d6be99 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:42.879819 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834ab8b-e8cc-49c7-b413-c3cb51d6be99 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:42.880002 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834ab8b-e8cc-49c7-b413-c3cb51d6be99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:42.896817 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-a834ab8b-e8cc-49c7-b413-c3cb51d6be99 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:49:42.898581 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a834ab8b-e8cc-49c7-b413-c3cb51d6be99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:49:42.908977 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:42.962920 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 600/1179] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:49:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:49:42.985926 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f293e-2bac-40a8-8fae-72df043e7d8a None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:43.003029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:43.087689 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f293e-2bac-40a8-8fae-72df043e7d8a None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:43.119537 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55e8f3-9d60-44e0-961e-3f4d31bd4cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:43.120339 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55e8f3-9d60-44e0-961e-3f4d31bd4cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:43.120627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55e8f3-9d60-44e0-961e-3f4d31bd4cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:43.120903 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55e8f3-9d60-44e0-961e-3f4d31bd4cf0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:43.131401 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c55e8f3-9d60-44e0-961e-3f4d31bd4cf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:49:43.139388 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-9c55e8f3-9d60-44e0-961e-3f4d31bd4cf0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:49:43.139388 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:49:43.139388 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:49:43.139388 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:49:43.139388 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:49:43.139388 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:49:43.139388 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:49:43.139388 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:49:43.139388 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:49:43.139388 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:49:43.139388 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:49:43.139388 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:49:43.139388 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:49:43.139388 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:49:43.139388 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:49:43.139388 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:49:43.140529 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:49:43.140529 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:49:43.140529 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:49:43.140529 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:49:43.140529 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:49:43.140529 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:49:43.140529 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:49:43.140529 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:49:43.140529 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:49:43.140529 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:49:43.140529 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:49:43.140529 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:49:43.140529 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:49:43.140529 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:49:43.140529 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:49:43.140529 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:49:43.141596 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:49:43.141596 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:49:43.141596 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:49:43.141596 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:49:43.141596 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:49:43.141596 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:49:43.141596 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:49:43.141596 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:49:43.141596 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:49:43.141596 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:49:43.141596 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:49:43.141596 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:49:43.141596 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 580/1180] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 11 20:49:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:49:43.146653 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834ab8b-e8cc-49c7-b413-c3cb51d6be99 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:43.240572 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834ab8b-e8cc-49c7-b413-c3cb51d6be99 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:43.275275 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5decb0b0-b890-434e-9b52-9e2da2d2d42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:43.275947 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decb0b0-b890-434e-9b52-9e2da2d2d42f None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:43.276269 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decb0b0-b890-434e-9b52-9e2da2d2d42f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:43.276550 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decb0b0-b890-434e-9b52-9e2da2d2d42f None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:43.277299 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5decb0b0-b890-434e-9b52-9e2da2d2d42f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:49:43.277614 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5decb0b0-b890-434e-9b52-9e2da2d2d42f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:43.278987 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5decb0b0-b890-434e-9b52-9e2da2d2d42f None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:43.286838 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 601/1181] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:49:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:43.292493 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55e8f3-9d60-44e0-961e-3f4d31bd4cf0 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:43.370652 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:43.395157 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55e8f3-9d60-44e0-961e-3f4d31bd4cf0 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:43.428942 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d4ae1-6107-4082-80aa-b001e1488ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:43.429839 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d4ae1-6107-4082-80aa-b001e1488ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:43.430130 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d4ae1-6107-4082-80aa-b001e1488ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:43.430409 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d4ae1-6107-4082-80aa-b001e1488ea7 None admin] PATH_INFO: `/v3/users/b6b18358486142b99cb212720e538f29` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:43.442891 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d4ae1-6107-4082-80aa-b001e1488ea7 None admin] RBAC: Authorizing `identity:get_user(user_id=b6b18358486142b99cb212720e538f29)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:43.445111 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d4ae1-6107-4082-80aa-b001e1488ea7 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:43.446737 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 581/1182] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:49:43 2022] GET /identity/v3/users/b6b18358486142b99cb212720e538f29 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:43.452443 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5decb0b0-b890-434e-9b52-9e2da2d2d42f None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:43.463590 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:43.550903 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5decb0b0-b890-434e-9b52-9e2da2d2d42f None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:43.583800 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29135bde-6d66-429c-be0a-5d4b6d4fa1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:43.584480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29135bde-6d66-429c-be0a-5d4b6d4fa1ef None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:43.584813 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29135bde-6d66-429c-be0a-5d4b6d4fa1ef None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:43.585095 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29135bde-6d66-429c-be0a-5d4b6d4fa1ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:43.650521 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29135bde-6d66-429c-be0a-5d4b6d4fa1ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:43.651988 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29135bde-6d66-429c-be0a-5d4b6d4fa1ef None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:43.661487 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:43.749208 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 602/1183] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:49:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 20:49:43.755264 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d4ae1-6107-4082-80aa-b001e1488ea7 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:43.853331 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d4ae1-6107-4082-80aa-b001e1488ea7 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:43.882060 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:43.886731 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd25a2-1ddd-49ca-93df-27d1f29ee6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:43.887585 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd25a2-1ddd-49ca-93df-27d1f29ee6cf None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:43.887877 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd25a2-1ddd-49ca-93df-27d1f29ee6cf None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:43.888176 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd25a2-1ddd-49ca-93df-27d1f29ee6cf None admin] PATH_INFO: `/v3/projects/c19d5b872c0b4350b9478981344ad270` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:43.889421 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccd25a2-1ddd-49ca-93df-27d1f29ee6cf None admin] RBAC: Authorizing `identity:get_project(project_id=c19d5b872c0b4350b9478981344ad270)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:43.890829 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccd25a2-1ddd-49ca-93df-27d1f29ee6cf None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:43.892516 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 582/1184] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:49:43 2022] GET /identity/v3/projects/c19d5b872c0b4350b9478981344ad270 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:43.898882 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29135bde-6d66-429c-be0a-5d4b6d4fa1ef None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:43.993307 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29135bde-6d66-429c-be0a-5d4b6d4fa1ef None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:44.002297 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:44.025954 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac3473-f516-4ae2-984b-25799ee348ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:44.026597 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac3473-f516-4ae2-984b-25799ee348ea None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:44.026881 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac3473-f516-4ae2-984b-25799ee348ea None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:44.027154 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac3473-f516-4ae2-984b-25799ee348ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:44.027996 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac3473-f516-4ae2-984b-25799ee348ea None admin] RBAC: Adding query filter params (role.id=86273ff072f3438d822e870272491768, scope.project.id=c19d5b872c0b4350b9478981344ad270, user.id=b6b18358486142b99cb212720e538f29) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:49:44.028309 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac3473-f516-4ae2-984b-25799ee348ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:44.029724 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac3473-f516-4ae2-984b-25799ee348ea None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:44.035537 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 603/1185] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:49:43 2022] GET /identity/v3/role_assignments?user.id=b6b18358486142b99cb212720e538f29&scope.project.id=c19d5b872c0b4350b9478981344ad270&role.id=86273ff072f3438d822e870272491768 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:46.040506 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af1876-b433-482c-8e4d-1cc15d704fc7 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:46.041027 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af1876-b433-482c-8e4d-1cc15d704fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:46.041155 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af1876-b433-482c-8e4d-1cc15d704fc7 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:46.042426 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 583/1186] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:49:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:49:46.047523 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8d190-6b2d-47d2-a281-533295dbac30 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:46.047943 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8d190-6b2d-47d2-a281-533295dbac30 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:46.048126 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8d190-6b2d-47d2-a281-533295dbac30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:46.064964 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-4cd8d190-6b2d-47d2-a281-533295dbac30 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:49:46.066139 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-4cd8d190-6b2d-47d2-a281-533295dbac30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:49:46.130327 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 604/1187] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:49:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:49:46.152163 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af1876-b433-482c-8e4d-1cc15d704fc7 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:46.254529 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af1876-b433-482c-8e4d-1cc15d704fc7 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:46.287038 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c76baf-420d-490a-bcb6-b7d74fbaac9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:46.288542 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c76baf-420d-490a-bcb6-b7d74fbaac9e None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:46.288913 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c76baf-420d-490a-bcb6-b7d74fbaac9e None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:46.289194 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c76baf-420d-490a-bcb6-b7d74fbaac9e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:46.299690 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c76baf-420d-490a-bcb6-b7d74fbaac9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:49:46.307844 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-28c76baf-420d-490a-bcb6-b7d74fbaac9e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:49:46.307844 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:49:46.307844 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:49:46.307844 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:49:46.307844 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:49:46.307844 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:49:46.307844 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:49:46.307844 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:49:46.307844 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:49:46.307844 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:49:46.307844 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:49:46.307844 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:49:46.307844 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:49:46.307844 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:49:46.307844 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:49:46.307844 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:49:46.309075 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:49:46.309075 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:49:46.309075 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:49:46.309075 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:49:46.309075 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:49:46.309075 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:49:46.309075 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:49:46.309075 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:49:46.309075 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:49:46.309075 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:49:46.309075 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:49:46.309075 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:49:46.309075 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:49:46.309075 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:49:46.309075 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:49:46.309075 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:49:46.310012 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:49:46.310012 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:49:46.310012 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:49:46.310012 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:49:46.310012 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:49:46.310012 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:49:46.310012 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:49:46.310012 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:49:46.310012 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:49:46.310012 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:49:46.310012 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:49:46.310012 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:49:46.310012 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 584/1188] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 11 20:49:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:49:46.315916 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8d190-6b2d-47d2-a281-533295dbac30 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:46.418558 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8d190-6b2d-47d2-a281-533295dbac30 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:46.420115 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:46.455036 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19c98c-f06f-42b9-8680-3e2d760cd483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:46.455719 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19c98c-f06f-42b9-8680-3e2d760cd483 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:46.456042 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19c98c-f06f-42b9-8680-3e2d760cd483 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:46.456324 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19c98c-f06f-42b9-8680-3e2d760cd483 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:46.457074 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f19c98c-f06f-42b9-8680-3e2d760cd483 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:49:46.457393 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f19c98c-f06f-42b9-8680-3e2d760cd483 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:46.458763 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f19c98c-f06f-42b9-8680-3e2d760cd483 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:46.468293 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 605/1189] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:49:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:46.475895 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c76baf-420d-490a-bcb6-b7d74fbaac9e None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:46.544640 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:46.591157 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c76baf-420d-490a-bcb6-b7d74fbaac9e None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:46.628358 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc537d2e-98fb-4d2f-9651-b69505bb97cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:46.629341 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc537d2e-98fb-4d2f-9651-b69505bb97cb None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:46.629624 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc537d2e-98fb-4d2f-9651-b69505bb97cb None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:46.629899 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc537d2e-98fb-4d2f-9651-b69505bb97cb None admin] PATH_INFO: `/v3/users/b6b18358486142b99cb212720e538f29` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:46.631077 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc537d2e-98fb-4d2f-9651-b69505bb97cb None admin] RBAC: Authorizing `identity:get_user(user_id=b6b18358486142b99cb212720e538f29)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:46.633290 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc537d2e-98fb-4d2f-9651-b69505bb97cb None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:46.634972 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 585/1190] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:49:46 2022] GET /identity/v3/users/b6b18358486142b99cb212720e538f29 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:46.640864 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19c98c-f06f-42b9-8680-3e2d760cd483 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:46.751423 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19c98c-f06f-42b9-8680-3e2d760cd483 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:46.788902 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b9f9d-e8b6-48ab-accb-ce52c7463f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:46.789777 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b9f9d-e8b6-48ab-accb-ce52c7463f95 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:46.790059 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b9f9d-e8b6-48ab-accb-ce52c7463f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:46.790338 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b9f9d-e8b6-48ab-accb-ce52c7463f95 None admin] PATH_INFO: `/v3/projects/c19d5b872c0b4350b9478981344ad270` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:46.791514 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b9f9d-e8b6-48ab-accb-ce52c7463f95 None admin] RBAC: Authorizing `identity:get_project(project_id=c19d5b872c0b4350b9478981344ad270)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:46.792979 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b9f9d-e8b6-48ab-accb-ce52c7463f95 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:46.794699 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 606/1191] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:49:46 2022] GET /identity/v3/projects/c19d5b872c0b4350b9478981344ad270 => generated 361 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:46.801783 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc537d2e-98fb-4d2f-9651-b69505bb97cb None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:46.910910 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc537d2e-98fb-4d2f-9651-b69505bb97cb None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:46.940217 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:46.948923 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821b531-681a-471f-8ad3-5cd133960f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:46.949820 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821b531-681a-471f-8ad3-5cd133960f20 None admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:46.950106 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821b531-681a-471f-8ad3-5cd133960f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:46.950379 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821b531-681a-471f-8ad3-5cd133960f20 None admin] PATH_INFO: `/v3/projects/c19d5b872c0b4350b9478981344ad270/users/b6b18358486142b99cb212720e538f29/roles/86273ff072f3438d822e870272491768` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:46.952391 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2821b531-681a-471f-8ad3-5cd133960f20 None admin] RBAC: Authorizing `identity:create_grant(project_id=c19d5b872c0b4350b9478981344ad270, user_id=b6b18358486142b99cb212720e538f29, role_id=86273ff072f3438d822e870272491768)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:46.955619 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2821b531-681a-471f-8ad3-5cd133960f20 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:47.018587 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 586/1192] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 11 20:49:46 2022] PUT /identity/v3/projects/c19d5b872c0b4350b9478981344ad270/users/b6b18358486142b99cb212720e538f29/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:49:49.024758 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669439c-9afa-4b30-8578-79ac00e8a512 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:49.025286 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669439c-9afa-4b30-8578-79ac00e8a512 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:49.025382 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669439c-9afa-4b30-8578-79ac00e8a512 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:49.026690 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 607/1193] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:49:49.031734 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b0f46-924e-4019-bd7a-cbdacfeacfe2 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:49.032206 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b0f46-924e-4019-bd7a-cbdacfeacfe2 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:49.032308 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b0f46-924e-4019-bd7a-cbdacfeacfe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:49.049303 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-e30b0f46-924e-4019-bd7a-cbdacfeacfe2 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:49:49.050485 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-e30b0f46-924e-4019-bd7a-cbdacfeacfe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:49:49.115253 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 587/1194] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:49:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:49:49.139243 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669439c-9afa-4b30-8578-79ac00e8a512 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:49.170287 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:49.238981 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669439c-9afa-4b30-8578-79ac00e8a512 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:49.272523 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deba388-e142-4f52-b796-d98ee102aa29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:49.273311 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deba388-e142-4f52-b796-d98ee102aa29 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:49.273594 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deba388-e142-4f52-b796-d98ee102aa29 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:49.273874 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deba388-e142-4f52-b796-d98ee102aa29 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:49.283765 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deba388-e142-4f52-b796-d98ee102aa29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:49:49.291889 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-6deba388-e142-4f52-b796-d98ee102aa29 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:49:49.291889 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:49:49.291889 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:49:49.291889 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:49:49.291889 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:49:49.291889 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:49:49.291889 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:49:49.291889 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:49:49.291889 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:49:49.291889 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:49:49.291889 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:49:49.291889 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:49:49.291889 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:49:49.291889 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:49:49.291889 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:49:49.291889 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:49:49.293066 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:49:49.293066 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:49:49.293066 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:49:49.293066 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:49:49.293066 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:49:49.293066 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:49:49.293066 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:49:49.293066 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:49:49.293066 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:49:49.293066 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:49:49.293066 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:49:49.293066 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:49:49.293066 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:49:49.293066 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:49:49.293066 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:49:49.293066 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:49:49.294386 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:49:49.294386 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:49:49.294386 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:49:49.294386 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:49:49.294386 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:49:49.294386 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:49:49.294386 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:49:49.294386 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:49:49.294386 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:49:49.294386 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:49:49.294386 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:49:49.294386 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:49:49.294386 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 608/1195] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 11 20:49:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:49:49.299014 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b0f46-924e-4019-bd7a-cbdacfeacfe2 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:49.395055 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b0f46-924e-4019-bd7a-cbdacfeacfe2 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:49.412179 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:49.428751 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4fb2e8-d480-4266-85d9-afeab1397c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:49.429410 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4fb2e8-d480-4266-85d9-afeab1397c40 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:49.429696 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4fb2e8-d480-4266-85d9-afeab1397c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:49.429976 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4fb2e8-d480-4266-85d9-afeab1397c40 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:49.430719 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4fb2e8-d480-4266-85d9-afeab1397c40 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:49:49.431032 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4fb2e8-d480-4266-85d9-afeab1397c40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:49.432472 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4fb2e8-d480-4266-85d9-afeab1397c40 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:49.440288 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 588/1196] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:49:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:49.446020 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deba388-e142-4f52-b796-d98ee102aa29 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:49.536130 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:49.545202 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deba388-e142-4f52-b796-d98ee102aa29 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:49.578271 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f1c33-9494-446f-87f8-4e9ee5873905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:49.579137 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f1c33-9494-446f-87f8-4e9ee5873905 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:49.579424 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f1c33-9494-446f-87f8-4e9ee5873905 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:49.579700 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f1c33-9494-446f-87f8-4e9ee5873905 None admin] PATH_INFO: `/v3/users/b6b18358486142b99cb212720e538f29` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:49.580902 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f1c33-9494-446f-87f8-4e9ee5873905 None admin] RBAC: Authorizing `identity:get_user(user_id=b6b18358486142b99cb212720e538f29)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:49.582350 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f1c33-9494-446f-87f8-4e9ee5873905 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:49.583961 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 609/1197] 10.222.0.40 () {56 vars in 1177 bytes} [Mon Jul 11 20:49:49 2022] GET /identity/v3/users/b6b18358486142b99cb212720e538f29 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:49.589786 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4fb2e8-d480-4266-85d9-afeab1397c40 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:49.691590 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4fb2e8-d480-4266-85d9-afeab1397c40 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:49.723605 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0016af3-a4f0-4ee0-818b-e3e3e855c591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:49.724274 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0016af3-a4f0-4ee0-818b-e3e3e855c591 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:49.724562 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0016af3-a4f0-4ee0-818b-e3e3e855c591 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:49.724837 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0016af3-a4f0-4ee0-818b-e3e3e855c591 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:49.771306 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:49.790391 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0016af3-a4f0-4ee0-818b-e3e3e855c591 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:49.791751 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0016af3-a4f0-4ee0-818b-e3e3e855c591 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:49.885590 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 589/1198] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:49:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 20:49:49.891574 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f1c33-9494-446f-87f8-4e9ee5873905 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:49.988157 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f1c33-9494-446f-87f8-4e9ee5873905 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:50.020628 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a204d74-3f99-4006-9c33-1a6fd993dcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:50.021479 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a204d74-3f99-4006-9c33-1a6fd993dcf8 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:50.021768 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a204d74-3f99-4006-9c33-1a6fd993dcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:50.022677 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a204d74-3f99-4006-9c33-1a6fd993dcf8 None admin] PATH_INFO: `/v3/projects/c19d5b872c0b4350b9478981344ad270` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:50.023855 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a204d74-3f99-4006-9c33-1a6fd993dcf8 None admin] RBAC: Authorizing `identity:get_project(project_id=c19d5b872c0b4350b9478981344ad270)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:50.025315 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a204d74-3f99-4006-9c33-1a6fd993dcf8 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:50.026990 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 610/1199] 10.222.0.40 () {56 vars in 1186 bytes} [Mon Jul 11 20:49:49 2022] GET /identity/v3/projects/c19d5b872c0b4350b9478981344ad270 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:49:50.032873 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0016af3-a4f0-4ee0-818b-e3e3e855c591 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:49:50.111785 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:49:50.130250 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0016af3-a4f0-4ee0-818b-e3e3e855c591 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:49:50.164125 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ad81a-facc-4bc9-b5cd-262ecac71cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:49:50.164780 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ad81a-facc-4bc9-b5cd-262ecac71cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:49:50.165072 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ad81a-facc-4bc9-b5cd-262ecac71cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:49:50.165355 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ad81a-facc-4bc9-b5cd-262ecac71cf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:49:50.166183 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ad81a-facc-4bc9-b5cd-262ecac71cf2 None admin] RBAC: Adding query filter params (role.id=86273ff072f3438d822e870272491768, scope.project.id=c19d5b872c0b4350b9478981344ad270, user.id=b6b18358486142b99cb212720e538f29) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:49:50.166502 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ad81a-facc-4bc9-b5cd-262ecac71cf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:49:50.167924 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ad81a-facc-4bc9-b5cd-262ecac71cf2 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:49:50.173629 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 590/1200] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:49:50 2022] GET /identity/v3/role_assignments?user.id=b6b18358486142b99cb212720e538f29&scope.project.id=c19d5b872c0b4350b9478981344ad270&role.id=86273ff072f3438d822e870272491768 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:50:00.016553 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=86 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:50:00.171002 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=28 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:02.151546 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad6c8e-034f-4662-af3b-680b067858c0 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:02.152189 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad6c8e-034f-4662-af3b-680b067858c0 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:02.152189 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad6c8e-034f-4662-af3b-680b067858c0 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:02.153512 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 611/1201] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:51:02.158511 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd726271-c405-4207-8386-bb26a42ec66e None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:02.158910 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd726271-c405-4207-8386-bb26a42ec66e None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:02.159079 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd726271-c405-4207-8386-bb26a42ec66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:02.176426 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-dd726271-c405-4207-8386-bb26a42ec66e None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:51:02.177602 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-dd726271-c405-4207-8386-bb26a42ec66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:51:02.242978 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 591/1202] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:51:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:51:02.267808 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad6c8e-034f-4662-af3b-680b067858c0 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:02.367941 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad6c8e-034f-4662-af3b-680b067858c0 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:02.401921 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74548e-9f3c-4aca-83b8-fbb0bd97b27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:02.402651 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74548e-9f3c-4aca-83b8-fbb0bd97b27f None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:02.402940 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74548e-9f3c-4aca-83b8-fbb0bd97b27f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:02.403218 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74548e-9f3c-4aca-83b8-fbb0bd97b27f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:02.413334 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74548e-9f3c-4aca-83b8-fbb0bd97b27f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:02.415927 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74548e-9f3c-4aca-83b8-fbb0bd97b27f None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:02.434297 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-2c74548e-9f3c-4aca-83b8-fbb0bd97b27f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:51:02.434297 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:51:02.434297 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:51:02.434297 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:51:02.434297 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:51:02.434297 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:51:02.434297 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:51:02.434297 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:51:02.434297 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:51:02.434297 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:51:02.434297 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:51:02.434297 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:51:02.434297 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:51:02.434297 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:51:02.434297 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:51:02.439559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:51:02.439559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:51:02.439559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:51:02.439559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:51:02.439559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:51:02.439559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:51:02.439559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:51:02.439559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:51:02.439559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:51:02.439559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:51:02.439559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:51:02.439559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:51:02.439559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:51:02.439559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:51:02.439559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:51:02.439559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:51:02.439559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:51:02.440763 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:51:02.440763 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:51:02.440763 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:51:02.440763 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:51:02.440763 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 612/1203] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:51:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:51:02.441702 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd726271-c405-4207-8386-bb26a42ec66e None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:02.541143 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd726271-c405-4207-8386-bb26a42ec66e None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:02.569505 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:02.575363 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748d0e9-d720-4dfc-819e-98ef1ec426ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:02.577054 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748d0e9-d720-4dfc-819e-98ef1ec426ec None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:02.577054 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748d0e9-d720-4dfc-819e-98ef1ec426ec None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:02.577054 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748d0e9-d720-4dfc-819e-98ef1ec426ec None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:02.577458 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748d0e9-d720-4dfc-819e-98ef1ec426ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:51:02.577772 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748d0e9-d720-4dfc-819e-98ef1ec426ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:02.579131 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748d0e9-d720-4dfc-819e-98ef1ec426ec None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:02.590713 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 592/1204] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:51:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:51:02.596521 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74548e-9f3c-4aca-83b8-fbb0bd97b27f None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:02.649014 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:02.695352 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74548e-9f3c-4aca-83b8-fbb0bd97b27f None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:02.728679 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af824797-e75c-41bb-b12f-18505e13b12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:02.729476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af824797-e75c-41bb-b12f-18505e13b12b None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:02.729758 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af824797-e75c-41bb-b12f-18505e13b12b None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:02.730030 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af824797-e75c-41bb-b12f-18505e13b12b None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:02.730798 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af824797-e75c-41bb-b12f-18505e13b12b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:02.732260 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af824797-e75c-41bb-b12f-18505e13b12b None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:02.844115 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 613/1205] 10.222.0.40 () {60 vars in 1132 bytes} [Mon Jul 11 20:51:02 2022] POST /identity/v3/users => generated 251 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:51:04.868906 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c0768-c839-4c73-830d-257a19e0aae9 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:04.869511 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c0768-c839-4c73-830d-257a19e0aae9 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:04.869511 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c0768-c839-4c73-830d-257a19e0aae9 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:04.870820 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 593/1206] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:51:04.875852 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21af5e1-473d-4da5-bca4-d12cf903b839 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:04.876306 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21af5e1-473d-4da5-bca4-d12cf903b839 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:04.876706 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21af5e1-473d-4da5-bca4-d12cf903b839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:04.893148 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-a21af5e1-473d-4da5-bca4-d12cf903b839 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:51:04.894326 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a21af5e1-473d-4da5-bca4-d12cf903b839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:51:04.960979 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 614/1207] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:51:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 20:51:04.985097 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c0768-c839-4c73-830d-257a19e0aae9 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:05.089046 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c0768-c839-4c73-830d-257a19e0aae9 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:05.124336 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073df1dc-570e-4127-9cec-0b72e45b3d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:05.125204 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073df1dc-570e-4127-9cec-0b72e45b3d5a None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:05.125497 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073df1dc-570e-4127-9cec-0b72e45b3d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:05.125781 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073df1dc-570e-4127-9cec-0b72e45b3d5a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:05.137554 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073df1dc-570e-4127-9cec-0b72e45b3d5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:51:05.145319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-073df1dc-570e-4127-9cec-0b72e45b3d5a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:51:05.145319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:51:05.145319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:51:05.145319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:51:05.145319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:51:05.145319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:51:05.145319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:51:05.145319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:51:05.145319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:51:05.145319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:51:05.145319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:51:05.145319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:51:05.145319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:51:05.145319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:51:05.145319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:51:05.145319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:51:05.146542 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:51:05.146542 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:51:05.146542 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:51:05.146542 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:51:05.146542 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:51:05.146542 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:51:05.146542 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:51:05.146542 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:51:05.146542 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:51:05.146542 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:51:05.146542 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:51:05.146542 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:51:05.146542 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:51:05.146542 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:51:05.146542 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:51:05.146542 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:51:05.147423 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:51:05.147423 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:51:05.147423 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:51:05.147423 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:51:05.147423 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:51:05.147423 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:51:05.147423 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:51:05.147423 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:51:05.147423 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:51:05.147423 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:51:05.147423 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:51:05.147423 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:51:05.147423 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 594/1208] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 11 20:51:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 20:51:05.153360 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21af5e1-473d-4da5-bca4-d12cf903b839 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:05.192749 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:05.250617 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21af5e1-473d-4da5-bca4-d12cf903b839 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:05.284532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8dd16a-1c9a-48b0-89fc-27cf74ca6871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:05.285206 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8dd16a-1c9a-48b0-89fc-27cf74ca6871 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:05.285495 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8dd16a-1c9a-48b0-89fc-27cf74ca6871 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:05.285772 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8dd16a-1c9a-48b0-89fc-27cf74ca6871 None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:05.286516 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8dd16a-1c9a-48b0-89fc-27cf74ca6871 None admin] RBAC: Adding query filter params (name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:51:05.286830 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8dd16a-1c9a-48b0-89fc-27cf74ca6871 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:05.288284 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8dd16a-1c9a-48b0-89fc-27cf74ca6871 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:05.297196 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 615/1209] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jul 11 20:51:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:51:05.302945 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073df1dc-570e-4127-9cec-0b72e45b3d5a None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:05.354160 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:05.404521 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073df1dc-570e-4127-9cec-0b72e45b3d5a None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:05.440157 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daeea4f-c94f-497f-a04e-089c99357981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:05.440949 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daeea4f-c94f-497f-a04e-089c99357981 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:05.441235 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daeea4f-c94f-497f-a04e-089c99357981 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:05.441519 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daeea4f-c94f-497f-a04e-089c99357981 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:05.452109 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daeea4f-c94f-497f-a04e-089c99357981 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:05.453538 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daeea4f-c94f-497f-a04e-089c99357981 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:05.470932 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-1daeea4f-c94f-497f-a04e-089c99357981 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:51:05.470932 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:51:05.470932 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:51:05.470932 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:51:05.470932 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:51:05.470932 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:51:05.470932 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:51:05.470932 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:51:05.470932 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:51:05.470932 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:51:05.470932 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:51:05.470932 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:51:05.470932 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:51:05.470932 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:51:05.470932 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:51:05.472161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:51:05.472161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:51:05.472161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:51:05.472161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:51:05.472161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:51:05.472161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:51:05.472161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:51:05.472161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:51:05.472161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:51:05.472161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:51:05.472161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:51:05.472161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:51:05.472161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:51:05.472161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:51:05.472161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:51:05.472161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:51:05.472161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:51:05.478775 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:51:05.478775 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:51:05.478775 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:51:05.478775 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:51:05.478775 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 595/1210] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:51:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:51:05.479076 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8dd16a-1c9a-48b0-89fc-27cf74ca6871 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:05.575707 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:05.578528 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8dd16a-1c9a-48b0-89fc-27cf74ca6871 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:05.611982 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0827a0a3-039c-4a43-8c9b-ec8ca0a7ff4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:05.612677 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827a0a3-039c-4a43-8c9b-ec8ca0a7ff4a None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:05.612967 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827a0a3-039c-4a43-8c9b-ec8ca0a7ff4a None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:05.613248 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827a0a3-039c-4a43-8c9b-ec8ca0a7ff4a None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:05.613973 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0827a0a3-039c-4a43-8c9b-ec8ca0a7ff4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:51:05.614290 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0827a0a3-039c-4a43-8c9b-ec8ca0a7ff4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:05.615675 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0827a0a3-039c-4a43-8c9b-ec8ca0a7ff4a None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:05.628246 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 616/1211] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:51:05.633818 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daeea4f-c94f-497f-a04e-089c99357981 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:05.735763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daeea4f-c94f-497f-a04e-089c99357981 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:05.737436 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:05.771244 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31be173-499f-4d02-a66b-2316c486e562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:05.772065 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31be173-499f-4d02-a66b-2316c486e562 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:05.772356 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31be173-499f-4d02-a66b-2316c486e562 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:05.772687 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31be173-499f-4d02-a66b-2316c486e562 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:05.779634 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31be173-499f-4d02-a66b-2316c486e562 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:05.781102 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31be173-499f-4d02-a66b-2316c486e562 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:05.796576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-c31be173-499f-4d02-a66b-2316c486e562 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 20:51:05.796576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:51:05.796576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:51:05.796576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:51:05.796576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:51:05.796576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:51:05.796576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:51:05.796576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:51:05.796576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:51:05.796576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:51:05.796576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:51:05.796576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:51:05.796576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:51:05.796576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:51:05.796576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:51:05.796576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:51:05.797742 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:51:05.797742 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:51:05.797742 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:51:05.797742 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:51:05.797742 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:51:05.797742 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:51:05.797742 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:51:05.797742 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:51:05.797742 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:51:05.797742 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:51:05.797742 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:51:05.797742 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:51:05.797742 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:51:05.797742 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:51:05.797742 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:51:05.797742 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:51:05.797742 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:51:05.797742 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:51:05.798988 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:51:05.798988 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:51:05.798988 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:51:05.798988 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:51:05.798988 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:51:05.798988 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:51:05.798988 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:51:05.798988 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:51:05.798988 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 20:51:05.798988 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:51:05.798988 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 596/1212] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:51:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:51:05.803518 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0827a0a3-039c-4a43-8c9b-ec8ca0a7ff4a None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:05.903387 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0827a0a3-039c-4a43-8c9b-ec8ca0a7ff4a None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:05.936329 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1a53a-7c23-4938-b96a-125c42f6b23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:05.937010 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1a53a-7c23-4938-b96a-125c42f6b23f None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:05.937290 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1a53a-7c23-4938-b96a-125c42f6b23f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:05.937569 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1a53a-7c23-4938-b96a-125c42f6b23f None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:05.938405 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec1a53a-7c23-4938-b96a-125c42f6b23f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:51:05.938765 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec1a53a-7c23-4938-b96a-125c42f6b23f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:05.940229 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec1a53a-7c23-4938-b96a-125c42f6b23f None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:05.958054 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 617/1213] 10.222.0.40 () {56 vars in 1143 bytes} [Mon Jul 11 20:51:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:51:05.963779 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31be173-499f-4d02-a66b-2316c486e562 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:06.062652 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31be173-499f-4d02-a66b-2316c486e562 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:06.097158 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719aafd-dc71-4ad3-a32f-96179a343bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:06.097820 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719aafd-dc71-4ad3-a32f-96179a343bbd None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:06.098108 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719aafd-dc71-4ad3-a32f-96179a343bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:06.098385 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719aafd-dc71-4ad3-a32f-96179a343bbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:06.128044 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:06.164498 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4719aafd-dc71-4ad3-a32f-96179a343bbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:06.165877 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4719aafd-dc71-4ad3-a32f-96179a343bbd None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:06.263091 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 597/1214] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:51:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 20:51:06.269062 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1a53a-7c23-4938-b96a-125c42f6b23f None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:06.288528 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:06.367955 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1a53a-7c23-4938-b96a-125c42f6b23f None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:06.402309 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ece7a1-695a-4140-a21b-bbdfea5f3461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:06.403105 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ece7a1-695a-4140-a21b-bbdfea5f3461 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:06.403390 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ece7a1-695a-4140-a21b-bbdfea5f3461 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:06.403671 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ece7a1-695a-4140-a21b-bbdfea5f3461 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:06.414276 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ece7a1-695a-4140-a21b-bbdfea5f3461 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:06.419863 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ece7a1-695a-4140-a21b-bbdfea5f3461 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:06.434167 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-21ece7a1-695a-4140-a21b-bbdfea5f3461 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:51:06.434167 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:51:06.434167 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:51:06.434167 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:51:06.434167 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:51:06.434167 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:51:06.434167 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:51:06.434167 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:51:06.434167 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:51:06.434167 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:51:06.434167 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:51:06.434167 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:51:06.434167 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:51:06.434167 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:51:06.434167 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:51:06.435279 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:51:06.435279 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:51:06.435279 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:51:06.435279 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:51:06.435279 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:51:06.435279 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:51:06.435279 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:51:06.435279 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:51:06.435279 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:51:06.435279 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:51:06.435279 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:51:06.435279 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:51:06.435279 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:51:06.435279 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:51:06.435279 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:51:06.435279 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:51:06.435279 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:51:06.436285 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:51:06.436285 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:51:06.436285 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:51:06.436285 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:51:06.436285 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 618/1215] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:51:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:51:06.441146 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719aafd-dc71-4ad3-a32f-96179a343bbd None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:06.501229 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:06.538957 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719aafd-dc71-4ad3-a32f-96179a343bbd None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:06.573526 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb0f5b-1033-4fa4-9487-72ca9f62b4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:06.574184 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb0f5b-1033-4fa4-9487-72ca9f62b4a0 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:06.574478 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb0f5b-1033-4fa4-9487-72ca9f62b4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:06.574758 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb0f5b-1033-4fa4-9487-72ca9f62b4a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:06.575572 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb0f5b-1033-4fa4-9487-72ca9f62b4a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:51:06.575886 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb0f5b-1033-4fa4-9487-72ca9f62b4a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:06.577284 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb0f5b-1033-4fa4-9487-72ca9f62b4a0 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:06.588525 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 598/1216] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:51:06.594342 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ece7a1-695a-4140-a21b-bbdfea5f3461 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:06.664271 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:06.694306 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ece7a1-695a-4140-a21b-bbdfea5f3461 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:06.727167 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2427150-70a8-447f-9b5b-eba9e207a578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:06.728154 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2427150-70a8-447f-9b5b-eba9e207a578 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:06.728271 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2427150-70a8-447f-9b5b-eba9e207a578 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:06.728525 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2427150-70a8-447f-9b5b-eba9e207a578 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:06.735028 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2427150-70a8-447f-9b5b-eba9e207a578 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:06.736504 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2427150-70a8-447f-9b5b-eba9e207a578 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:06.750313 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-e2427150-70a8-447f-9b5b-eba9e207a578 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:51:06.750313 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:51:06.750313 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:51:06.750313 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:51:06.750313 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:51:06.750313 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:51:06.750313 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:51:06.750313 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:51:06.750313 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:51:06.750313 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:51:06.750313 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:51:06.750313 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:51:06.750313 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:51:06.750313 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:51:06.750313 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:51:06.751440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:51:06.751440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:51:06.751440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:51:06.751440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:51:06.751440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:51:06.751440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:51:06.751440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:51:06.751440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:51:06.751440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:51:06.751440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:51:06.751440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:51:06.751440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:51:06.751440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:51:06.751440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:51:06.751440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:51:06.751440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:51:06.751440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:51:06.753018 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:51:06.753018 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:51:06.753018 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:51:06.753018 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:51:06.753018 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:51:06.753018 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:51:06.753018 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:51:06.753018 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:51:06.753018 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 619/1217] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:51:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:51:06.757620 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb0f5b-1033-4fa4-9487-72ca9f62b4a0 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:06.857487 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb0f5b-1033-4fa4-9487-72ca9f62b4a0 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:06.879712 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:06.891611 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9641bf-f895-45b7-a999-d58f5c5b1c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:06.892303 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9641bf-f895-45b7-a999-d58f5c5b1c72 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:06.892588 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9641bf-f895-45b7-a999-d58f5c5b1c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:06.892862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9641bf-f895-45b7-a999-d58f5c5b1c72 None admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:06.893640 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9641bf-f895-45b7-a999-d58f5c5b1c72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:51:06.893952 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9641bf-f895-45b7-a999-d58f5c5b1c72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:06.895355 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9641bf-f895-45b7-a999-d58f5c5b1c72 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:06.907958 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 599/1218] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 11 20:51:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:51:06.913985 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2427150-70a8-447f-9b5b-eba9e207a578 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:07.012115 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2427150-70a8-447f-9b5b-eba9e207a578 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:07.040356 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:07.047628 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd9e66f-3dda-4d53-8153-ae0eb41baeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:07.048315 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9e66f-3dda-4d53-8153-ae0eb41baeb8 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:07.048600 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9e66f-3dda-4d53-8153-ae0eb41baeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:07.048877 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9e66f-3dda-4d53-8153-ae0eb41baeb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:07.049698 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd9e66f-3dda-4d53-8153-ae0eb41baeb8 None admin] RBAC: Adding query filter params (role.id=17bc727d82f24074aba8b1185cb99739, scope.project.id=eca3ef2561fa435e80ff451aeab14f3b, user.id=177a912380ad43b6a5e31b787a07ce7d) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:51:07.050014 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd9e66f-3dda-4d53-8153-ae0eb41baeb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:07.051579 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd9e66f-3dda-4d53-8153-ae0eb41baeb8 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:07.056919 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 620/1219] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:51:06 2022] GET /identity/v3/role_assignments?user.id=177a912380ad43b6a5e31b787a07ce7d&scope.project.id=eca3ef2561fa435e80ff451aeab14f3b&role.id=17bc727d82f24074aba8b1185cb99739 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:51:09.047892 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e112a-68d4-4c83-8b8e-1cca75657ff1 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:09.048449 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e112a-68d4-4c83-8b8e-1cca75657ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:09.048539 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e112a-68d4-4c83-8b8e-1cca75657ff1 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:09.049874 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 600/1220] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:51:09.055193 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca0978-0e14-4ece-8004-be24219e3ee1 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:09.055591 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca0978-0e14-4ece-8004-be24219e3ee1 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:09.055769 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca0978-0e14-4ece-8004-be24219e3ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:09.073436 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-b9ca0978-0e14-4ece-8004-be24219e3ee1 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:51:09.074623 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-b9ca0978-0e14-4ece-8004-be24219e3ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:51:09.141207 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 621/1221] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:51:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:51:09.164605 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e112a-68d4-4c83-8b8e-1cca75657ff1 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:09.265442 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e112a-68d4-4c83-8b8e-1cca75657ff1 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:09.299691 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1696a-cf6b-42ab-ab0d-91f67b4511b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:09.300451 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1696a-cf6b-42ab-ab0d-91f67b4511b1 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:09.300740 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1696a-cf6b-42ab-ab0d-91f67b4511b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:09.301020 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1696a-cf6b-42ab-ab0d-91f67b4511b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:09.311194 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee1696a-cf6b-42ab-ab0d-91f67b4511b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:51:09.318927 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-0ee1696a-cf6b-42ab-ab0d-91f67b4511b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:51:09.318927 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:51:09.318927 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:51:09.318927 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:51:09.318927 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:51:09.318927 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:51:09.318927 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:51:09.318927 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:51:09.318927 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:51:09.318927 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:51:09.318927 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:51:09.318927 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:51:09.318927 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:51:09.318927 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:51:09.318927 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:51:09.318927 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:51:09.320117 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:51:09.320117 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:51:09.320117 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:51:09.320117 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:51:09.320117 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:51:09.320117 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:51:09.320117 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:51:09.320117 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:51:09.320117 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:51:09.320117 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:51:09.320117 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:51:09.320117 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:51:09.320117 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:51:09.320117 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:51:09.320117 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:51:09.320117 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:51:09.321823 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:51:09.321823 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:51:09.321823 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:51:09.321823 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:51:09.321823 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:51:09.321823 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:51:09.321823 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:51:09.321823 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:51:09.321823 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:51:09.321823 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:51:09.321823 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:51:09.321823 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:51:09.321823 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 601/1222] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 11 20:51:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:51:09.326759 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca0978-0e14-4ece-8004-be24219e3ee1 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:09.424053 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca0978-0e14-4ece-8004-be24219e3ee1 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:09.448250 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:09.458378 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ce608-9ed2-40e3-90b4-552a6ce0601a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:09.459101 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ce608-9ed2-40e3-90b4-552a6ce0601a None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:09.459381 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ce608-9ed2-40e3-90b4-552a6ce0601a None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:09.459658 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ce608-9ed2-40e3-90b4-552a6ce0601a None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:09.460431 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ce608-9ed2-40e3-90b4-552a6ce0601a None admin] RBAC: Adding query filter params (name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:51:09.460745 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ce608-9ed2-40e3-90b4-552a6ce0601a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:09.462141 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ce608-9ed2-40e3-90b4-552a6ce0601a None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:09.469837 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 622/1223] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jul 11 20:51:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:51:09.475487 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1696a-cf6b-42ab-ab0d-91f67b4511b1 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:09.519096 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:09.577962 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1696a-cf6b-42ab-ab0d-91f67b4511b1 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:09.611808 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8605e-f5e7-492d-b06f-7b1fdf553243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:09.612634 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8605e-f5e7-492d-b06f-7b1fdf553243 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:09.612925 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8605e-f5e7-492d-b06f-7b1fdf553243 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:09.613208 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8605e-f5e7-492d-b06f-7b1fdf553243 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:09.624594 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e8605e-f5e7-492d-b06f-7b1fdf553243 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:09.626033 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e8605e-f5e7-492d-b06f-7b1fdf553243 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:09.643855 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-64e8605e-f5e7-492d-b06f-7b1fdf553243 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:51:09.643855 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:51:09.643855 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:51:09.643855 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:51:09.643855 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:51:09.643855 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:51:09.643855 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:51:09.643855 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:51:09.643855 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:51:09.643855 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:51:09.643855 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:51:09.643855 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:51:09.643855 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:51:09.643855 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:51:09.643855 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:51:09.644911 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:51:09.644911 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:51:09.644911 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:51:09.644911 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:51:09.644911 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:51:09.644911 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:51:09.644911 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:51:09.644911 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:51:09.644911 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:51:09.644911 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:51:09.644911 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:51:09.644911 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:51:09.644911 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:51:09.644911 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:51:09.644911 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:51:09.644911 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:51:09.644911 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:51:09.646210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:51:09.646210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:51:09.646210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:51:09.646210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:51:09.646210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 602/1224] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:51:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:51:09.651073 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ce608-9ed2-40e3-90b4-552a6ce0601a None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:09.751291 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ce608-9ed2-40e3-90b4-552a6ce0601a None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:09.783708 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729e6f1-64fc-46c7-bc04-6e97d569e07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:09.784443 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729e6f1-64fc-46c7-bc04-6e97d569e07a None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:09.784728 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729e6f1-64fc-46c7-bc04-6e97d569e07a None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:09.785018 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729e6f1-64fc-46c7-bc04-6e97d569e07a None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:09.785711 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c729e6f1-64fc-46c7-bc04-6e97d569e07a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:51:09.786018 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c729e6f1-64fc-46c7-bc04-6e97d569e07a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:09.787369 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c729e6f1-64fc-46c7-bc04-6e97d569e07a None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:09.799480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 623/1225] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:51:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:51:09.805692 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8605e-f5e7-492d-b06f-7b1fdf553243 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:09.898304 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:09.904731 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8605e-f5e7-492d-b06f-7b1fdf553243 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:09.938348 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46242fb-623d-4664-999f-4b10d63acfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:09.939151 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46242fb-623d-4664-999f-4b10d63acfc2 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:09.939438 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46242fb-623d-4664-999f-4b10d63acfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:09.939714 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46242fb-623d-4664-999f-4b10d63acfc2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:09.947393 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46242fb-623d-4664-999f-4b10d63acfc2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:09.948946 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46242fb-623d-4664-999f-4b10d63acfc2 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:09.963231 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-e46242fb-623d-4664-999f-4b10d63acfc2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 20:51:09.963231 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:51:09.963231 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:51:09.963231 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:51:09.963231 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:51:09.963231 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:51:09.963231 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:51:09.963231 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:51:09.963231 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:51:09.963231 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:51:09.963231 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:51:09.963231 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:51:09.963231 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:51:09.963231 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:51:09.963231 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:51:09.963231 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:51:09.964560 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:51:09.964560 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:51:09.964560 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:51:09.964560 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:51:09.964560 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:51:09.964560 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:51:09.964560 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:51:09.964560 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:51:09.964560 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:51:09.964560 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:51:09.964560 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:51:09.964560 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:51:09.964560 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:51:09.964560 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:51:09.964560 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:51:09.964560 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:51:09.964560 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:51:09.964560 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:51:09.965549 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:51:09.965549 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:51:09.965549 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:51:09.965549 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:51:09.965549 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:51:09.965549 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:51:09.965549 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:51:09.965549 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:51:09.965549 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 20:51:09.965549 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:51:09.965549 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 603/1226] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:51:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:51:09.970556 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729e6f1-64fc-46c7-bc04-6e97d569e07a None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:10.017424 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:10.070106 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729e6f1-64fc-46c7-bc04-6e97d569e07a None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:10.103570 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685dbb8e-9317-4767-9b8a-1d525315caaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:10.104265 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685dbb8e-9317-4767-9b8a-1d525315caaa None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:10.104551 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685dbb8e-9317-4767-9b8a-1d525315caaa None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:10.104827 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685dbb8e-9317-4767-9b8a-1d525315caaa None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:10.105649 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685dbb8e-9317-4767-9b8a-1d525315caaa None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:51:10.105961 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685dbb8e-9317-4767-9b8a-1d525315caaa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:10.107397 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685dbb8e-9317-4767-9b8a-1d525315caaa None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:10.124277 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 624/1227] 10.222.0.40 () {56 vars in 1143 bytes} [Mon Jul 11 20:51:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:51:10.130371 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46242fb-623d-4664-999f-4b10d63acfc2 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:10.232060 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46242fb-623d-4664-999f-4b10d63acfc2 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:10.265628 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19798cd2-102f-4398-8914-5856aacb9506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:10.266415 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19798cd2-102f-4398-8914-5856aacb9506 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:10.266699 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19798cd2-102f-4398-8914-5856aacb9506 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:10.266973 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19798cd2-102f-4398-8914-5856aacb9506 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:10.278141 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19798cd2-102f-4398-8914-5856aacb9506 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:10.279652 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19798cd2-102f-4398-8914-5856aacb9506 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:10.297167 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-19798cd2-102f-4398-8914-5856aacb9506 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:51:10.297167 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:51:10.297167 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:51:10.297167 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:51:10.297167 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:51:10.297167 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:51:10.297167 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:51:10.297167 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:51:10.297167 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:51:10.297167 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:51:10.297167 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:51:10.297167 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:51:10.297167 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:51:10.297167 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:51:10.297167 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:51:10.298290 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:51:10.298290 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:51:10.298290 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:51:10.298290 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:51:10.298290 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:51:10.298290 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:51:10.298290 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:51:10.298290 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:51:10.298290 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:51:10.298290 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:51:10.298290 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:51:10.298290 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:51:10.298290 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:51:10.298290 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:51:10.298290 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:51:10.298290 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:51:10.298290 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:51:10.299423 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:51:10.299423 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:51:10.299423 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:51:10.299423 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:51:10.299423 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 604/1228] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:51:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:51:10.304314 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685dbb8e-9317-4767-9b8a-1d525315caaa None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:10.401756 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685dbb8e-9317-4767-9b8a-1d525315caaa None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:10.404028 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:10.435363 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe8a2e-95ef-40ad-acf7-96a8c04ef172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:10.436061 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe8a2e-95ef-40ad-acf7-96a8c04ef172 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:10.436353 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe8a2e-95ef-40ad-acf7-96a8c04ef172 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:10.436641 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe8a2e-95ef-40ad-acf7-96a8c04ef172 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:10.437356 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfe8a2e-95ef-40ad-acf7-96a8c04ef172 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:51:10.437672 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfe8a2e-95ef-40ad-acf7-96a8c04ef172 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:10.439037 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfe8a2e-95ef-40ad-acf7-96a8c04ef172 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:10.450698 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 625/1229] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:51:10.456648 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19798cd2-102f-4398-8914-5856aacb9506 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:10.466442 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:10.554945 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19798cd2-102f-4398-8914-5856aacb9506 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:10.588324 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3eadd1-8fb8-4370-a212-a1e07a7cd8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:10.589115 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3eadd1-8fb8-4370-a212-a1e07a7cd8cc None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:10.589403 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3eadd1-8fb8-4370-a212-a1e07a7cd8cc None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:10.589684 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3eadd1-8fb8-4370-a212-a1e07a7cd8cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:10.596239 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3eadd1-8fb8-4370-a212-a1e07a7cd8cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:10.597666 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3eadd1-8fb8-4370-a212-a1e07a7cd8cc None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:10.612437 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-af3eadd1-8fb8-4370-a212-a1e07a7cd8cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:51:10.612437 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:51:10.612437 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:51:10.612437 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:51:10.612437 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:51:10.612437 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:51:10.612437 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:51:10.612437 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:51:10.612437 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:51:10.612437 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:51:10.612437 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:51:10.612437 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:51:10.612437 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:51:10.612437 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:51:10.612437 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:51:10.613514 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:51:10.613514 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:51:10.613514 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:51:10.613514 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:51:10.613514 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:51:10.613514 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:51:10.613514 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:51:10.613514 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:51:10.613514 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:51:10.613514 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:51:10.613514 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:51:10.613514 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:51:10.613514 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:51:10.613514 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:51:10.613514 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:51:10.613514 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:51:10.613514 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:51:10.614763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:51:10.614763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:51:10.614763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:51:10.614763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:51:10.614763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:51:10.614763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:51:10.614763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:51:10.614763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:51:10.614763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 605/1230] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:51:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:51:10.619501 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe8a2e-95ef-40ad-acf7-96a8c04ef172 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:10.718985 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe8a2e-95ef-40ad-acf7-96a8c04ef172 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:10.751356 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca39a6e-b21e-4f2e-9a46-a20ffbf7168f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:10.752296 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca39a6e-b21e-4f2e-9a46-a20ffbf7168f None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:10.752588 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca39a6e-b21e-4f2e-9a46-a20ffbf7168f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:10.752869 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca39a6e-b21e-4f2e-9a46-a20ffbf7168f None admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:10.753651 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca39a6e-b21e-4f2e-9a46-a20ffbf7168f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:51:10.753968 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca39a6e-b21e-4f2e-9a46-a20ffbf7168f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:10.755394 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca39a6e-b21e-4f2e-9a46-a20ffbf7168f None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:10.767646 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 626/1231] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 11 20:51:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:51:10.773657 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3eadd1-8fb8-4370-a212-a1e07a7cd8cc None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:10.839401 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:10.872893 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3eadd1-8fb8-4370-a212-a1e07a7cd8cc None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:10.906511 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57609d5-c5b8-498e-9ec4-fe6fc249a1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:10.907397 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57609d5-c5b8-498e-9ec4-fe6fc249a1dc None admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:10.907716 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57609d5-c5b8-498e-9ec4-fe6fc249a1dc None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:10.907959 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57609d5-c5b8-498e-9ec4-fe6fc249a1dc None admin] PATH_INFO: `/v3/projects/eca3ef2561fa435e80ff451aeab14f3b/users/177a912380ad43b6a5e31b787a07ce7d/roles/17bc727d82f24074aba8b1185cb99739` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:10.922028 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57609d5-c5b8-498e-9ec4-fe6fc249a1dc None admin] RBAC: Authorizing `identity:create_grant(project_id=eca3ef2561fa435e80ff451aeab14f3b, user_id=177a912380ad43b6a5e31b787a07ce7d, role_id=17bc727d82f24074aba8b1185cb99739)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:10.929248 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57609d5-c5b8-498e-9ec4-fe6fc249a1dc None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:11.006068 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 606/1232] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 11 20:51:10 2022] PUT /identity/v3/projects/eca3ef2561fa435e80ff451aeab14f3b/users/177a912380ad43b6a5e31b787a07ce7d/roles/17bc727d82f24074aba8b1185cb99739 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:51:13.000828 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7565464-3010-49c8-a013-e5db3a84f060 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:13.001441 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7565464-3010-49c8-a013-e5db3a84f060 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:13.001441 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7565464-3010-49c8-a013-e5db3a84f060 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:13.003050 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 627/1233] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:51:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:51:13.008220 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed67b6-3829-4f00-92ad-ec40476152ce None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:13.008632 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed67b6-3829-4f00-92ad-ec40476152ce None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:13.009269 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed67b6-3829-4f00-92ad-ec40476152ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:13.026403 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-d7ed67b6-3829-4f00-92ad-ec40476152ce None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:51:13.027585 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d7ed67b6-3829-4f00-92ad-ec40476152ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:51:13.093522 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 607/1234] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:51:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:51:13.116878 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7565464-3010-49c8-a013-e5db3a84f060 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:13.142897 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:13.219394 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7565464-3010-49c8-a013-e5db3a84f060 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:13.254732 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241bd06c-602c-4ef6-a75d-841a1b1b98c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:13.255460 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bd06c-602c-4ef6-a75d-841a1b1b98c2 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:13.255751 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bd06c-602c-4ef6-a75d-841a1b1b98c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:13.256088 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bd06c-602c-4ef6-a75d-841a1b1b98c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:13.267124 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241bd06c-602c-4ef6-a75d-841a1b1b98c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:51:13.275307 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-241bd06c-602c-4ef6-a75d-841a1b1b98c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:51:13.275307 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:51:13.275307 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:51:13.275307 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:51:13.275307 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:51:13.275307 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:51:13.275307 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:51:13.275307 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:51:13.275307 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:51:13.275307 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:51:13.275307 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:51:13.275307 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:51:13.275307 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:51:13.275307 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:51:13.275307 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:51:13.275307 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:51:13.276580 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:51:13.276580 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:51:13.276580 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:51:13.276580 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:51:13.276580 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:51:13.276580 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:51:13.276580 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:51:13.276580 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:51:13.276580 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:51:13.276580 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:51:13.276580 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:51:13.276580 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:51:13.276580 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:51:13.276580 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:51:13.276580 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:51:13.276580 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:51:13.277767 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:51:13.277767 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:51:13.277767 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:51:13.277767 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:51:13.277767 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:51:13.277767 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:51:13.277767 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:51:13.277767 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:51:13.277767 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:51:13.277767 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:51:13.277767 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 20:51:13.277767 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:51:13.277767 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 628/1235] 10.222.0.40 () {56 vars in 1102 bytes} [Mon Jul 11 20:51:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:51:13.282570 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed67b6-3829-4f00-92ad-ec40476152ce None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:13.329749 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:13.383530 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed67b6-3829-4f00-92ad-ec40476152ce None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:13.418430 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0827895-e56c-442f-9ece-cc3f2d7520d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:13.419107 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0827895-e56c-442f-9ece-cc3f2d7520d6 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:13.419399 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0827895-e56c-442f-9ece-cc3f2d7520d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:13.419683 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0827895-e56c-442f-9ece-cc3f2d7520d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:13.420465 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0827895-e56c-442f-9ece-cc3f2d7520d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:51:13.420780 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0827895-e56c-442f-9ece-cc3f2d7520d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:13.422200 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0827895-e56c-442f-9ece-cc3f2d7520d6 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:13.431469 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 608/1236] 10.222.0.40 () {56 vars in 1103 bytes} [Mon Jul 11 20:51:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:51:13.437205 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241bd06c-602c-4ef6-a75d-841a1b1b98c2 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:13.524136 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:13.541129 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241bd06c-602c-4ef6-a75d-841a1b1b98c2 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:13.574707 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b09a5a-018e-4cb7-b481-66e18d88f958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:13.575467 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b09a5a-018e-4cb7-b481-66e18d88f958 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:13.575751 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b09a5a-018e-4cb7-b481-66e18d88f958 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:13.576055 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b09a5a-018e-4cb7-b481-66e18d88f958 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:13.585868 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b09a5a-018e-4cb7-b481-66e18d88f958 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:13.588151 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b09a5a-018e-4cb7-b481-66e18d88f958 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:13.605421 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-e4b09a5a-018e-4cb7-b481-66e18d88f958 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:51:13.605421 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:51:13.605421 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:51:13.605421 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:51:13.605421 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:51:13.605421 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:51:13.605421 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:51:13.605421 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:51:13.605421 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:51:13.605421 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:51:13.605421 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:51:13.605421 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:51:13.605421 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:51:13.605421 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:51:13.605421 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:51:13.606381 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:51:13.606381 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:51:13.606381 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:51:13.606381 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:51:13.606381 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:51:13.606381 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:51:13.606381 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:51:13.606381 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:51:13.606381 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:51:13.606381 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:51:13.606381 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:51:13.606381 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:51:13.606381 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:51:13.606381 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:51:13.606381 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:51:13.606381 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:51:13.606381 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:51:13.607622 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:51:13.607622 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:51:13.607622 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:51:13.607622 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:51:13.607622 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 629/1237] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:51:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:51:13.612542 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0827895-e56c-442f-9ece-cc3f2d7520d6 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:13.718973 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0827895-e56c-442f-9ece-cc3f2d7520d6 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:13.728696 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:13.753952 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d861b-b481-4263-b0c2-8a57ac0e682a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:13.754624 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d861b-b481-4263-b0c2-8a57ac0e682a None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:13.754915 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d861b-b481-4263-b0c2-8a57ac0e682a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:13.755195 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d861b-b481-4263-b0c2-8a57ac0e682a None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:13.755921 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23d861b-b481-4263-b0c2-8a57ac0e682a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:51:13.756265 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23d861b-b481-4263-b0c2-8a57ac0e682a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:13.757626 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23d861b-b481-4263-b0c2-8a57ac0e682a None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:13.768673 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 609/1238] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:51:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:51:13.775161 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b09a5a-018e-4cb7-b481-66e18d88f958 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:13.878424 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b09a5a-018e-4cb7-b481-66e18d88f958 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:13.912555 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259d498-b1d5-478a-a2a7-d752ea38d78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:13.913397 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259d498-b1d5-478a-a2a7-d752ea38d78f None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:13.913723 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259d498-b1d5-478a-a2a7-d752ea38d78f None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:13.914008 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259d498-b1d5-478a-a2a7-d752ea38d78f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:13.917358 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:13.921865 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259d498-b1d5-478a-a2a7-d752ea38d78f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:13.923312 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259d498-b1d5-478a-a2a7-d752ea38d78f None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:13.938168 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-6259d498-b1d5-478a-a2a7-d752ea38d78f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 20:51:13.938168 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:51:13.938168 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:51:13.938168 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:51:13.938168 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:51:13.938168 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:51:13.938168 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:51:13.938168 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:51:13.938168 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:51:13.938168 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:51:13.938168 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:51:13.938168 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:51:13.938168 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:51:13.938168 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:51:13.938168 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:51:13.938168 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:51:13.948416 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:51:13.948416 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:51:13.948416 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:51:13.948416 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:51:13.948416 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:51:13.948416 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:51:13.948416 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:51:13.948416 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:51:13.948416 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:51:13.948416 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:51:13.948416 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:51:13.948416 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:51:13.948416 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:51:13.948416 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:51:13.948416 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:51:13.948416 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:51:13.948416 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:51:13.948416 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:51:13.949355 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:51:13.949355 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:51:13.949355 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:51:13.949355 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:51:13.949355 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:51:13.949355 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:51:13.949355 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:51:13.949355 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:51:13.949355 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 20:51:13.949355 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:51:13.949355 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 630/1239] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:51:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:51:13.949950 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d861b-b481-4263-b0c2-8a57ac0e682a None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:14.045576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d861b-b481-4263-b0c2-8a57ac0e682a None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:14.081252 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59f23a-1723-47d8-896f-fd69bce0f61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:14.081925 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59f23a-1723-47d8-896f-fd69bce0f61d None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:14.082212 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59f23a-1723-47d8-896f-fd69bce0f61d None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:14.082490 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59f23a-1723-47d8-896f-fd69bce0f61d None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:14.083323 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a59f23a-1723-47d8-896f-fd69bce0f61d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:51:14.083637 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a59f23a-1723-47d8-896f-fd69bce0f61d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:14.085186 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a59f23a-1723-47d8-896f-fd69bce0f61d None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:14.104683 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 610/1240] 10.222.0.40 () {56 vars in 1143 bytes} [Mon Jul 11 20:51:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:51:14.110619 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259d498-b1d5-478a-a2a7-d752ea38d78f None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:14.220769 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259d498-b1d5-478a-a2a7-d752ea38d78f None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:14.254312 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6915ace-0628-40e2-a448-5d20f145af83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:14.255015 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6915ace-0628-40e2-a448-5d20f145af83 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:14.255301 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6915ace-0628-40e2-a448-5d20f145af83 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:14.255580 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6915ace-0628-40e2-a448-5d20f145af83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:14.315944 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:14.322923 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6915ace-0628-40e2-a448-5d20f145af83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:14.324504 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6915ace-0628-40e2-a448-5d20f145af83 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:14.422349 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 631/1241] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:51:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 20:51:14.428249 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59f23a-1723-47d8-896f-fd69bce0f61d None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:14.455799 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:14.528871 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59f23a-1723-47d8-896f-fd69bce0f61d None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:14.563817 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d19d83-a910-4824-be2b-3801086c7cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:14.564645 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d19d83-a910-4824-be2b-3801086c7cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:14.564936 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d19d83-a910-4824-be2b-3801086c7cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:14.565220 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d19d83-a910-4824-be2b-3801086c7cc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:14.576122 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d19d83-a910-4824-be2b-3801086c7cc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:14.577513 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d19d83-a910-4824-be2b-3801086c7cc3 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:14.595181 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-20d19d83-a910-4824-be2b-3801086c7cc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:51:14.595181 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:51:14.595181 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:51:14.595181 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:51:14.595181 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:51:14.595181 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:51:14.595181 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:51:14.595181 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:51:14.595181 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:51:14.595181 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:51:14.595181 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:51:14.595181 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:51:14.595181 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:51:14.595181 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:51:14.595181 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:51:14.596331 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:51:14.596331 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:51:14.596331 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:51:14.596331 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:51:14.596331 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:51:14.596331 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:51:14.596331 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:51:14.596331 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:51:14.596331 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:51:14.596331 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:51:14.596331 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:51:14.596331 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:51:14.596331 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:51:14.596331 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:51:14.596331 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:51:14.596331 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:51:14.596331 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:51:14.597644 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:51:14.597644 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:51:14.597644 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:51:14.597644 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:51:14.597644 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 611/1242] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:51:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:51:14.602185 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6915ace-0628-40e2-a448-5d20f145af83 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:14.695689 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:14.701551 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6915ace-0628-40e2-a448-5d20f145af83 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:14.734731 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef711430-c93d-4ba8-8f9e-561e7f9ec9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:14.735399 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef711430-c93d-4ba8-8f9e-561e7f9ec9d7 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:14.735705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef711430-c93d-4ba8-8f9e-561e7f9ec9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:14.736015 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef711430-c93d-4ba8-8f9e-561e7f9ec9d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:14.742887 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef711430-c93d-4ba8-8f9e-561e7f9ec9d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:51:14.742887 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef711430-c93d-4ba8-8f9e-561e7f9ec9d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:14.742887 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef711430-c93d-4ba8-8f9e-561e7f9ec9d7 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:14.751851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 632/1243] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:51:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:51:14.757831 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d19d83-a910-4824-be2b-3801086c7cc3 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:14.835624 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:14.857560 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d19d83-a910-4824-be2b-3801086c7cc3 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:14.891090 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3af9e2-6cfa-4a1f-b624-ebdc0e3798a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:14.891887 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3af9e2-6cfa-4a1f-b624-ebdc0e3798a2 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:14.892253 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3af9e2-6cfa-4a1f-b624-ebdc0e3798a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:14.892535 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3af9e2-6cfa-4a1f-b624-ebdc0e3798a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:14.899093 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3af9e2-6cfa-4a1f-b624-ebdc0e3798a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:14.901292 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3af9e2-6cfa-4a1f-b624-ebdc0e3798a2 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:14.914732 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-7b3af9e2-6cfa-4a1f-b624-ebdc0e3798a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:51:14.914732 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:51:14.914732 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:51:14.914732 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:51:14.914732 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:51:14.914732 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:51:14.914732 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:51:14.914732 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:51:14.914732 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:51:14.914732 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:51:14.914732 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:51:14.914732 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:51:14.914732 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:51:14.914732 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:51:14.914732 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:51:14.918697 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:51:14.918697 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:51:14.918697 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:51:14.918697 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:51:14.918697 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:51:14.918697 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:51:14.918697 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:51:14.918697 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:51:14.918697 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:51:14.918697 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:51:14.918697 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:51:14.918697 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:51:14.918697 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:51:14.918697 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:51:14.918697 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:51:14.918697 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:51:14.918697 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:51:14.919844 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:51:14.919844 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:51:14.919844 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:51:14.919844 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:51:14.919844 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:51:14.919844 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:51:14.919844 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:51:14.919844 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:51:14.919844 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 612/1244] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:51:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:51:14.922394 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef711430-c93d-4ba8-8f9e-561e7f9ec9d7 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:15.027003 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef711430-c93d-4ba8-8f9e-561e7f9ec9d7 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:15.060862 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e37c5-329e-4f10-8d9c-0aea2681fe72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:15.061532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e37c5-329e-4f10-8d9c-0aea2681fe72 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:15.061852 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e37c5-329e-4f10-8d9c-0aea2681fe72 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:15.062132 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e37c5-329e-4f10-8d9c-0aea2681fe72 None admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:15.062910 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e37c5-329e-4f10-8d9c-0aea2681fe72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:51:15.063225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e37c5-329e-4f10-8d9c-0aea2681fe72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:15.064696 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e37c5-329e-4f10-8d9c-0aea2681fe72 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:15.079616 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 633/1245] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 11 20:51:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:51:15.085587 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3af9e2-6cfa-4a1f-b624-ebdc0e3798a2 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:15.184863 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3af9e2-6cfa-4a1f-b624-ebdc0e3798a2 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:15.217909 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91b2c0-e398-447e-abf5-83f6ca864faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:15.218617 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91b2c0-e398-447e-abf5-83f6ca864faa None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:15.218904 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91b2c0-e398-447e-abf5-83f6ca864faa None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:15.219180 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91b2c0-e398-447e-abf5-83f6ca864faa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:15.220028 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91b2c0-e398-447e-abf5-83f6ca864faa None admin] RBAC: Adding query filter params (role.id=17bc727d82f24074aba8b1185cb99739, scope.project.id=eca3ef2561fa435e80ff451aeab14f3b, user.id=177a912380ad43b6a5e31b787a07ce7d) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:51:15.220359 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91b2c0-e398-447e-abf5-83f6ca864faa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:15.221771 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91b2c0-e398-447e-abf5-83f6ca864faa None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:15.227502 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 613/1246] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:51:15 2022] GET /identity/v3/role_assignments?user.id=177a912380ad43b6a5e31b787a07ce7d&scope.project.id=eca3ef2561fa435e80ff451aeab14f3b&role.id=17bc727d82f24074aba8b1185cb99739 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:51:17.300864 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d074f-9784-4d68-b627-648f2d5a6471 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:17.301440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d074f-9784-4d68-b627-648f2d5a6471 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:17.301440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d074f-9784-4d68-b627-648f2d5a6471 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:17.302796 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 634/1247] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:51:17.308074 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302fe31-b87c-4c91-8bc0-820acca54f58 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:17.308518 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302fe31-b87c-4c91-8bc0-820acca54f58 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:17.308707 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302fe31-b87c-4c91-8bc0-820acca54f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:17.313650 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:17.326078 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-0302fe31-b87c-4c91-8bc0-820acca54f58 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:51:17.327247 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-0302fe31-b87c-4c91-8bc0-820acca54f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:51:17.391612 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 614/1248] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:51:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:51:17.415478 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d074f-9784-4d68-b627-648f2d5a6471 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:17.433688 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:17.516171 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d074f-9784-4d68-b627-648f2d5a6471 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:17.550026 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae9587-9a40-44d9-a18d-0f13af22e5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:17.550818 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae9587-9a40-44d9-a18d-0f13af22e5a7 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:17.551153 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae9587-9a40-44d9-a18d-0f13af22e5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:17.551384 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae9587-9a40-44d9-a18d-0f13af22e5a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:17.562001 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae9587-9a40-44d9-a18d-0f13af22e5a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:51:17.569654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-33ae9587-9a40-44d9-a18d-0f13af22e5a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:51:17.569654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:51:17.569654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:51:17.569654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:51:17.569654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:51:17.569654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:51:17.569654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:51:17.569654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:51:17.569654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:51:17.569654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:51:17.569654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:51:17.569654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:51:17.569654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:51:17.569654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:51:17.569654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:51:17.569654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:51:17.573190 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:51:17.573190 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:51:17.573190 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:51:17.573190 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:51:17.573190 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:51:17.573190 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:51:17.573190 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:51:17.573190 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:51:17.573190 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:51:17.573190 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:51:17.573190 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:51:17.573190 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:51:17.573190 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:51:17.573190 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:51:17.573190 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:51:17.573190 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:51:17.574119 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:51:17.574119 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:51:17.574119 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:51:17.574119 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:51:17.574119 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:51:17.574119 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:51:17.574119 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:51:17.574119 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:51:17.574119 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:51:17.574119 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:51:17.574119 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:51:17.574119 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:51:17.574119 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 635/1249] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 11 20:51:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:51:17.577519 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302fe31-b87c-4c91-8bc0-820acca54f58 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:17.674955 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302fe31-b87c-4c91-8bc0-820acca54f58 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:17.704966 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:17.709751 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ace70-5773-4f13-8fb7-80dc6927e5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:17.710421 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ace70-5773-4f13-8fb7-80dc6927e5f3 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:17.710708 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ace70-5773-4f13-8fb7-80dc6927e5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:17.710988 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ace70-5773-4f13-8fb7-80dc6927e5f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:17.711730 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8ace70-5773-4f13-8fb7-80dc6927e5f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:51:17.712066 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8ace70-5773-4f13-8fb7-80dc6927e5f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:17.713622 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8ace70-5773-4f13-8fb7-80dc6927e5f3 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:17.721563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 615/1250] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:51:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:51:17.727362 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae9587-9a40-44d9-a18d-0f13af22e5a7 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:17.804542 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:17.829608 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae9587-9a40-44d9-a18d-0f13af22e5a7 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:17.863158 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b96f1-3925-410e-917c-e2dacabdfa86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:17.866351 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b96f1-3925-410e-917c-e2dacabdfa86 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:17.866351 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b96f1-3925-410e-917c-e2dacabdfa86 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:17.866351 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b96f1-3925-410e-917c-e2dacabdfa86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:17.875985 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b96f1-3925-410e-917c-e2dacabdfa86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:17.877672 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b96f1-3925-410e-917c-e2dacabdfa86 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:17.895015 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-642b96f1-3925-410e-917c-e2dacabdfa86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:51:17.895015 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:51:17.895015 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:51:17.895015 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:51:17.895015 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:51:17.895015 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:51:17.895015 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:51:17.895015 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:51:17.895015 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:51:17.895015 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:51:17.895015 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:51:17.895015 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:51:17.895015 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:51:17.895015 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:51:17.895015 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:51:17.898594 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:51:17.898594 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:51:17.898594 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:51:17.898594 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:51:17.898594 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:51:17.898594 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:51:17.898594 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:51:17.898594 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:51:17.898594 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:51:17.898594 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:51:17.898594 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:51:17.898594 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:51:17.898594 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:51:17.898594 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:51:17.898594 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:51:17.898594 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:51:17.898594 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:51:17.899737 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:51:17.899737 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:51:17.899737 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:51:17.899737 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:51:17.899737 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 636/1251] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:51:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:51:17.902087 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ace70-5773-4f13-8fb7-80dc6927e5f3 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:18.000489 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ace70-5773-4f13-8fb7-80dc6927e5f3 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:18.034829 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a3f25-7537-46a9-90c5-3815581516c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:18.035557 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a3f25-7537-46a9-90c5-3815581516c5 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:18.035841 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a3f25-7537-46a9-90c5-3815581516c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:18.036158 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a3f25-7537-46a9-90c5-3815581516c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:18.036874 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620a3f25-7537-46a9-90c5-3815581516c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:51:18.037184 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620a3f25-7537-46a9-90c5-3815581516c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:18.038532 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620a3f25-7537-46a9-90c5-3815581516c5 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:18.049983 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 616/1252] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:51:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:51:18.055747 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b96f1-3925-410e-917c-e2dacabdfa86 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:18.159090 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b96f1-3925-410e-917c-e2dacabdfa86 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:18.185767 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:18.193420 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca235f-9eaf-4421-9172-3da1412a4c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:18.194225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca235f-9eaf-4421-9172-3da1412a4c2b None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:18.194514 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca235f-9eaf-4421-9172-3da1412a4c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:18.194793 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca235f-9eaf-4421-9172-3da1412a4c2b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:18.202787 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca235f-9eaf-4421-9172-3da1412a4c2b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:18.204302 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca235f-9eaf-4421-9172-3da1412a4c2b None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:18.218883 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-2cca235f-9eaf-4421-9172-3da1412a4c2b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 20:51:18.218883 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:51:18.218883 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:51:18.218883 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:51:18.218883 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:51:18.218883 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:51:18.218883 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:51:18.218883 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:51:18.218883 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:51:18.218883 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:51:18.218883 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:51:18.218883 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:51:18.218883 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:51:18.218883 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:51:18.218883 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:51:18.218883 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:51:18.219931 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:51:18.219931 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:51:18.219931 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:51:18.219931 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:51:18.219931 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:51:18.219931 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:51:18.219931 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:51:18.219931 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:51:18.219931 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:51:18.219931 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:51:18.219931 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:51:18.219931 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:51:18.219931 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:51:18.219931 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:51:18.219931 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:51:18.219931 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:51:18.219931 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:51:18.219931 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:51:18.221012 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:51:18.221012 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:51:18.221012 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:51:18.221012 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:51:18.221012 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:51:18.221012 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:51:18.221012 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:51:18.221012 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:51:18.221012 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 20:51:18.221012 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:51:18.221012 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 637/1253] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:51:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:51:18.226018 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a3f25-7537-46a9-90c5-3815581516c5 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:18.284191 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:18.329612 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a3f25-7537-46a9-90c5-3815581516c5 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:18.364136 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4aff6-71ff-457e-a687-d63f7a3f3fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:18.364816 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4aff6-71ff-457e-a687-d63f7a3f3fdc None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:18.365106 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4aff6-71ff-457e-a687-d63f7a3f3fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:18.365388 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4aff6-71ff-457e-a687-d63f7a3f3fdc None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:18.366220 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a4aff6-71ff-457e-a687-d63f7a3f3fdc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:51:18.366630 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a4aff6-71ff-457e-a687-d63f7a3f3fdc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:18.368158 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a4aff6-71ff-457e-a687-d63f7a3f3fdc None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:18.386660 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 617/1254] 10.222.0.40 () {56 vars in 1143 bytes} [Mon Jul 11 20:51:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:51:18.392438 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca235f-9eaf-4421-9172-3da1412a4c2b None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:18.491425 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca235f-9eaf-4421-9172-3da1412a4c2b None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:18.524877 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b003ece-ece3-4ffc-aada-89ef41814e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:18.526108 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b003ece-ece3-4ffc-aada-89ef41814e3a None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:18.526398 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b003ece-ece3-4ffc-aada-89ef41814e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:18.526671 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b003ece-ece3-4ffc-aada-89ef41814e3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:18.580572 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:18.593221 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b003ece-ece3-4ffc-aada-89ef41814e3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:18.594658 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b003ece-ece3-4ffc-aada-89ef41814e3a None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:18.691378 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 638/1255] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:51:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 20:51:18.697858 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4aff6-71ff-457e-a687-d63f7a3f3fdc None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:18.795174 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4aff6-71ff-457e-a687-d63f7a3f3fdc None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:18.808449 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:18.828487 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04cb79-4cac-440b-bb82-802513006d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:18.829264 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04cb79-4cac-440b-bb82-802513006d0a None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:18.829554 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04cb79-4cac-440b-bb82-802513006d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:18.829831 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04cb79-4cac-440b-bb82-802513006d0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:18.840040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc04cb79-4cac-440b-bb82-802513006d0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:18.841426 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc04cb79-4cac-440b-bb82-802513006d0a None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:18.858052 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-bc04cb79-4cac-440b-bb82-802513006d0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:51:18.858052 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:51:18.858052 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:51:18.858052 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:51:18.858052 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:51:18.858052 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:51:18.858052 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:51:18.858052 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:51:18.858052 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:51:18.858052 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:51:18.858052 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:51:18.858052 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:51:18.858052 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:51:18.858052 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:51:18.858052 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:51:18.860770 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:51:18.860770 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:51:18.860770 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:51:18.860770 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:51:18.860770 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:51:18.860770 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:51:18.860770 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:51:18.860770 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:51:18.860770 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:51:18.860770 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:51:18.860770 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:51:18.860770 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:51:18.860770 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:51:18.860770 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:51:18.860770 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:51:18.860770 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:51:18.860770 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:51:18.861670 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:51:18.861670 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:51:18.861670 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:51:18.861670 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:51:18.861670 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 618/1256] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:51:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:51:18.865160 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b003ece-ece3-4ffc-aada-89ef41814e3a None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:18.951663 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:18.963584 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b003ece-ece3-4ffc-aada-89ef41814e3a None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:18.996177 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86546097-f2b6-440a-aad7-e3f8934c4396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:18.996847 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86546097-f2b6-440a-aad7-e3f8934c4396 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:18.997129 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86546097-f2b6-440a-aad7-e3f8934c4396 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:18.997402 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86546097-f2b6-440a-aad7-e3f8934c4396 None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:18.998149 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86546097-f2b6-440a-aad7-e3f8934c4396 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:51:18.998488 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86546097-f2b6-440a-aad7-e3f8934c4396 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:18.999848 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86546097-f2b6-440a-aad7-e3f8934c4396 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:19.011695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 639/1257] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 20:51:19.017342 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04cb79-4cac-440b-bb82-802513006d0a None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:19.119811 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04cb79-4cac-440b-bb82-802513006d0a None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:19.154208 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb6cac-4909-46b1-9809-8deae0954756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:19.155066 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb6cac-4909-46b1-9809-8deae0954756 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:19.155358 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb6cac-4909-46b1-9809-8deae0954756 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:19.155641 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb6cac-4909-46b1-9809-8deae0954756 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:19.162480 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eb6cac-4909-46b1-9809-8deae0954756 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:19.163913 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eb6cac-4909-46b1-9809-8deae0954756 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:19.177594 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-c2eb6cac-4909-46b1-9809-8deae0954756 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:51:19.177594 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:51:19.177594 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:51:19.177594 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:51:19.177594 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:51:19.177594 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:51:19.177594 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:51:19.177594 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:51:19.177594 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:51:19.177594 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:51:19.177594 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:51:19.177594 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:51:19.177594 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:51:19.177594 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:51:19.177594 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:51:19.181005 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:51:19.181005 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:51:19.181005 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:51:19.181005 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:51:19.181005 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:51:19.181005 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:51:19.181005 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:51:19.181005 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:51:19.181005 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:51:19.181005 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:51:19.181005 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:51:19.181005 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:51:19.181005 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:51:19.181005 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:51:19.181005 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:51:19.181005 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:51:19.181005 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:51:19.182598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:51:19.182598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:51:19.182598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:51:19.182598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:51:19.182598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:51:19.182598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:51:19.182598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:51:19.182598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:51:19.182598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 619/1258] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:51:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:51:19.185529 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86546097-f2b6-440a-aad7-e3f8934c4396 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:19.283737 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86546097-f2b6-440a-aad7-e3f8934c4396 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:19.316100 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9b7fe-c3d3-4249-8ddb-b2a967188678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:19.316762 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9b7fe-c3d3-4249-8ddb-b2a967188678 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:19.317045 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9b7fe-c3d3-4249-8ddb-b2a967188678 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:19.317327 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9b7fe-c3d3-4249-8ddb-b2a967188678 None admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:19.318099 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc9b7fe-c3d3-4249-8ddb-b2a967188678 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:51:19.318412 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc9b7fe-c3d3-4249-8ddb-b2a967188678 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:19.319842 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc9b7fe-c3d3-4249-8ddb-b2a967188678 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:19.333062 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 640/1259] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 11 20:51:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:51:19.339177 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb6cac-4909-46b1-9809-8deae0954756 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:19.364409 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:19.439074 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb6cac-4909-46b1-9809-8deae0954756 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:19.471775 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c74070c-36f4-455c-a5eb-e19278aab65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:19.472463 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74070c-36f4-455c-a5eb-e19278aab65d None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:19.472752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74070c-36f4-455c-a5eb-e19278aab65d None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:19.473035 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74070c-36f4-455c-a5eb-e19278aab65d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:19.473907 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c74070c-36f4-455c-a5eb-e19278aab65d None admin] RBAC: Adding query filter params (role.id=86273ff072f3438d822e870272491768, scope.project.id=eca3ef2561fa435e80ff451aeab14f3b, user.id=177a912380ad43b6a5e31b787a07ce7d) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:51:19.474227 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c74070c-36f4-455c-a5eb-e19278aab65d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:19.475644 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c74070c-36f4-455c-a5eb-e19278aab65d None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:19.481636 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 620/1260] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:51:19 2022] GET /identity/v3/role_assignments?user.id=177a912380ad43b6a5e31b787a07ce7d&scope.project.id=eca3ef2561fa435e80ff451aeab14f3b&role.id=86273ff072f3438d822e870272491768 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:51:21.498391 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ce9b6-bc96-47b7-86e7-ad45b0d49bb2 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:21.498973 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ce9b6-bc96-47b7-86e7-ad45b0d49bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:21.499078 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ce9b6-bc96-47b7-86e7-ad45b0d49bb2 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:21.500599 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 641/1261] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:51:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:51:21.505939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166518f-7670-405a-8d10-4b5627d78b42 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:21.506356 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166518f-7670-405a-8d10-4b5627d78b42 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:21.506504 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166518f-7670-405a-8d10-4b5627d78b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:21.523567 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-6166518f-7670-405a-8d10-4b5627d78b42 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:51:21.525646 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-6166518f-7670-405a-8d10-4b5627d78b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:51:21.590079 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 621/1262] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:51:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:51:21.612438 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ce9b6-bc96-47b7-86e7-ad45b0d49bb2 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:21.623948 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:21.711346 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ce9b6-bc96-47b7-86e7-ad45b0d49bb2 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:21.744804 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14673502-3ae0-4d45-a75d-b27dab42d7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:21.745615 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14673502-3ae0-4d45-a75d-b27dab42d7f2 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:21.745898 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14673502-3ae0-4d45-a75d-b27dab42d7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:21.746183 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14673502-3ae0-4d45-a75d-b27dab42d7f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:21.756130 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14673502-3ae0-4d45-a75d-b27dab42d7f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:51:21.764162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-14673502-3ae0-4d45-a75d-b27dab42d7f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:51:21.764162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:51:21.764162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:51:21.764162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:51:21.764162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:51:21.764162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:51:21.764162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:51:21.764162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:51:21.764162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:51:21.764162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:51:21.764162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:51:21.764162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:51:21.764162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:51:21.764162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:51:21.764162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:51:21.764162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:51:21.767424 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:51:21.767424 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:51:21.767424 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:51:21.767424 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:51:21.767424 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:51:21.767424 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:51:21.767424 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:51:21.767424 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:51:21.767424 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:51:21.767424 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:51:21.767424 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:51:21.767424 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:51:21.767424 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:51:21.767424 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:51:21.767424 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:51:21.767424 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:51:21.768424 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:51:21.768424 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:51:21.768424 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:51:21.768424 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:51:21.768424 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:51:21.768424 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:51:21.768424 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:51:21.768424 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:51:21.768424 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:51:21.768424 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:51:21.768424 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:51:21.768424 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:51:21.768424 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 642/1263] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 11 20:51:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:51:21.771463 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166518f-7670-405a-8d10-4b5627d78b42 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:21.790546 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:21.871777 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166518f-7670-405a-8d10-4b5627d78b42 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:21.906638 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120f4b9-32a7-4e22-a769-37132aa9cf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:21.907307 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120f4b9-32a7-4e22-a769-37132aa9cf1c None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:21.907608 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120f4b9-32a7-4e22-a769-37132aa9cf1c None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:21.908064 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120f4b9-32a7-4e22-a769-37132aa9cf1c None admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:21.908819 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120f4b9-32a7-4e22-a769-37132aa9cf1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:51:21.909136 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120f4b9-32a7-4e22-a769-37132aa9cf1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:21.910503 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120f4b9-32a7-4e22-a769-37132aa9cf1c None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:21.918639 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 622/1264] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:51:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:51:21.924491 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14673502-3ae0-4d45-a75d-b27dab42d7f2 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:21.990592 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:22.023215 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14673502-3ae0-4d45-a75d-b27dab42d7f2 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:22.056237 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3bdb54-4179-4172-9284-f7ddcd35c6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:22.057775 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3bdb54-4179-4172-9284-f7ddcd35c6b2 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:22.058060 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3bdb54-4179-4172-9284-f7ddcd35c6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:22.058336 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3bdb54-4179-4172-9284-f7ddcd35c6b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:22.068542 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3bdb54-4179-4172-9284-f7ddcd35c6b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:22.069985 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3bdb54-4179-4172-9284-f7ddcd35c6b2 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:22.087136 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-ab3bdb54-4179-4172-9284-f7ddcd35c6b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:51:22.087136 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:51:22.087136 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:51:22.087136 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:51:22.087136 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:51:22.087136 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:51:22.087136 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:51:22.087136 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:51:22.087136 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:51:22.087136 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:51:22.087136 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:51:22.087136 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:51:22.087136 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:51:22.087136 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:51:22.087136 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:51:22.088592 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:51:22.088592 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:51:22.088592 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:51:22.088592 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:51:22.088592 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:51:22.088592 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:51:22.088592 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:51:22.088592 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:51:22.088592 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:51:22.088592 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:51:22.088592 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:51:22.088592 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:51:22.088592 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:51:22.088592 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:51:22.088592 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:51:22.088592 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:51:22.088592 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:51:22.089729 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:51:22.089729 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:51:22.089729 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:51:22.089729 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:51:22.089729 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 643/1265] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:51:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:51:22.094278 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120f4b9-32a7-4e22-a769-37132aa9cf1c None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:22.174755 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:22.193676 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120f4b9-32a7-4e22-a769-37132aa9cf1c None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:22.227369 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf40cf15-9726-4e3d-9861-7c849a5a8027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:22.228110 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40cf15-9726-4e3d-9861-7c849a5a8027 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:22.228463 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40cf15-9726-4e3d-9861-7c849a5a8027 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:22.228702 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40cf15-9726-4e3d-9861-7c849a5a8027 None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:22.229422 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf40cf15-9726-4e3d-9861-7c849a5a8027 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:51:22.229734 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf40cf15-9726-4e3d-9861-7c849a5a8027 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:22.231089 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf40cf15-9726-4e3d-9861-7c849a5a8027 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:22.242388 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 623/1266] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:51:22.248773 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3bdb54-4179-4172-9284-f7ddcd35c6b2 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:22.348842 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3bdb54-4179-4172-9284-f7ddcd35c6b2 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:22.370266 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:22.384052 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010cd95e-fc62-437c-83d2-0d6fc26544c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:22.385504 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010cd95e-fc62-437c-83d2-0d6fc26544c9 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:22.385793 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010cd95e-fc62-437c-83d2-0d6fc26544c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:22.386072 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010cd95e-fc62-437c-83d2-0d6fc26544c9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:22.393497 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010cd95e-fc62-437c-83d2-0d6fc26544c9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:22.394930 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010cd95e-fc62-437c-83d2-0d6fc26544c9 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:22.408875 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-010cd95e-fc62-437c-83d2-0d6fc26544c9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 20:51:22.408875 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:51:22.408875 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:51:22.408875 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:51:22.408875 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:51:22.408875 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:51:22.408875 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:51:22.408875 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:51:22.408875 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:51:22.408875 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:51:22.408875 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:51:22.408875 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:51:22.408875 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:51:22.408875 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:51:22.408875 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:51:22.408875 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:51:22.410017 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:51:22.410017 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:51:22.410017 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:51:22.410017 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:51:22.410017 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:51:22.410017 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:51:22.410017 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:51:22.410017 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:51:22.410017 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:51:22.410017 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:51:22.410017 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:51:22.410017 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:51:22.410017 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:51:22.410017 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:51:22.410017 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:51:22.410017 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:51:22.410017 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:51:22.410017 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:51:22.411280 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:51:22.411280 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:51:22.411280 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:51:22.411280 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:51:22.411280 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:51:22.411280 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:51:22.411280 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:51:22.411280 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:51:22.411280 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 20:51:22.411280 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:51:22.411280 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 644/1267] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:51:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:51:22.416601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf40cf15-9726-4e3d-9861-7c849a5a8027 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:22.518287 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf40cf15-9726-4e3d-9861-7c849a5a8027 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:22.551688 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96268d05-efe4-4203-931a-33da191b39eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:22.552381 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96268d05-efe4-4203-931a-33da191b39eb None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:22.552675 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96268d05-efe4-4203-931a-33da191b39eb None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:22.552957 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96268d05-efe4-4203-931a-33da191b39eb None admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:22.553783 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96268d05-efe4-4203-931a-33da191b39eb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:51:22.554125 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96268d05-efe4-4203-931a-33da191b39eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:22.555526 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96268d05-efe4-4203-931a-33da191b39eb None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:22.564490 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:22.573051 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 624/1268] 10.222.0.40 () {56 vars in 1143 bytes} [Mon Jul 11 20:51:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:51:22.578734 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010cd95e-fc62-437c-83d2-0d6fc26544c9 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:22.679104 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010cd95e-fc62-437c-83d2-0d6fc26544c9 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:22.713407 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37612036-ba45-4862-bcb7-6921d205d7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:22.714195 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37612036-ba45-4862-bcb7-6921d205d7ab None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:22.714480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37612036-ba45-4862-bcb7-6921d205d7ab None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:22.714775 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37612036-ba45-4862-bcb7-6921d205d7ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:22.725245 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37612036-ba45-4862-bcb7-6921d205d7ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:22.727065 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37612036-ba45-4862-bcb7-6921d205d7ab None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:22.744678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-37612036-ba45-4862-bcb7-6921d205d7ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:51:22.744678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:51:22.744678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:51:22.744678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:51:22.744678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:51:22.744678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:51:22.744678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:51:22.744678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:51:22.744678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:51:22.744678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:51:22.744678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:51:22.744678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:51:22.744678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:51:22.744678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:51:22.744678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:51:22.745612 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:51:22.745612 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:51:22.745612 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:51:22.745612 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:51:22.745612 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:51:22.745612 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:51:22.745612 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:51:22.745612 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:51:22.745612 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:51:22.745612 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:51:22.745612 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:51:22.745612 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:51:22.745612 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:51:22.745612 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:51:22.745612 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:51:22.745612 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:51:22.745612 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:51:22.746622 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:51:22.746622 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:51:22.746622 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:51:22.746622 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:51:22.746622 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 645/1269] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:51:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:51:22.751585 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96268d05-efe4-4203-931a-33da191b39eb None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:22.850840 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96268d05-efe4-4203-931a-33da191b39eb None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:22.884306 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945459f-b202-4820-bd12-8512d3d0586f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:22.885064 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945459f-b202-4820-bd12-8512d3d0586f None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:22.885368 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945459f-b202-4820-bd12-8512d3d0586f None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:22.885649 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945459f-b202-4820-bd12-8512d3d0586f None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:22.886367 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945459f-b202-4820-bd12-8512d3d0586f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:51:22.886720 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945459f-b202-4820-bd12-8512d3d0586f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:22.888104 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945459f-b202-4820-bd12-8512d3d0586f None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:22.899012 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 625/1270] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:51:22.905429 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37612036-ba45-4862-bcb7-6921d205d7ab None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:22.938477 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:23.006468 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37612036-ba45-4862-bcb7-6921d205d7ab None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:23.039338 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5f399-8cf5-4ead-9a51-8f4881663dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:23.040159 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5f399-8cf5-4ead-9a51-8f4881663dac None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:23.040454 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5f399-8cf5-4ead-9a51-8f4881663dac None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:23.041401 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5f399-8cf5-4ead-9a51-8f4881663dac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:23.049117 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5f399-8cf5-4ead-9a51-8f4881663dac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:23.050557 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5f399-8cf5-4ead-9a51-8f4881663dac None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:23.064064 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-2de5f399-8cf5-4ead-9a51-8f4881663dac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:51:23.064064 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:51:23.064064 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:51:23.064064 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:51:23.064064 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:51:23.064064 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:51:23.064064 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:51:23.064064 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:51:23.064064 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:51:23.064064 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:51:23.064064 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:51:23.064064 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:51:23.064064 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:51:23.064064 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:51:23.064064 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:51:23.065160 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:51:23.065160 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:51:23.065160 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:51:23.065160 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:51:23.065160 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:51:23.065160 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:51:23.065160 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:51:23.065160 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:51:23.065160 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:51:23.065160 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:51:23.065160 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:51:23.065160 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:51:23.065160 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:51:23.065160 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:51:23.065160 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:51:23.065160 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:51:23.065160 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:51:23.066261 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:51:23.066261 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:51:23.066261 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:51:23.066261 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:51:23.066261 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:51:23.066261 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:51:23.066261 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:51:23.066261 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:51:23.066261 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 646/1271] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:51:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:51:23.071128 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945459f-b202-4820-bd12-8512d3d0586f None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:23.129593 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:23.170074 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945459f-b202-4820-bd12-8512d3d0586f None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:23.202495 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048d6f6-cd37-4e0f-8618-f5416f9d204c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:23.203155 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048d6f6-cd37-4e0f-8618-f5416f9d204c None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:23.203439 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048d6f6-cd37-4e0f-8618-f5416f9d204c None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:23.203714 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048d6f6-cd37-4e0f-8618-f5416f9d204c None admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:23.204526 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8048d6f6-cd37-4e0f-8618-f5416f9d204c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:51:23.204875 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8048d6f6-cd37-4e0f-8618-f5416f9d204c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:23.206286 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8048d6f6-cd37-4e0f-8618-f5416f9d204c None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:23.218777 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 626/1272] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 11 20:51:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:51:23.224849 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5f399-8cf5-4ead-9a51-8f4881663dac None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:23.315588 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:23.324827 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5f399-8cf5-4ead-9a51-8f4881663dac None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:23.357904 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4cf9e1-839b-41a0-84f6-86c95546bdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:23.358800 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cf9e1-839b-41a0-84f6-86c95546bdd2 None admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:23.359086 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cf9e1-839b-41a0-84f6-86c95546bdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:23.359364 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cf9e1-839b-41a0-84f6-86c95546bdd2 None admin] PATH_INFO: `/v3/projects/eca3ef2561fa435e80ff451aeab14f3b/users/177a912380ad43b6a5e31b787a07ce7d/roles/86273ff072f3438d822e870272491768` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:23.361353 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4cf9e1-839b-41a0-84f6-86c95546bdd2 None admin] RBAC: Authorizing `identity:create_grant(project_id=eca3ef2561fa435e80ff451aeab14f3b, user_id=177a912380ad43b6a5e31b787a07ce7d, role_id=86273ff072f3438d822e870272491768)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:23.362797 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4cf9e1-839b-41a0-84f6-86c95546bdd2 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:23.477496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 647/1273] 10.222.0.40 () {58 vars in 1439 bytes} [Mon Jul 11 20:51:23 2022] PUT /identity/v3/projects/eca3ef2561fa435e80ff451aeab14f3b/users/177a912380ad43b6a5e31b787a07ce7d/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 20:51:25.464383 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de6284-0aea-45f6-8812-7008595cb5a9 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:25.464940 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de6284-0aea-45f6-8812-7008595cb5a9 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:25.464940 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de6284-0aea-45f6-8812-7008595cb5a9 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:25.466304 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 627/1274] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:51:25.471573 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1359a3-9feb-4881-b11b-640dbd082301 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:25.472006 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1359a3-9feb-4881-b11b-640dbd082301 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:25.472176 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1359a3-9feb-4881-b11b-640dbd082301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:25.489525 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-0b1359a3-9feb-4881-b11b-640dbd082301 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:51:25.490720 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-0b1359a3-9feb-4881-b11b-640dbd082301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:51:25.557822 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 648/1275] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:51:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:51:25.581509 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de6284-0aea-45f6-8812-7008595cb5a9 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:25.684297 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de6284-0aea-45f6-8812-7008595cb5a9 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:25.701779 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:25.718709 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc423da-55e9-41af-8df4-dc0e6ef7d5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:25.719460 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc423da-55e9-41af-8df4-dc0e6ef7d5f4 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:25.719765 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc423da-55e9-41af-8df4-dc0e6ef7d5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:25.720080 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc423da-55e9-41af-8df4-dc0e6ef7d5f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:25.730435 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc423da-55e9-41af-8df4-dc0e6ef7d5f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 20:51:25.747787 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-bcc423da-55e9-41af-8df4-dc0e6ef7d5f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:51:25.747787 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:51:25.747787 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:51:25.747787 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:51:25.747787 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:51:25.747787 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:51:25.747787 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:51:25.747787 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:51:25.747787 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:51:25.747787 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:51:25.747787 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:51:25.747787 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:51:25.747787 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 20:51:25.747787 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 20:51:25.747787 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 20:51:25.747787 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 20:51:25.749065 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 20:51:25.749065 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 20:51:25.749065 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 20:51:25.749065 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 20:51:25.749065 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:51:25.749065 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:51:25.749065 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:51:25.749065 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:51:25.749065 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:51:25.749065 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:51:25.749065 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:51:25.749065 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:51:25.749065 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:51:25.749065 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:51:25.749065 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:51:25.749065 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:51:25.750153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:51:25.750153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:51:25.750153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:51:25.750153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:51:25.750153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 20:51:25.750153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 20:51:25.750153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 20:51:25.750153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 20:51:25.750153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 20:51:25.750153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 20:51:25.750153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 20:51:25.750153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:51:25.750153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 628/1276] 10.222.0.40 () {56 vars in 1096 bytes} [Mon Jul 11 20:51:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:51:25.751031 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1359a3-9feb-4881-b11b-640dbd082301 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:25.823948 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:25.840765 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1359a3-9feb-4881-b11b-640dbd082301 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:25.872767 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf334b74-2920-4132-b4e2-90cd791b8bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:25.873430 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf334b74-2920-4132-b4e2-90cd791b8bbb None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:25.873716 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf334b74-2920-4132-b4e2-90cd791b8bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:25.873993 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf334b74-2920-4132-b4e2-90cd791b8bbb None admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:25.874728 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf334b74-2920-4132-b4e2-90cd791b8bbb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:51:25.875035 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf334b74-2920-4132-b4e2-90cd791b8bbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:25.876434 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf334b74-2920-4132-b4e2-90cd791b8bbb None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:25.884513 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 649/1277] 10.222.0.40 () {56 vars in 1099 bytes} [Mon Jul 11 20:51:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:51:25.890857 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc423da-55e9-41af-8df4-dc0e6ef7d5f4 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:25.988698 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc423da-55e9-41af-8df4-dc0e6ef7d5f4 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:26.022797 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c2ada-fe4f-41f4-9a4c-ce84c526cf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:26.023584 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c2ada-fe4f-41f4-9a4c-ce84c526cf1f None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:26.024047 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c2ada-fe4f-41f4-9a4c-ce84c526cf1f None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:26.024328 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c2ada-fe4f-41f4-9a4c-ce84c526cf1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:26.035211 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c2ada-fe4f-41f4-9a4c-ce84c526cf1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:26.036833 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c2ada-fe4f-41f4-9a4c-ce84c526cf1f None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:26.053617 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-cd7c2ada-fe4f-41f4-9a4c-ce84c526cf1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:51:26.053617 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:51:26.053617 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:51:26.053617 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:51:26.053617 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:51:26.053617 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:51:26.053617 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:51:26.053617 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:51:26.053617 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:51:26.053617 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:51:26.053617 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:51:26.053617 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:51:26.053617 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:51:26.053617 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:51:26.053617 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:51:26.054681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:51:26.054681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:51:26.054681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:51:26.054681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:51:26.054681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:51:26.054681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:51:26.054681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:51:26.054681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:51:26.054681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:51:26.054681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:51:26.054681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:51:26.054681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:51:26.054681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:51:26.054681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:51:26.054681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:51:26.054681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:51:26.054681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:51:26.055824 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:51:26.055824 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:51:26.055824 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:51:26.055824 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:51:26.055824 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 629/1278] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:51:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:51:26.061011 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf334b74-2920-4132-b4e2-90cd791b8bbb None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:26.159033 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf334b74-2920-4132-b4e2-90cd791b8bbb None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:26.193098 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f04df-8970-48bb-b185-4a0e48a42e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:26.193763 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f04df-8970-48bb-b185-4a0e48a42e9b None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:26.194051 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f04df-8970-48bb-b185-4a0e48a42e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:26.194328 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f04df-8970-48bb-b185-4a0e48a42e9b None admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:26.195047 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f04df-8970-48bb-b185-4a0e48a42e9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:51:26.195355 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f04df-8970-48bb-b185-4a0e48a42e9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:26.196831 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f04df-8970-48bb-b185-4a0e48a42e9b None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:26.209252 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 650/1279] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:51:26.215359 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c2ada-fe4f-41f4-9a4c-ce84c526cf1f None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:26.247367 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:26.316319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c2ada-fe4f-41f4-9a4c-ce84c526cf1f None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:26.347953 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51104236-24c0-4f80-949f-040a8f43c1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:26.348772 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51104236-24c0-4f80-949f-040a8f43c1f3 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:26.349060 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51104236-24c0-4f80-949f-040a8f43c1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:26.349338 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51104236-24c0-4f80-949f-040a8f43c1f3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:26.357849 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51104236-24c0-4f80-949f-040a8f43c1f3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:26.359291 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51104236-24c0-4f80-949f-040a8f43c1f3 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:26.374824 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-51104236-24c0-4f80-949f-040a8f43c1f3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 20:51:26.374824 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:51:26.374824 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:51:26.374824 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:51:26.374824 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:51:26.374824 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:51:26.374824 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:51:26.374824 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:51:26.374824 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:51:26.374824 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:51:26.374824 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:51:26.374824 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:51:26.374824 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 20:51:26.374824 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 20:51:26.374824 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 20:51:26.374824 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 20:51:26.375947 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:51:26.375947 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:51:26.375947 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 20:51:26.375947 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:51:26.375947 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 20:51:26.375947 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 20:51:26.375947 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:51:26.375947 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:51:26.375947 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:51:26.375947 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:51:26.375947 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:51:26.375947 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:51:26.375947 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:51:26.375947 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:51:26.375947 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:51:26.375947 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:51:26.375947 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:51:26.375947 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:51:26.377403 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:51:26.377403 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:51:26.377403 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 20:51:26.377403 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 20:51:26.377403 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 20:51:26.377403 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 20:51:26.377403 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 20:51:26.377403 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 20:51:26.377403 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 20:51:26.377403 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:51:26.377403 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 630/1280] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:51:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:51:26.382142 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f04df-8970-48bb-b185-4a0e48a42e9b None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:26.386353 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:26.481849 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f04df-8970-48bb-b185-4a0e48a42e9b None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:26.516453 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b80fb0-69b3-449c-ae1a-52496a40aadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:26.517060 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b80fb0-69b3-449c-ae1a-52496a40aadf None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:26.517346 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b80fb0-69b3-449c-ae1a-52496a40aadf None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:26.517620 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b80fb0-69b3-449c-ae1a-52496a40aadf None admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:26.518437 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b80fb0-69b3-449c-ae1a-52496a40aadf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:51:26.518746 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b80fb0-69b3-449c-ae1a-52496a40aadf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:26.520221 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b80fb0-69b3-449c-ae1a-52496a40aadf None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:26.537353 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 651/1281] 10.222.0.40 () {56 vars in 1143 bytes} [Mon Jul 11 20:51:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:51:26.543954 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51104236-24c0-4f80-949f-040a8f43c1f3 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:26.634066 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:26.643538 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51104236-24c0-4f80-949f-040a8f43c1f3 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:26.677539 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bca5cd-4f9e-4bd9-8484-9d3c192ff469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:26.678199 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bca5cd-4f9e-4bd9-8484-9d3c192ff469 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:26.678486 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bca5cd-4f9e-4bd9-8484-9d3c192ff469 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:26.678767 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bca5cd-4f9e-4bd9-8484-9d3c192ff469 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:26.744456 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bca5cd-4f9e-4bd9-8484-9d3c192ff469 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:26.745958 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bca5cd-4f9e-4bd9-8484-9d3c192ff469 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:26.831460 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:26.842123 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 631/1282] 10.222.0.40 () {58 vars in 1282 bytes} [Mon Jul 11 20:51:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 20:51:26.847941 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b80fb0-69b3-449c-ae1a-52496a40aadf None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:26.909706 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:26.948177 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b80fb0-69b3-449c-ae1a-52496a40aadf None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:26.981375 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779e02e-148e-4965-a1d9-8473dec47217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:26.982174 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779e02e-148e-4965-a1d9-8473dec47217 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:26.982461 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779e02e-148e-4965-a1d9-8473dec47217 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:26.982739 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779e02e-148e-4965-a1d9-8473dec47217 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:26.993239 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7779e02e-148e-4965-a1d9-8473dec47217 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:26.994789 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7779e02e-148e-4965-a1d9-8473dec47217 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:27.012653 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-7779e02e-148e-4965-a1d9-8473dec47217 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:51:27.012653 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:51:27.012653 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:51:27.012653 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:51:27.012653 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:51:27.012653 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:51:27.012653 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:51:27.012653 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:51:27.012653 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:51:27.012653 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:51:27.012653 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:51:27.012653 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:51:27.012653 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 20:51:27.012653 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 20:51:27.012653 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 20:51:27.013559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 20:51:27.013559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:51:27.013559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:51:27.013559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:51:27.013559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:51:27.013559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:51:27.013559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:51:27.013559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:51:27.013559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:51:27.013559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:51:27.013559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:51:27.013559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:51:27.013559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:51:27.013559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:51:27.013559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:51:27.013559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:51:27.013559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:51:27.014939 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 20:51:27.014939 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 20:51:27.014939 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 20:51:27.014939 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:51:27.014939 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 652/1283] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 20:51:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:51:27.019512 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bca5cd-4f9e-4bd9-8484-9d3c192ff469 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:27.117216 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bca5cd-4f9e-4bd9-8484-9d3c192ff469 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:27.151703 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94015401-53ca-40e9-b897-83a0d90fa3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:27.152393 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94015401-53ca-40e9-b897-83a0d90fa3da None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:27.152678 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94015401-53ca-40e9-b897-83a0d90fa3da None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:27.152953 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94015401-53ca-40e9-b897-83a0d90fa3da None admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:27.153671 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94015401-53ca-40e9-b897-83a0d90fa3da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:51:27.153978 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94015401-53ca-40e9-b897-83a0d90fa3da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:27.155333 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94015401-53ca-40e9-b897-83a0d90fa3da None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:27.166163 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 632/1284] 10.222.0.40 () {56 vars in 1109 bytes} [Mon Jul 11 20:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:51:27.171821 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779e02e-148e-4965-a1d9-8473dec47217 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:27.270938 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779e02e-148e-4965-a1d9-8473dec47217 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:27.284919 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:27.303950 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0321022b-1926-4de3-b716-36ebe9d66c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:27.304815 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321022b-1926-4de3-b716-36ebe9d66c17 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:27.305102 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321022b-1926-4de3-b716-36ebe9d66c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:27.305382 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321022b-1926-4de3-b716-36ebe9d66c17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:27.312439 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0321022b-1926-4de3-b716-36ebe9d66c17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:27.313880 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0321022b-1926-4de3-b716-36ebe9d66c17 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:27.328576 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application [None req-0321022b-1926-4de3-b716-36ebe9d66c17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:51:27.328576 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:51:27.328576 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:51:27.328576 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:51:27.328576 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:51:27.328576 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:51:27.328576 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:51:27.328576 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:51:27.328576 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:51:27.328576 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:51:27.328576 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:51:27.328576 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:51:27.328576 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 20:51:27.328576 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 20:51:27.328576 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 20:51:27.329695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 20:51:27.329695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:51:27.329695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:51:27.329695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:51:27.329695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:51:27.329695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:51:27.329695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:51:27.329695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:51:27.329695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application with Lock( Jul 11 20:51:27.329695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:51:27.329695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:51:27.329695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:51:27.329695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:51:27.329695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:51:27.329695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:51:27.329695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:51:27.329695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:51:27.330882 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 20:51:27.330882 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 20:51:27.330882 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 20:51:27.330882 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 20:51:27.330882 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 20:51:27.330882 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 20:51:27.330882 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 20:51:27.330882 dv-cinder-849022-2-smb devstack@keystone.service[80375]: ERROR keystone.server.flask.application Jul 11 20:51:27.330882 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 653/1285] 10.222.0.40 () {56 vars in 1111 bytes} [Mon Jul 11 20:51:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:51:27.335646 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94015401-53ca-40e9-b897-83a0d90fa3da None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:27.385117 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:27.434551 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94015401-53ca-40e9-b897-83a0d90fa3da None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:27.469300 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75007cca-ec0e-477a-935f-ce1aa4185d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:27.469963 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75007cca-ec0e-477a-935f-ce1aa4185d57 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:27.470253 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75007cca-ec0e-477a-935f-ce1aa4185d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:27.470532 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75007cca-ec0e-477a-935f-ce1aa4185d57 None admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:27.471331 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75007cca-ec0e-477a-935f-ce1aa4185d57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:51:27.471628 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75007cca-ec0e-477a-935f-ce1aa4185d57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:27.473081 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75007cca-ec0e-477a-935f-ce1aa4185d57 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:27.485499 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 633/1286] 10.222.0.40 () {56 vars in 1148 bytes} [Mon Jul 11 20:51:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:51:27.491464 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0321022b-1926-4de3-b716-36ebe9d66c17 None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:27.588327 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0321022b-1926-4de3-b716-36ebe9d66c17 None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:27.621209 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d0819-c4ba-4231-aaa0-3bbbe3922dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:27.621866 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d0819-c4ba-4231-aaa0-3bbbe3922dcc None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:27.622144 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d0819-c4ba-4231-aaa0-3bbbe3922dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:27.622420 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d0819-c4ba-4231-aaa0-3bbbe3922dcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:27.623229 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d0819-c4ba-4231-aaa0-3bbbe3922dcc None admin] RBAC: Adding query filter params (role.id=86273ff072f3438d822e870272491768, scope.project.id=eca3ef2561fa435e80ff451aeab14f3b, user.id=177a912380ad43b6a5e31b787a07ce7d) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:51:27.623543 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d0819-c4ba-4231-aaa0-3bbbe3922dcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:27.625002 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d0819-c4ba-4231-aaa0-3bbbe3922dcc None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:27.630877 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 654/1287] 10.222.0.40 () {56 vars in 1374 bytes} [Mon Jul 11 20:51:27 2022] GET /identity/v3/role_assignments?user.id=177a912380ad43b6a5e31b787a07ce7d&scope.project.id=eca3ef2561fa435e80ff451aeab14f3b&role.id=86273ff072f3438d822e870272491768 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:51:29.666319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff4591-274e-4b32-ba3e-ad8704b9a90b None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:29.666712 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff4591-274e-4b32-ba3e-ad8704b9a90b None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:29.666872 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff4591-274e-4b32-ba3e-ad8704b9a90b None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:29.668305 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 634/1288] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:51:29.673428 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569efe4d-7858-45c6-b472-591ba4b3802c None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:29.673846 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569efe4d-7858-45c6-b472-591ba4b3802c None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:29.673999 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569efe4d-7858-45c6-b472-591ba4b3802c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:29.692081 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-569efe4d-7858-45c6-b472-591ba4b3802c None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:51:29.693262 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-569efe4d-7858-45c6-b472-591ba4b3802c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:51:29.722889 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:29.759130 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 655/1289] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:51:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:51:29.781598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff4591-274e-4b32-ba3e-ad8704b9a90b None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:29.881440 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff4591-274e-4b32-ba3e-ad8704b9a90b None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:29.893400 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:29.916396 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f363ec-c4e9-41b2-a1e0-dec10a8d8c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:29.917128 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f363ec-c4e9-41b2-a1e0-dec10a8d8c5f None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:29.917409 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f363ec-c4e9-41b2-a1e0-dec10a8d8c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:29.917682 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f363ec-c4e9-41b2-a1e0-dec10a8d8c5f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:29.918323 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f363ec-c4e9-41b2-a1e0-dec10a8d8c5f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:29.919671 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f363ec-c4e9-41b2-a1e0-dec10a8d8c5f None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:29.932432 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-53f363ec-c4e9-41b2-a1e0-dec10a8d8c5f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 20:51:29.932432 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:51:29.932432 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:51:29.932432 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:51:29.932432 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:51:29.932432 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:51:29.932432 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:51:29.932432 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:51:29.932432 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 20:51:29.932432 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:51:29.932432 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:51:29.932432 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:51:29.932432 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:51:29.932432 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:51:29.932432 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:51:29.932432 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:51:29.932432 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:51:29.933545 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:51:29.933545 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:51:29.933545 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:51:29.933545 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:51:29.933545 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:51:29.933545 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:51:29.933545 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:51:29.933545 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:51:29.933545 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:51:29.933545 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:51:29.933545 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:51:29.933545 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:51:29.933545 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:51:29.933545 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:51:29.933545 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:51:29.933545 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:51:29.935013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:51:29.935013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:51:29.935013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:51:29.935013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:51:29.935013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:51:29.935013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:51:29.935013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:51:29.935013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:51:29.935013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:51:29.935013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:51:29.935013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:51:29.935013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:51:29.935013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 20:51:29.935013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:51:29.935013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 635/1290] 10.222.0.40 () {56 vars in 1117 bytes} [Mon Jul 11 20:51:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:51:29.939711 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569efe4d-7858-45c6-b472-591ba4b3802c None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:30.036260 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569efe4d-7858-45c6-b472-591ba4b3802c None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:30.069786 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de2d86-eaeb-4b00-a94d-6cb1c8cbdb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:30.070452 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de2d86-eaeb-4b00-a94d-6cb1c8cbdb2c None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:30.070735 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de2d86-eaeb-4b00-a94d-6cb1c8cbdb2c None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:30.071006 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de2d86-eaeb-4b00-a94d-6cb1c8cbdb2c None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:30.072087 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de2d86-eaeb-4b00-a94d-6cb1c8cbdb2c None admin] RBAC: Adding query filter params (name=placement) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:51:30.072403 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de2d86-eaeb-4b00-a94d-6cb1c8cbdb2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:30.073766 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de2d86-eaeb-4b00-a94d-6cb1c8cbdb2c None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:30.078794 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 656/1291] 10.222.0.40 () {56 vars in 1116 bytes} [Mon Jul 11 20:51:29 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:51:30.084735 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f363ec-c4e9-41b2-a1e0-dec10a8d8c5f None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:30.184982 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f363ec-c4e9-41b2-a1e0-dec10a8d8c5f None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:30.217855 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb1921-9075-432f-beba-d757be636169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:30.218521 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb1921-9075-432f-beba-d757be636169 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:30.218811 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb1921-9075-432f-beba-d757be636169 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:30.219093 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb1921-9075-432f-beba-d757be636169 None admin] PATH_INFO: `/v3/services` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:30.219805 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb1921-9075-432f-beba-d757be636169 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:51:30.220144 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb1921-9075-432f-beba-d757be636169 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:30.221504 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb1921-9075-432f-beba-d757be636169 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:30.226125 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 636/1292] 10.222.0.40 () {56 vars in 1116 bytes} [Mon Jul 11 20:51:30 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:51:32.237093 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64eb229-06e6-4d13-b577-f7e3d86766c3 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:32.237643 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64eb229-06e6-4d13-b577-f7e3d86766c3 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:32.237643 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64eb229-06e6-4d13-b577-f7e3d86766c3 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:32.239039 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 657/1293] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:51:32.244651 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c1916-314e-4d63-9600-fde2fce9d941 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:32.245052 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c1916-314e-4d63-9600-fde2fce9d941 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:32.245222 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c1916-314e-4d63-9600-fde2fce9d941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:32.261927 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-b39c1916-314e-4d63-9600-fde2fce9d941 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:51:32.263098 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b39c1916-314e-4d63-9600-fde2fce9d941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:51:32.292136 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:32.328626 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 637/1294] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:51:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:51:32.351201 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64eb229-06e6-4d13-b577-f7e3d86766c3 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:32.382717 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:32.451487 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64eb229-06e6-4d13-b577-f7e3d86766c3 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:32.485113 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196dae8d-973e-4266-b86a-4b753a2dc06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:32.485771 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196dae8d-973e-4266-b86a-4b753a2dc06c None admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:32.486058 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196dae8d-973e-4266-b86a-4b753a2dc06c None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:32.486337 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196dae8d-973e-4266-b86a-4b753a2dc06c None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:32.487175 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196dae8d-973e-4266-b86a-4b753a2dc06c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:32.488511 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196dae8d-973e-4266-b86a-4b753a2dc06c None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:32.577897 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 658/1295] 10.222.0.40 () {60 vars in 1141 bytes} [Mon Jul 11 20:51:32 2022] POST /identity/v3/services => generated 246 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:51:34.628665 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5bfa3-2347-4e23-874b-41a1534e0d67 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:34.629221 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5bfa3-2347-4e23-874b-41a1534e0d67 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:34.629221 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5bfa3-2347-4e23-874b-41a1534e0d67 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:34.630581 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 638/1296] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:51:34.636280 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241fdc1-d89e-460c-8769-e096e3556ee6 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:34.636718 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241fdc1-d89e-460c-8769-e096e3556ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:34.636853 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241fdc1-d89e-460c-8769-e096e3556ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:34.653802 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-6241fdc1-d89e-460c-8769-e096e3556ee6 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:51:34.654992 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-6241fdc1-d89e-460c-8769-e096e3556ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:51:34.726795 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 659/1297] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:51:34 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:51:34.750798 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5bfa3-2347-4e23-874b-41a1534e0d67 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:34.853647 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5bfa3-2347-4e23-874b-41a1534e0d67 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:34.886398 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b09df4-97c9-43f8-9716-6a6d98d64558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:34.887138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b09df4-97c9-43f8-9716-6a6d98d64558 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:34.887419 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b09df4-97c9-43f8-9716-6a6d98d64558 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:34.887689 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b09df4-97c9-43f8-9716-6a6d98d64558 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:34.888398 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b09df4-97c9-43f8-9716-6a6d98d64558 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:34.889746 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b09df4-97c9-43f8-9716-6a6d98d64558 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:34.902161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-08b09df4-97c9-43f8-9716-6a6d98d64558 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 20:51:34.902161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:51:34.902161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:51:34.902161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:51:34.902161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:51:34.902161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:51:34.902161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:51:34.902161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:51:34.902161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 20:51:34.902161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:51:34.902161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:51:34.902161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:51:34.902161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:51:34.902161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:51:34.902161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:51:34.902161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:51:34.902161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:51:34.905489 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:51:34.905489 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:51:34.905489 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:51:34.905489 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:51:34.905489 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:51:34.905489 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:51:34.905489 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:51:34.905489 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:51:34.905489 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:51:34.905489 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:51:34.905489 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:51:34.905489 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:51:34.905489 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:51:34.905489 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:51:34.905489 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:51:34.905489 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:51:34.906563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:51:34.906563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:51:34.906563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:51:34.906563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:51:34.906563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:51:34.906563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:51:34.906563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:51:34.906563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:51:34.906563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:51:34.906563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:51:34.906563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:51:34.906563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:51:34.906563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 20:51:34.906563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:51:34.906563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 639/1298] 10.222.0.40 () {56 vars in 1117 bytes} [Mon Jul 11 20:51:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:51:34.909510 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241fdc1-d89e-460c-8769-e096e3556ee6 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:34.928500 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:35.008194 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241fdc1-d89e-460c-8769-e096e3556ee6 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:35.043972 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7dde16-a93a-473f-b048-fc3a7112d0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:35.044738 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7dde16-a93a-473f-b048-fc3a7112d0bb None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:35.045029 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7dde16-a93a-473f-b048-fc3a7112d0bb None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:35.045314 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7dde16-a93a-473f-b048-fc3a7112d0bb None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:35.046028 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7dde16-a93a-473f-b048-fc3a7112d0bb None admin] RBAC: Adding query filter params (name=placement) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:51:35.046344 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7dde16-a93a-473f-b048-fc3a7112d0bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:35.047721 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7dde16-a93a-473f-b048-fc3a7112d0bb None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:35.052868 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 660/1299] 10.222.0.40 () {56 vars in 1116 bytes} [Mon Jul 11 20:51:34 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:51:35.059116 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b09df4-97c9-43f8-9716-6a6d98d64558 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:35.091338 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:35.161860 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b09df4-97c9-43f8-9716-6a6d98d64558 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:35.195239 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537755a-4c60-439e-82e2-2c49dfb91ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:35.195901 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537755a-4c60-439e-82e2-2c49dfb91ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:35.196213 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537755a-4c60-439e-82e2-2c49dfb91ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:35.196496 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537755a-4c60-439e-82e2-2c49dfb91ed2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:35.197886 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537755a-4c60-439e-82e2-2c49dfb91ed2 None admin] RBAC: Adding query filter params (interface=public, service_id=78caad85f1064d6b937216f16443ccf7, region_id=RegionOne) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:51:35.198203 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537755a-4c60-439e-82e2-2c49dfb91ed2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:35.199612 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537755a-4c60-439e-82e2-2c49dfb91ed2 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:35.204579 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 640/1300] 10.222.0.40 () {56 vars in 1251 bytes} [Mon Jul 11 20:51:35 2022] GET /identity/v3/endpoints?service_id=78caad85f1064d6b937216f16443ccf7&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:51:35.210162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7dde16-a93a-473f-b048-fc3a7112d0bb None admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:35.293068 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:35.310751 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7dde16-a93a-473f-b048-fc3a7112d0bb None admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:35.345038 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96857a77-9900-4aa9-aac4-1a4db93a9168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:35.345704 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96857a77-9900-4aa9-aac4-1a4db93a9168 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:35.345994 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96857a77-9900-4aa9-aac4-1a4db93a9168 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:35.346275 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96857a77-9900-4aa9-aac4-1a4db93a9168 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:35.346950 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96857a77-9900-4aa9-aac4-1a4db93a9168 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:35.348352 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96857a77-9900-4aa9-aac4-1a4db93a9168 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:35.355750 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 661/1301] 10.222.0.40 () {56 vars in 1087 bytes} [Mon Jul 11 20:51:35 2022] GET /identity/v3/services => generated 2191 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 20:51:37.358067 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6a539-520f-4a5f-8a50-ab0a2574cc18 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:37.358599 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6a539-520f-4a5f-8a50-ab0a2574cc18 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:37.358693 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6a539-520f-4a5f-8a50-ab0a2574cc18 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:37.360024 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 641/1302] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:51:37.365065 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fc9ea-57d2-494d-9362-bca128acfbf8 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:37.365525 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fc9ea-57d2-494d-9362-bca128acfbf8 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:37.365683 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fc9ea-57d2-494d-9362-bca128acfbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:37.382917 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-8c2fc9ea-57d2-494d-9362-bca128acfbf8 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:51:37.384253 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-8c2fc9ea-57d2-494d-9362-bca128acfbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:51:37.450042 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 662/1303] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:51:37 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 20:51:37.472665 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6a539-520f-4a5f-8a50-ab0a2574cc18 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:37.568948 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:37.575599 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6a539-520f-4a5f-8a50-ab0a2574cc18 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:37.607981 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f5fcb-5b0a-4d8d-a00a-43463b0cdfb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:37.608830 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f5fcb-5b0a-4d8d-a00a-43463b0cdfb3 None admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:37.609070 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f5fcb-5b0a-4d8d-a00a-43463b0cdfb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:37.609348 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f5fcb-5b0a-4d8d-a00a-43463b0cdfb3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:37.609998 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f5fcb-5b0a-4d8d-a00a-43463b0cdfb3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:37.611358 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f5fcb-5b0a-4d8d-a00a-43463b0cdfb3 None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:37.623681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application [None req-959f5fcb-5b0a-4d8d-a00a-43463b0cdfb3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 20:51:37.623681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:51:37.623681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 20:51:37.623681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 20:51:37.623681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 20:51:37.623681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 20:51:37.623681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 20:51:37.623681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:51:37.623681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 20:51:37.623681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:51:37.623681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 20:51:37.623681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:51:37.623681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 20:51:37.623681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 20:51:37.623681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 20:51:37.623681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 20:51:37.623681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 20:51:37.624964 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 20:51:37.624964 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 20:51:37.624964 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 20:51:37.624964 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 20:51:37.624964 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 20:51:37.624964 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 20:51:37.624964 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 20:51:37.624964 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 20:51:37.624964 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 20:51:37.624964 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 20:51:37.624964 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 20:51:37.624964 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 20:51:37.624964 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 20:51:37.624964 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 20:51:37.624964 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 20:51:37.624964 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 20:51:37.626152 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 20:51:37.626152 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application with Lock( Jul 11 20:51:37.626152 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 20:51:37.626152 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self._enter() Jul 11 20:51:37.626152 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 20:51:37.626152 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 20:51:37.626152 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 20:51:37.626152 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application return self.creator() Jul 11 20:51:37.626152 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 20:51:37.626152 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application created_value = creator( Jul 11 20:51:37.626152 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 20:51:37.626152 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 20:51:37.626152 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 20:51:37.626152 dv-cinder-849022-2-smb devstack@keystone.service[80374]: ERROR keystone.server.flask.application Jul 11 20:51:37.626152 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 642/1304] 10.222.0.40 () {56 vars in 1117 bytes} [Mon Jul 11 20:51:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 20:51:37.631066 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2fc9ea-57d2-494d-9362-bca128acfbf8 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:37.706657 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:37.729344 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2fc9ea-57d2-494d-9362-bca128acfbf8 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:37.762673 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e6fb6-4976-4ddd-9e3e-215ce8d19838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:37.763326 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e6fb6-4976-4ddd-9e3e-215ce8d19838 None admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:37.763613 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e6fb6-4976-4ddd-9e3e-215ce8d19838 None admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:37.763890 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e6fb6-4976-4ddd-9e3e-215ce8d19838 None admin] PATH_INFO: `/v3/services` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:37.764622 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e6fb6-4976-4ddd-9e3e-215ce8d19838 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 20:51:37.764933 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e6fb6-4976-4ddd-9e3e-215ce8d19838 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:37.766289 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e6fb6-4976-4ddd-9e3e-215ce8d19838 None admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:37.771398 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 663/1305] 10.222.0.40 () {56 vars in 1116 bytes} [Mon Jul 11 20:51:37 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 20:51:37.777180 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f5fcb-5b0a-4d8d-a00a-43463b0cdfb3 None admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:51:37.877529 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f5fcb-5b0a-4d8d-a00a-43463b0cdfb3 None admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:51:37.910727 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a62d0-2ff5-4229-a3bf-168f6f516f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:51:37.911383 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a62d0-2ff5-4229-a3bf-168f6f516f1c None admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:51:37.911672 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a62d0-2ff5-4229-a3bf-168f6f516f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:51:37.911944 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a62d0-2ff5-4229-a3bf-168f6f516f1c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:51:37.912744 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30a62d0-2ff5-4229-a3bf-168f6f516f1c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:51:37.914394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30a62d0-2ff5-4229-a3bf-168f6f516f1c None admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:51:37.996479 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 643/1306] 10.222.0.40 () {60 vars in 1144 bytes} [Mon Jul 11 20:51:37 2022] POST /identity/v3/endpoints => generated 331 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 20:51:47.800458 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=30 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:51:47.992053 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:57:24.199878 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566102d-5399-4cc4-967b-6261107ddb1d None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:57:24.201001 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566102d-5399-4cc4-967b-6261107ddb1d None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:57:24.201571 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566102d-5399-4cc4-967b-6261107ddb1d None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:57:24.208906 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728cc3a8-ae2f-43e0-99f8-0e423e98dc68 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:57:24.217903 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728cc3a8-ae2f-43e0-99f8-0e423e98dc68 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:57:24.217903 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728cc3a8-ae2f-43e0-99f8-0e423e98dc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:57:24.218110 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 664/1307] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:57:24 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:57:24.396941 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-728cc3a8-ae2f-43e0-99f8-0e423e98dc68 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:57:24.396941 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-728cc3a8-ae2f-43e0-99f8-0e423e98dc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:57:24.448518 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 644/1308] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 20:57:24.486839 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1d33b-de6b-47b0-9d9c-ed9509a71c60 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:57:24.490504 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1d33b-de6b-47b0-9d9c-ed9509a71c60 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:57:24.490504 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1d33b-de6b-47b0-9d9c-ed9509a71c60 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:57:24.490504 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 665/1309] 10.222.0.40 () {54 vars in 964 bytes} [Mon Jul 11 20:57:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:57:24.497192 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c7757-8025-4f3c-aba9-02db3d0984a9 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:57:24.497553 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c7757-8025-4f3c-aba9-02db3d0984a9 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:57:24.497776 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c7757-8025-4f3c-aba9-02db3d0984a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:57:24.683142 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-da7c7757-8025-4f3c-aba9-02db3d0984a9 None None] MFA Rules not processed for user `29046b079f1a4f4ea2244e69cbbaa805`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:57:24.684310 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-da7c7757-8025-4f3c-aba9-02db3d0984a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:57:24.724343 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:57:24.829377 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 645/1310] 10.222.0.40 () {58 vars in 1061 bytes} [Mon Jul 11 20:57:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:57:24.839366 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1d33b-de6b-47b0-9d9c-ed9509a71c60 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:57:24.841330 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-36f1d33b-de6b-47b0-9d9c-ed9509a71c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:57:24.980715 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1d33b-de6b-47b0-9d9c-ed9509a71c60 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:57:25.071453 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ac23b-34d0-4578-aa59-aea3c63f3184 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:57:25.072276 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ac23b-34d0-4578-aa59-aea3c63f3184 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:57:25.072633 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ac23b-34d0-4578-aa59-aea3c63f3184 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:57:25.073090 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ac23b-34d0-4578-aa59-aea3c63f3184 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:57:25.074951 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-063ac23b-34d0-4578-aa59-aea3c63f3184 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:57:25.134195 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:57:25.195436 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ac23b-34d0-4578-aa59-aea3c63f3184 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:57:25.197135 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ac23b-34d0-4578-aa59-aea3c63f3184 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:57:25.232315 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 666/1311] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:57:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:57:27.680603 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bb5d4-fabf-4da2-b543-8da5074fbe12 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:57:27.681117 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bb5d4-fabf-4da2-b543-8da5074fbe12 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:57:27.681230 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bb5d4-fabf-4da2-b543-8da5074fbe12 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:57:27.682536 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 646/1312] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:57:27.687774 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ebc95-4e9f-4915-bc0e-1c3adb932085 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:57:27.688225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ebc95-4e9f-4915-bc0e-1c3adb932085 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:57:27.688374 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ebc95-4e9f-4915-bc0e-1c3adb932085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:57:27.760315 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-3e7ebc95-4e9f-4915-bc0e-1c3adb932085 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:57:27.761606 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-3e7ebc95-4e9f-4915-bc0e-1c3adb932085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:57:27.860559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 667/1313] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:57:27.899285 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bb5d4-fabf-4da2-b543-8da5074fbe12 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:57:27.900881 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b90bb5d4-fabf-4da2-b543-8da5074fbe12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:57:28.013722 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bb5d4-fabf-4da2-b543-8da5074fbe12 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:57:28.086769 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:57:28.089389 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc381d5-90e8-4a27-9190-654427a36404 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:57:28.090043 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc381d5-90e8-4a27-9190-654427a36404 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:57:28.090331 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc381d5-90e8-4a27-9190-654427a36404 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:57:28.090611 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc381d5-90e8-4a27-9190-654427a36404 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:57:28.092255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-fbc381d5-90e8-4a27-9190-654427a36404 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:57:28.201233 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc381d5-90e8-4a27-9190-654427a36404 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:57:28.202759 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc381d5-90e8-4a27-9190-654427a36404 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:57:28.223268 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 647/1314] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:57:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:57:30.726581 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3d05d-4c0e-4371-8053-003ca074a245 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:57:30.727597 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3d05d-4c0e-4371-8053-003ca074a245 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:57:30.727762 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3d05d-4c0e-4371-8053-003ca074a245 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:57:30.729343 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 668/1315] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:57:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:57:30.734485 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c27e3c-d5e8-405d-9ad3-d43906d6a5de None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:57:30.734908 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c27e3c-d5e8-405d-9ad3-d43906d6a5de None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:57:30.735051 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c27e3c-d5e8-405d-9ad3-d43906d6a5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:57:30.798861 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-c4c27e3c-d5e8-405d-9ad3-d43906d6a5de None None] MFA Rules not processed for user `20a887b4089a485d92fa68e64ce9538a`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:57:30.800095 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c4c27e3c-d5e8-405d-9ad3-d43906d6a5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:57:30.851726 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:57:30.896410 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 648/1316] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:57:30 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:57:30.935961 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3d05d-4c0e-4371-8053-003ca074a245 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:57:30.937554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-77b3d05d-4c0e-4371-8053-003ca074a245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:57:30.947910 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:57:31.040238 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3d05d-4c0e-4371-8053-003ca074a245 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:57:31.110524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750338e-9eda-4047-80b1-3309956875b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:57:31.111197 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750338e-9eda-4047-80b1-3309956875b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:57:31.111488 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750338e-9eda-4047-80b1-3309956875b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:57:31.111769 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750338e-9eda-4047-80b1-3309956875b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:57:31.113422 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-6750338e-9eda-4047-80b1-3309956875b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:57:31.174027 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:57:31.220171 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6750338e-9eda-4047-80b1-3309956875b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:57:31.221606 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6750338e-9eda-4047-80b1-3309956875b3 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:57:31.239118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 669/1317] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:57:30 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:57:34.081175 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a559f3-ea93-4f20-a44d-94479e011876 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:57:34.081753 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a559f3-ea93-4f20-a44d-94479e011876 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:57:34.081854 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a559f3-ea93-4f20-a44d-94479e011876 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:57:34.083148 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 649/1318] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:57:34.088923 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca340068-e806-48ac-bcce-055bc0727bc6 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:57:34.089313 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca340068-e806-48ac-bcce-055bc0727bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:57:34.089522 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca340068-e806-48ac-bcce-055bc0727bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:57:34.154151 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-ca340068-e806-48ac-bcce-055bc0727bc6 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:57:34.155356 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-ca340068-e806-48ac-bcce-055bc0727bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:57:34.249228 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 670/1319] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:57:34 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:57:34.287940 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a559f3-ea93-4f20-a44d-94479e011876 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:57:34.289555 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b0a559f3-ea93-4f20-a44d-94479e011876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:57:34.392285 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a559f3-ea93-4f20-a44d-94479e011876 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:57:34.462840 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77de06-9b35-4472-967c-dba0a1400ee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:57:34.463483 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77de06-9b35-4472-967c-dba0a1400ee7 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:57:34.463768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77de06-9b35-4472-967c-dba0a1400ee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:57:34.464073 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77de06-9b35-4472-967c-dba0a1400ee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:57:34.465697 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-2b77de06-9b35-4472-967c-dba0a1400ee7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:57:34.472904 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:57:34.571491 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77de06-9b35-4472-967c-dba0a1400ee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:57:34.572944 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77de06-9b35-4472-967c-dba0a1400ee7 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:57:34.590489 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 650/1320] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:57:34 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:57:37.633563 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8406e-a58e-41f7-af5e-7f439e32c77f None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:57:37.634129 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8406e-a58e-41f7-af5e-7f439e32c77f None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:57:37.634129 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8406e-a58e-41f7-af5e-7f439e32c77f None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:57:37.635503 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 671/1321] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:57:37.640740 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38c2bf-f848-4dfc-b1f7-63120b6e3dc4 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:57:37.641169 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38c2bf-f848-4dfc-b1f7-63120b6e3dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:57:37.641457 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38c2bf-f848-4dfc-b1f7-63120b6e3dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:57:37.706733 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-6b38c2bf-f848-4dfc-b1f7-63120b6e3dc4 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:57:37.707918 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-6b38c2bf-f848-4dfc-b1f7-63120b6e3dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:57:37.765572 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:57:37.804972 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 651/1322] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:57:37.840968 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8406e-a58e-41f7-af5e-7f439e32c77f None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:57:37.842480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-9aa8406e-a58e-41f7-af5e-7f439e32c77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:57:37.862694 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:57:37.956772 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8406e-a58e-41f7-af5e-7f439e32c77f None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:57:38.038290 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632426f-848a-49db-a5f9-d335d77302dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:57:38.038955 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632426f-848a-49db-a5f9-d335d77302dd service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:57:38.039247 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632426f-848a-49db-a5f9-d335d77302dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:57:38.039531 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632426f-848a-49db-a5f9-d335d77302dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:57:38.041352 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-9632426f-848a-49db-a5f9-d335d77302dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:57:38.114531 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:57:38.153546 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632426f-848a-49db-a5f9-d335d77302dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:57:38.154993 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632426f-848a-49db-a5f9-d335d77302dd service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:57:38.173332 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 672/1323] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:57:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:57:40.283150 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5dbaa-ee99-432b-9209-59d455bb638d None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:57:40.283677 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5dbaa-ee99-432b-9209-59d455bb638d None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:57:40.283769 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5dbaa-ee99-432b-9209-59d455bb638d None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:57:40.285116 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 652/1324] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:57:40.290651 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5369e-3073-4144-9023-672a601a948a None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:57:40.291050 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5369e-3073-4144-9023-672a601a948a None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:57:40.291211 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5369e-3073-4144-9023-672a601a948a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:57:40.356807 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-d1b5369e-3073-4144-9023-672a601a948a None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:57:40.357924 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-d1b5369e-3073-4144-9023-672a601a948a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:57:40.453172 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 673/1325] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:57:40.488772 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5dbaa-ee99-432b-9209-59d455bb638d None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:57:40.490359 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-82d5dbaa-ee99-432b-9209-59d455bb638d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:57:40.593191 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5dbaa-ee99-432b-9209-59d455bb638d None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:57:40.668066 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d21ba-529d-4d29-b4fb-4be13f5e054a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:57:40.668763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d21ba-529d-4d29-b4fb-4be13f5e054a service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:57:40.669050 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d21ba-529d-4d29-b4fb-4be13f5e054a service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:57:40.669330 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d21ba-529d-4d29-b4fb-4be13f5e054a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:57:40.670965 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-1d3d21ba-529d-4d29-b4fb-4be13f5e054a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:57:40.689400 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:57:40.786541 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3d21ba-529d-4d29-b4fb-4be13f5e054a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:57:40.788544 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3d21ba-529d-4d29-b4fb-4be13f5e054a service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:57:40.807790 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 653/1326] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:57:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:57:42.888825 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4637f-e851-497e-b5e1-552664c91de0 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:57:42.889372 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4637f-e851-497e-b5e1-552664c91de0 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:57:42.889372 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4637f-e851-497e-b5e1-552664c91de0 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:57:42.891016 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 674/1327] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:57:42.897685 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58603ea9-e6f0-4d82-958e-ac0ef48047fb None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:57:42.898280 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58603ea9-e6f0-4d82-958e-ac0ef48047fb None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:57:42.898280 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58603ea9-e6f0-4d82-958e-ac0ef48047fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:57:42.969718 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-58603ea9-e6f0-4d82-958e-ac0ef48047fb None None] MFA Rules not processed for user `20a887b4089a485d92fa68e64ce9538a`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:57:42.970944 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-58603ea9-e6f0-4d82-958e-ac0ef48047fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:57:43.035465 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:57:43.066997 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 654/1328] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:57:42 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:57:43.106207 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4637f-e851-497e-b5e1-552664c91de0 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:57:43.107742 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-48d4637f-e851-497e-b5e1-552664c91de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:57:43.139883 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:57:43.227280 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4637f-e851-497e-b5e1-552664c91de0 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:57:43.301692 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c8b84-f914-4d2d-ac0b-7b4f51646f53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:57:43.302352 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c8b84-f914-4d2d-ac0b-7b4f51646f53 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:57:43.302642 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c8b84-f914-4d2d-ac0b-7b4f51646f53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:57:43.302924 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c8b84-f914-4d2d-ac0b-7b4f51646f53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:57:43.305160 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-d26c8b84-f914-4d2d-ac0b-7b4f51646f53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:57:43.383865 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:57:43.418782 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c8b84-f914-4d2d-ac0b-7b4f51646f53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:57:43.420528 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c8b84-f914-4d2d-ac0b-7b4f51646f53 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:57:43.439037 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 675/1329] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:57:43 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:57:45.939157 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895ff11-5eb6-4afa-be46-1172b6b03ea4 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:57:45.939692 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895ff11-5eb6-4afa-be46-1172b6b03ea4 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:57:45.939692 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895ff11-5eb6-4afa-be46-1172b6b03ea4 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:57:45.941047 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 655/1330] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:57:45.947042 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac2c42-d543-4455-ac9f-70d529a9d4ac None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:57:45.947448 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac2c42-d543-4455-ac9f-70d529a9d4ac None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:57:45.947611 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac2c42-d543-4455-ac9f-70d529a9d4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:57:46.011392 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-d5ac2c42-d543-4455-ac9f-70d529a9d4ac None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:57:46.012618 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-d5ac2c42-d543-4455-ac9f-70d529a9d4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:57:46.107650 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 676/1331] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:57:46.143980 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9895ff11-5eb6-4afa-be46-1172b6b03ea4 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:57:46.145493 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-9895ff11-5eb6-4afa-be46-1172b6b03ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:57:46.246413 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9895ff11-5eb6-4afa-be46-1172b6b03ea4 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:57:46.318240 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8772bc1c-ade6-4aae-977b-955110987fca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:57:46.319540 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772bc1c-ade6-4aae-977b-955110987fca service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:57:46.319829 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772bc1c-ade6-4aae-977b-955110987fca service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:57:46.320138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772bc1c-ade6-4aae-977b-955110987fca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:57:46.321776 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-8772bc1c-ade6-4aae-977b-955110987fca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:57:46.349867 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:57:46.435933 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8772bc1c-ade6-4aae-977b-955110987fca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:57:46.437389 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8772bc1c-ade6-4aae-977b-955110987fca service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:57:46.456431 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 656/1332] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:57:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:57:48.532196 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064c151-2797-431c-80b9-7530e21703f1 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:57:48.532720 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064c151-2797-431c-80b9-7530e21703f1 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:57:48.532813 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064c151-2797-431c-80b9-7530e21703f1 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:57:48.534172 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 677/1333] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:57:48.539402 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab5a53-9a30-4f3a-bae9-61b21ceeebd4 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:57:48.539780 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab5a53-9a30-4f3a-bae9-61b21ceeebd4 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:57:48.539976 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab5a53-9a30-4f3a-bae9-61b21ceeebd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:57:48.603095 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-cdab5a53-9a30-4f3a-bae9-61b21ceeebd4 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:57:48.604253 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-cdab5a53-9a30-4f3a-bae9-61b21ceeebd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:57:48.677198 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:57:48.699882 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 657/1334] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:57:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:57:48.739499 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064c151-2797-431c-80b9-7530e21703f1 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:57:48.741961 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-1064c151-2797-431c-80b9-7530e21703f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:57:48.781748 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:57:48.844340 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064c151-2797-431c-80b9-7530e21703f1 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:57:48.916481 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75aadb9-8ab6-4295-ab1b-58838fea3064 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:57:48.917054 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75aadb9-8ab6-4295-ab1b-58838fea3064 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:57:48.917340 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75aadb9-8ab6-4295-ab1b-58838fea3064 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:57:48.917640 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75aadb9-8ab6-4295-ab1b-58838fea3064 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:57:48.919263 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-e75aadb9-8ab6-4295-ab1b-58838fea3064 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:57:48.999799 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:57:49.024686 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75aadb9-8ab6-4295-ab1b-58838fea3064 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:57:49.026107 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75aadb9-8ab6-4295-ab1b-58838fea3064 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:57:49.044859 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 678/1335] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:57:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:57:51.601287 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb84e44-0e6c-4206-8eb8-836888f468bc None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:57:51.601792 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb84e44-0e6c-4206-8eb8-836888f468bc None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:57:51.601792 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb84e44-0e6c-4206-8eb8-836888f468bc None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:57:51.603177 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 658/1336] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:57:51.608496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a9e5e-fc90-4a5c-98e3-4f0cdb3c89bc None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:57:51.608874 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a9e5e-fc90-4a5c-98e3-4f0cdb3c89bc None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:57:51.609070 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a9e5e-fc90-4a5c-98e3-4f0cdb3c89bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:57:51.673348 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-ed0a9e5e-fc90-4a5c-98e3-4f0cdb3c89bc None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:57:51.674553 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-ed0a9e5e-fc90-4a5c-98e3-4f0cdb3c89bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:57:51.770876 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 679/1337] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:57:51 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:57:51.823029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3951950-d693-43d8-98ea-45ffaf78c743 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:57:51.823330 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3951950-d693-43d8-98ea-45ffaf78c743 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:57:51.823619 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3951950-d693-43d8-98ea-45ffaf78c743 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:57:51.825035 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 659/1338] 10.222.0.40 () {54 vars in 964 bytes} [Mon Jul 11 20:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:57:51.830896 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d9baa-0500-4c2b-98dc-ae3712e932d9 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:57:51.831193 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d9baa-0500-4c2b-98dc-ae3712e932d9 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:57:51.831503 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d9baa-0500-4c2b-98dc-ae3712e932d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:57:51.885032 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:57:51.906290 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-c20d9baa-0500-4c2b-98dc-ae3712e932d9 None None] MFA Rules not processed for user `29046b079f1a4f4ea2244e69cbbaa805`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:57:51.907484 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-c20d9baa-0500-4c2b-98dc-ae3712e932d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:57:51.982557 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 680/1339] 10.222.0.40 () {58 vars in 1061 bytes} [Mon Jul 11 20:57:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:57:51.992389 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3951950-d693-43d8-98ea-45ffaf78c743 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:57:51.993897 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-e3951950-d693-43d8-98ea-45ffaf78c743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:57:52.095749 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3951950-d693-43d8-98ea-45ffaf78c743 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:57:52.169173 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e07ff2b-6511-4146-a35f-5ae72747f46f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:57:52.169754 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07ff2b-6511-4146-a35f-5ae72747f46f service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:57:52.170043 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07ff2b-6511-4146-a35f-5ae72747f46f service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:57:52.170326 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07ff2b-6511-4146-a35f-5ae72747f46f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:57:52.171951 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-8e07ff2b-6511-4146-a35f-5ae72747f46f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:57:52.209750 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:57:52.285023 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e07ff2b-6511-4146-a35f-5ae72747f46f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:57:52.286454 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e07ff2b-6511-4146-a35f-5ae72747f46f service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:57:52.306888 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 660/1340] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:57:51 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:57:57.210795 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4adb91-5c80-4ece-9823-4ed5ec9d5384 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:57:57.211425 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4adb91-5c80-4ece-9823-4ed5ec9d5384 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:57:57.211425 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4adb91-5c80-4ece-9823-4ed5ec9d5384 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:57:57.212799 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 681/1341] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:57:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:57:57.219022 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560e7ed-91e8-4b0e-a509-a5cec4c2c13d None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:57:57.219022 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560e7ed-91e8-4b0e-a509-a5cec4c2c13d None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:57:57.219022 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560e7ed-91e8-4b0e-a509-a5cec4c2c13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:57:57.290929 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-1560e7ed-91e8-4b0e-a509-a5cec4c2c13d None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:57:57.292462 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-1560e7ed-91e8-4b0e-a509-a5cec4c2c13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:57:57.379412 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:57:57.390850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 661/1342] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:57:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:57:57.430765 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4adb91-5c80-4ece-9823-4ed5ec9d5384 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:57:57.432338 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-ff4adb91-5c80-4ece-9823-4ed5ec9d5384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:57:57.538555 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4adb91-5c80-4ece-9823-4ed5ec9d5384 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:57:57.576268 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:57:57.612913 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17cd86-064b-4cc0-9bf0-05b8e2d3ac50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:57:57.613574 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17cd86-064b-4cc0-9bf0-05b8e2d3ac50 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:57:57.613863 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17cd86-064b-4cc0-9bf0-05b8e2d3ac50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:57:57.614141 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17cd86-064b-4cc0-9bf0-05b8e2d3ac50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:57:57.616671 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-2b17cd86-064b-4cc0-9bf0-05b8e2d3ac50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:57:57.725965 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17cd86-064b-4cc0-9bf0-05b8e2d3ac50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:57:57.727401 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17cd86-064b-4cc0-9bf0-05b8e2d3ac50 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:57:57.745757 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 682/1343] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:57:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 20:58:00.775574 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d04269-cf91-473d-8e48-860134a76d13 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:00.776149 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d04269-cf91-473d-8e48-860134a76d13 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:00.776149 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d04269-cf91-473d-8e48-860134a76d13 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:00.777527 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 662/1344] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:58:00.782702 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf5a97-d729-4b20-8a69-322c91070da9 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:00.783128 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf5a97-d729-4b20-8a69-322c91070da9 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:00.783261 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf5a97-d729-4b20-8a69-322c91070da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:00.848667 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-0ebf5a97-d729-4b20-8a69-322c91070da9 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:58:00.849840 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-0ebf5a97-d729-4b20-8a69-322c91070da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:00.867683 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:00.949176 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 683/1345] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:58:00 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:58:00.986221 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d04269-cf91-473d-8e48-860134a76d13 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:58:00.987792 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-26d04269-cf91-473d-8e48-860134a76d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:01.091235 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d04269-cf91-473d-8e48-860134a76d13 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:58:01.164602 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a568de-178e-4ff5-8e7b-38e987298f41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:58:01.165263 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a568de-178e-4ff5-8e7b-38e987298f41 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:01.165551 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a568de-178e-4ff5-8e7b-38e987298f41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:01.165831 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a568de-178e-4ff5-8e7b-38e987298f41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:01.167460 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-66a568de-178e-4ff5-8e7b-38e987298f41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:01.211427 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:01.283634 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a568de-178e-4ff5-8e7b-38e987298f41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:58:01.285104 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a568de-178e-4ff5-8e7b-38e987298f41 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:58:01.304684 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 663/1346] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:58:00 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:58:05.461539 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102fab18-9892-467c-b027-6ebf34ca404e None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:05.462096 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102fab18-9892-467c-b027-6ebf34ca404e None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:05.462096 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102fab18-9892-467c-b027-6ebf34ca404e None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:05.463494 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 684/1347] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:58:05.468945 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fd495-4f3e-4046-833c-53bd9194b830 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:05.469391 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fd495-4f3e-4046-833c-53bd9194b830 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:05.469486 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fd495-4f3e-4046-833c-53bd9194b830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:05.538992 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-b21fd495-4f3e-4046-833c-53bd9194b830 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:58:05.540275 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b21fd495-4f3e-4046-833c-53bd9194b830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:05.643250 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:05.646455 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 664/1348] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:58:05.685924 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102fab18-9892-467c-b027-6ebf34ca404e None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:58:05.687546 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-102fab18-9892-467c-b027-6ebf34ca404e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:05.797908 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102fab18-9892-467c-b027-6ebf34ca404e None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:58:05.849305 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:05.877574 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317dda1-ebe1-477d-9e3a-782d2208c3aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:58:05.878495 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317dda1-ebe1-477d-9e3a-782d2208c3aa service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:05.878938 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317dda1-ebe1-477d-9e3a-782d2208c3aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:05.879564 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317dda1-ebe1-477d-9e3a-782d2208c3aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:05.882067 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-b317dda1-ebe1-477d-9e3a-782d2208c3aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:05.992417 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317dda1-ebe1-477d-9e3a-782d2208c3aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:58:05.993848 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317dda1-ebe1-477d-9e3a-782d2208c3aa service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:58:06.011888 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 685/1349] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:58:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:58:10.982103 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfa5d0-0802-4f44-a2ff-cbf949751771 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:10.982985 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfa5d0-0802-4f44-a2ff-cbf949751771 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:10.983479 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfa5d0-0802-4f44-a2ff-cbf949751771 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:10.985403 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 665/1350] 10.222.0.40 () {54 vars in 921 bytes} [Mon Jul 11 20:58:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:58:11.005409 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75666465-4cae-4b89-8195-bace295938a0 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:11.006461 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75666465-4cae-4b89-8195-bace295938a0 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:11.006629 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75666465-4cae-4b89-8195-bace295938a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:11.137795 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-75666465-4cae-4b89-8195-bace295938a0 None None] MFA Rules not processed for user `177a912380ad43b6a5e31b787a07ce7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:58:11.138977 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-75666465-4cae-4b89-8195-bace295938a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:11.160480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:11.266113 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 686/1351] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Jul 11 20:58:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:58:15.334369 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da187d-6b30-40b9-8588-cad875778ce3 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:15.335324 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da187d-6b30-40b9-8588-cad875778ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:15.335759 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da187d-6b30-40b9-8588-cad875778ce3 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:15.337363 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 666/1352] 10.222.0.40 () {54 vars in 921 bytes} [Mon Jul 11 20:58:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:58:15.346257 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99381b-a950-4409-ba0e-36fe96b7bb8e None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:15.346740 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99381b-a950-4409-ba0e-36fe96b7bb8e None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:15.346835 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99381b-a950-4409-ba0e-36fe96b7bb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:15.427036 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-8a99381b-a950-4409-ba0e-36fe96b7bb8e None None] MFA Rules not processed for user `177a912380ad43b6a5e31b787a07ce7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:58:15.429463 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-8a99381b-a950-4409-ba0e-36fe96b7bb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:15.508225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:15.548255 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 687/1353] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Jul 11 20:58:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:58:16.997164 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e313ac2-136c-4f85-acb6-c06ed05aca57 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:16.997709 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e313ac2-136c-4f85-acb6-c06ed05aca57 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:16.997709 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e313ac2-136c-4f85-acb6-c06ed05aca57 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:16.999079 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 667/1354] 10.222.0.40 () {54 vars in 921 bytes} [Mon Jul 11 20:58:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:58:17.006288 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eaabae-93a5-49e8-b05e-a9f3c5413e99 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:17.006288 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eaabae-93a5-49e8-b05e-a9f3c5413e99 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:17.006288 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eaabae-93a5-49e8-b05e-a9f3c5413e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:17.081666 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-d3eaabae-93a5-49e8-b05e-a9f3c5413e99 None None] MFA Rules not processed for user `177a912380ad43b6a5e31b787a07ce7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:58:17.082876 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-d3eaabae-93a5-49e8-b05e-a9f3c5413e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:17.190269 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 688/1355] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Jul 11 20:58:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:58:20.688989 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b335e-7efb-4e26-bda0-89ba5063d299 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:20.689859 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b335e-7efb-4e26-bda0-89ba5063d299 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:20.690575 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b335e-7efb-4e26-bda0-89ba5063d299 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:20.696645 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 668/1356] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:58:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:58:20.698202 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74eeeef-aa79-4a0a-87d3-8e869f3900e7 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:20.698643 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74eeeef-aa79-4a0a-87d3-8e869f3900e7 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:20.698813 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74eeeef-aa79-4a0a-87d3-8e869f3900e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:20.740494 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:20.777791 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-d74eeeef-aa79-4a0a-87d3-8e869f3900e7 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:58:20.779025 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-d74eeeef-aa79-4a0a-87d3-8e869f3900e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:20.880187 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 689/1357] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:58:20.935489 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94401fc7-645b-4767-b315-8ad6124b64e3 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:20.935784 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94401fc7-645b-4767-b315-8ad6124b64e3 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:20.936096 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94401fc7-645b-4767-b315-8ad6124b64e3 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:20.937691 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 669/1358] 10.222.0.40 () {54 vars in 961 bytes} [Mon Jul 11 20:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:58:20.948129 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7d673-6f89-429f-8dee-97877cd952d5 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:20.948732 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7d673-6f89-429f-8dee-97877cd952d5 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:20.949091 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7d673-6f89-429f-8dee-97877cd952d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:21.030302 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-a0f7d673-6f89-429f-8dee-97877cd952d5 None None] MFA Rules not processed for user `8ac15411c75f4bd4a86f6753c9240a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:58:21.031695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a0f7d673-6f89-429f-8dee-97877cd952d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:21.086593 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:21.162682 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 690/1359] 10.222.0.40 () {58 vars in 1058 bytes} [Mon Jul 11 20:58:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:58:21.170271 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94401fc7-645b-4767-b315-8ad6124b64e3 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:58:21.171782 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-94401fc7-645b-4767-b315-8ad6124b64e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:21.340086 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94401fc7-645b-4767-b315-8ad6124b64e3 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:58:21.416795 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:21.458387 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e7b06-a8b6-4eaa-9bcc-6e787b6d8ba6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:58:21.459272 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e7b06-a8b6-4eaa-9bcc-6e787b6d8ba6 service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:21.459568 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e7b06-a8b6-4eaa-9bcc-6e787b6d8ba6 service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:21.459938 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e7b06-a8b6-4eaa-9bcc-6e787b6d8ba6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:21.461692 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-f77e7b06-a8b6-4eaa-9bcc-6e787b6d8ba6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:21.557475 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e7b06-a8b6-4eaa-9bcc-6e787b6d8ba6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:58:21.559086 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e7b06-a8b6-4eaa-9bcc-6e787b6d8ba6 service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:58:21.587663 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 670/1360] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:58:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:58:23.840038 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6b045-8fd9-4664-a497-2e4280a5d6b7 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:23.840542 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6b045-8fd9-4664-a497-2e4280a5d6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:23.840542 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6b045-8fd9-4664-a497-2e4280a5d6b7 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:23.842013 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 691/1361] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:58:23.847209 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c7fac-a79c-49c5-888d-90e15c72c5c7 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:23.847209 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c7fac-a79c-49c5-888d-90e15c72c5c7 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:23.847845 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c7fac-a79c-49c5-888d-90e15c72c5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:23.920395 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-a72c7fac-a79c-49c5-888d-90e15c72c5c7 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:58:23.921620 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-a72c7fac-a79c-49c5-888d-90e15c72c5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:23.961157 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:24.022504 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 671/1362] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:58:24.066335 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6b045-8fd9-4664-a497-2e4280a5d6b7 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:58:24.067871 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-21a6b045-8fd9-4664-a497-2e4280a5d6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:24.239753 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6b045-8fd9-4664-a497-2e4280a5d6b7 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:58:24.250252 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:24.368539 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b5698-d4b1-44c9-ba11-a9d821b77c98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:58:24.369582 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b5698-d4b1-44c9-ba11-a9d821b77c98 service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:24.370147 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b5698-d4b1-44c9-ba11-a9d821b77c98 service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:24.370573 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b5698-d4b1-44c9-ba11-a9d821b77c98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:24.373534 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-494b5698-d4b1-44c9-ba11-a9d821b77c98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:24.493589 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b5698-d4b1-44c9-ba11-a9d821b77c98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:58:24.495207 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b5698-d4b1-44c9-ba11-a9d821b77c98 service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:58:24.514822 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 692/1363] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:58:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:58:27.041613 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fa9c0-bce2-429c-8262-3f5569a9128a None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:27.042222 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fa9c0-bce2-429c-8262-3f5569a9128a None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:27.042222 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fa9c0-bce2-429c-8262-3f5569a9128a None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:27.043883 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 672/1364] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:58:27.049245 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd9e3a-ebf8-471c-9335-d47eac06571d None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:27.050057 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd9e3a-ebf8-471c-9335-d47eac06571d None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:27.050340 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd9e3a-ebf8-471c-9335-d47eac06571d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:27.070522 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:27.128864 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-19bd9e3a-ebf8-471c-9335-d47eac06571d None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:58:27.130210 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-19bd9e3a-ebf8-471c-9335-d47eac06571d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:27.240409 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 693/1365] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:58:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:58:27.288475 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176982a-0f51-4332-85ae-8a4de497ea7e None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:27.288792 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176982a-0f51-4332-85ae-8a4de497ea7e None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:27.289073 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176982a-0f51-4332-85ae-8a4de497ea7e None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:27.290746 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 673/1366] 10.222.0.40 () {54 vars in 961 bytes} [Mon Jul 11 20:58:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:58:27.296944 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fc7e8-4956-42d1-bc65-1b163263bc4f None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:27.296944 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fc7e8-4956-42d1-bc65-1b163263bc4f None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:27.297233 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fc7e8-4956-42d1-bc65-1b163263bc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:27.378537 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-539fc7e8-4956-42d1-bc65-1b163263bc4f None None] MFA Rules not processed for user `8ac15411c75f4bd4a86f6753c9240a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:58:27.379745 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-539fc7e8-4956-42d1-bc65-1b163263bc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:27.418721 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:27.501252 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 694/1367] 10.222.0.40 () {58 vars in 1058 bytes} [Mon Jul 11 20:58:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:58:27.510032 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176982a-0f51-4332-85ae-8a4de497ea7e None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:58:27.512037 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c176982a-0f51-4332-85ae-8a4de497ea7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:27.695099 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176982a-0f51-4332-85ae-8a4de497ea7e None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:58:27.718131 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:27.829924 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b6fa8-996a-4f09-b948-260084716ac0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:58:27.830596 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b6fa8-996a-4f09-b948-260084716ac0 service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:27.830886 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b6fa8-996a-4f09-b948-260084716ac0 service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:27.831274 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b6fa8-996a-4f09-b948-260084716ac0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:27.833008 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-526b6fa8-996a-4f09-b948-260084716ac0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:27.947229 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b6fa8-996a-4f09-b948-260084716ac0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:58:27.949057 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b6fa8-996a-4f09-b948-260084716ac0 service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:58:27.972012 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 674/1368] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:58:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:58:28.978966 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774fd190-e98a-451f-b735-492a6d5a2dc0 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:28.979515 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774fd190-e98a-451f-b735-492a6d5a2dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:28.979600 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774fd190-e98a-451f-b735-492a6d5a2dc0 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:28.981120 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 695/1369] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:58:28.986177 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c686a4-0ee0-4345-808e-6868cb364257 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:28.986595 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c686a4-0ee0-4345-808e-6868cb364257 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:28.986767 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c686a4-0ee0-4345-808e-6868cb364257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:29.020101 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:29.058460 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-46c686a4-0ee0-4345-808e-6868cb364257 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:58:29.060245 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-46c686a4-0ee0-4345-808e-6868cb364257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:29.171239 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 675/1370] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:58:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:58:29.523096 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb12da8-13f4-4e06-a6b3-4d0e28dc9562 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:29.524145 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb12da8-13f4-4e06-a6b3-4d0e28dc9562 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:29.524145 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb12da8-13f4-4e06-a6b3-4d0e28dc9562 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:29.525226 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 696/1371] 10.222.0.40 () {54 vars in 963 bytes} [Mon Jul 11 20:58:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:58:29.530157 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0883842-345f-4708-8170-991159871ddb None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:29.530461 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0883842-345f-4708-8170-991159871ddb None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:29.530751 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0883842-345f-4708-8170-991159871ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:29.610483 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-d0883842-345f-4708-8170-991159871ddb None None] MFA Rules not processed for user `e4ae1169746141bc8993707b12cacd80`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:58:29.611690 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d0883842-345f-4708-8170-991159871ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:29.665081 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:29.704129 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 676/1372] 10.222.0.40 () {58 vars in 1060 bytes} [Mon Jul 11 20:58:29 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:58:29.711339 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb12da8-13f4-4e06-a6b3-4d0e28dc9562 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:58:29.713273 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-fdb12da8-13f4-4e06-a6b3-4d0e28dc9562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:29.833174 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb12da8-13f4-4e06-a6b3-4d0e28dc9562 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:58:29.879679 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:29.920547 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ebb8e-51b6-42dd-b460-29672009c379 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:58:29.921175 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ebb8e-51b6-42dd-b460-29672009c379 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:29.921698 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ebb8e-51b6-42dd-b460-29672009c379 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:29.922170 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ebb8e-51b6-42dd-b460-29672009c379 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:29.924150 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-4e8ebb8e-51b6-42dd-b460-29672009c379 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:30.043028 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ebb8e-51b6-42dd-b460-29672009c379 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:58:30.044511 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ebb8e-51b6-42dd-b460-29672009c379 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:58:30.066463 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 697/1373] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:58:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:58:30.227685 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1dec8a-f41f-4c10-b55e-74fca3123b56 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:30.228226 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1dec8a-f41f-4c10-b55e-74fca3123b56 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:30.228226 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1dec8a-f41f-4c10-b55e-74fca3123b56 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:30.232673 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 677/1374] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:58:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:58:30.234553 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35ce59-1e84-4129-855c-9075b96d2986 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:30.235245 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35ce59-1e84-4129-855c-9075b96d2986 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:30.235245 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35ce59-1e84-4129-855c-9075b96d2986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:30.338680 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-2e35ce59-1e84-4129-855c-9075b96d2986 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:58:30.340137 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-2e35ce59-1e84-4129-855c-9075b96d2986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:30.363530 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:30.446748 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 698/1375] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:58:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:58:30.490338 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1dec8a-f41f-4c10-b55e-74fca3123b56 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:58:30.491846 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-3a1dec8a-f41f-4c10-b55e-74fca3123b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:30.637714 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1dec8a-f41f-4c10-b55e-74fca3123b56 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:58:30.689035 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:30.756881 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6c0c1-dc8e-45b6-bff4-0264f0494f1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:58:30.757578 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6c0c1-dc8e-45b6-bff4-0264f0494f1b service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:30.757869 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6c0c1-dc8e-45b6-bff4-0264f0494f1b service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:30.758153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6c0c1-dc8e-45b6-bff4-0264f0494f1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:30.760156 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-74e6c0c1-dc8e-45b6-bff4-0264f0494f1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:30.852927 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e6c0c1-dc8e-45b6-bff4-0264f0494f1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:58:30.854509 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e6c0c1-dc8e-45b6-bff4-0264f0494f1b service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:58:30.873075 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 678/1376] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:58:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:58:33.038980 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149c476-b396-40e2-8c22-3aa950728737 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:33.039544 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149c476-b396-40e2-8c22-3aa950728737 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:33.039544 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149c476-b396-40e2-8c22-3aa950728737 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:33.041000 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 699/1377] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:58:33.046123 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053aacd3-f45b-4f8e-8d24-8009d2beda53 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:33.046545 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053aacd3-f45b-4f8e-8d24-8009d2beda53 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:33.046689 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053aacd3-f45b-4f8e-8d24-8009d2beda53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:33.112845 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-053aacd3-f45b-4f8e-8d24-8009d2beda53 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:58:33.114048 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-053aacd3-f45b-4f8e-8d24-8009d2beda53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:33.121390 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:33.224638 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 679/1378] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:58:33.270054 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149c476-b396-40e2-8c22-3aa950728737 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:58:33.271588 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-1149c476-b396-40e2-8c22-3aa950728737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:33.429180 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149c476-b396-40e2-8c22-3aa950728737 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:58:33.432654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:33.544065 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097134f-0b4a-49a7-8fe5-f6e1cb9f5505 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:58:33.546300 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097134f-0b4a-49a7-8fe5-f6e1cb9f5505 service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:33.546300 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097134f-0b4a-49a7-8fe5-f6e1cb9f5505 service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:33.546300 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097134f-0b4a-49a7-8fe5-f6e1cb9f5505 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:33.548898 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-1097134f-0b4a-49a7-8fe5-f6e1cb9f5505 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:33.645349 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1097134f-0b4a-49a7-8fe5-f6e1cb9f5505 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:58:33.647018 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1097134f-0b4a-49a7-8fe5-f6e1cb9f5505 service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:58:33.676019 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 700/1379] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:58:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:58:35.882921 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5ad75-7527-485d-864d-bb063060790d None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:35.883450 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5ad75-7527-485d-864d-bb063060790d None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:35.883450 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5ad75-7527-485d-864d-bb063060790d None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:35.885278 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 680/1380] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:58:35.890387 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e756e-ebe2-4ea3-a82f-6aeaa685607d None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:35.890833 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e756e-ebe2-4ea3-a82f-6aeaa685607d None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:35.891057 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e756e-ebe2-4ea3-a82f-6aeaa685607d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:35.901425 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:35.961005 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-a90e756e-ebe2-4ea3-a82f-6aeaa685607d None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:58:35.962216 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a90e756e-ebe2-4ea3-a82f-6aeaa685607d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:36.064747 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 701/1381] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:58:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:58:36.109106 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5ad75-7527-485d-864d-bb063060790d None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:58:36.110595 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-4cd5ad75-7527-485d-864d-bb063060790d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:36.256711 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:36.267425 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5ad75-7527-485d-864d-bb063060790d None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:58:36.389039 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86888d4f-b1cd-4732-b8d8-3d3233fba8e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:58:36.389690 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86888d4f-b1cd-4732-b8d8-3d3233fba8e9 service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:36.389977 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86888d4f-b1cd-4732-b8d8-3d3233fba8e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:36.390256 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86888d4f-b1cd-4732-b8d8-3d3233fba8e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:36.391877 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-86888d4f-b1cd-4732-b8d8-3d3233fba8e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:36.485290 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86888d4f-b1cd-4732-b8d8-3d3233fba8e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:58:36.486866 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86888d4f-b1cd-4732-b8d8-3d3233fba8e9 service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:58:36.498327 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:36.507236 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 681/1382] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:58:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:58:39.003536 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacedaf-73ac-47ec-9e39-bf7d1f26bcc4 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:39.004101 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacedaf-73ac-47ec-9e39-bf7d1f26bcc4 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:39.004193 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacedaf-73ac-47ec-9e39-bf7d1f26bcc4 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:39.005523 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 702/1383] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:58:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:58:39.012590 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293b754-37a3-42f2-b2dc-8673f6958388 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:39.013019 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293b754-37a3-42f2-b2dc-8673f6958388 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:39.013159 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293b754-37a3-42f2-b2dc-8673f6958388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:39.079910 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-6293b754-37a3-42f2-b2dc-8673f6958388 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:58:39.081138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-6293b754-37a3-42f2-b2dc-8673f6958388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:39.178436 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 682/1384] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:58:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:58:39.221885 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacedaf-73ac-47ec-9e39-bf7d1f26bcc4 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:58:39.223383 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-4cacedaf-73ac-47ec-9e39-bf7d1f26bcc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:39.309711 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:39.386535 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacedaf-73ac-47ec-9e39-bf7d1f26bcc4 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:58:39.503366 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec407f44-2ced-4a0a-aad3-9879b9be6ef9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:58:39.504065 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec407f44-2ced-4a0a-aad3-9879b9be6ef9 service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:39.504361 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec407f44-2ced-4a0a-aad3-9879b9be6ef9 service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:39.504644 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec407f44-2ced-4a0a-aad3-9879b9be6ef9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:39.506300 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-ec407f44-2ced-4a0a-aad3-9879b9be6ef9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:39.558892 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:39.601441 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec407f44-2ced-4a0a-aad3-9879b9be6ef9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:58:39.602975 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec407f44-2ced-4a0a-aad3-9879b9be6ef9 service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:58:39.622118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 703/1385] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:58:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:58:41.675802 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f053ce5-08a2-4a7b-a376-432e499452b6 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:41.676275 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f053ce5-08a2-4a7b-a376-432e499452b6 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:41.676571 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f053ce5-08a2-4a7b-a376-432e499452b6 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:41.679243 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 683/1386] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:58:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:58:41.684384 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af46ebf-539e-4b94-9fae-e6a2757fcc7c None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:41.684789 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af46ebf-539e-4b94-9fae-e6a2757fcc7c None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:41.684950 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af46ebf-539e-4b94-9fae-e6a2757fcc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:41.754129 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-7af46ebf-539e-4b94-9fae-e6a2757fcc7c None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:58:41.755573 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-7af46ebf-539e-4b94-9fae-e6a2757fcc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:41.866450 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 704/1387] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:58:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:58:41.912361 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f053ce5-08a2-4a7b-a376-432e499452b6 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:58:41.913922 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-8f053ce5-08a2-4a7b-a376-432e499452b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:41.990538 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:42.061282 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f053ce5-08a2-4a7b-a376-432e499452b6 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:58:42.175999 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d75003-8217-471c-8de4-12e15791ca73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:58:42.176665 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d75003-8217-471c-8de4-12e15791ca73 service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:42.177539 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d75003-8217-471c-8de4-12e15791ca73 service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:42.177812 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d75003-8217-471c-8de4-12e15791ca73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:42.179627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-63d75003-8217-471c-8de4-12e15791ca73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:42.218056 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:42.275666 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d75003-8217-471c-8de4-12e15791ca73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:58:42.277247 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d75003-8217-471c-8de4-12e15791ca73 service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:58:42.295587 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 684/1388] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:58:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:58:44.720316 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad9cde-345a-47ec-80c1-ce11118557d2 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:44.720846 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad9cde-345a-47ec-80c1-ce11118557d2 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:44.720965 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad9cde-345a-47ec-80c1-ce11118557d2 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:44.722364 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 705/1389] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:58:44.728257 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4183d17-84f6-4b34-b430-01a50c35914f None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:44.728660 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4183d17-84f6-4b34-b430-01a50c35914f None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:44.728946 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4183d17-84f6-4b34-b430-01a50c35914f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:44.796177 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-b4183d17-84f6-4b34-b430-01a50c35914f None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:58:44.797389 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b4183d17-84f6-4b34-b430-01a50c35914f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:44.903403 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 685/1390] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:58:44.948697 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad9cde-345a-47ec-80c1-ce11118557d2 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:58:44.950283 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-89ad9cde-345a-47ec-80c1-ce11118557d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:44.982977 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:45.099288 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad9cde-345a-47ec-80c1-ce11118557d2 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:58:45.213972 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:45.226423 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c9a8b-bedb-40f2-8f7b-686732a40db1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:58:45.227129 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c9a8b-bedb-40f2-8f7b-686732a40db1 service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:45.227479 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c9a8b-bedb-40f2-8f7b-686732a40db1 service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:45.227766 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c9a8b-bedb-40f2-8f7b-686732a40db1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:45.229496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a33c9a8b-bedb-40f2-8f7b-686732a40db1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:45.320348 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c9a8b-bedb-40f2-8f7b-686732a40db1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:58:45.322013 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c9a8b-bedb-40f2-8f7b-686732a40db1 service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:58:45.340467 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 706/1391] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:58:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:58:45.534856 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07ab6b-33d8-4515-8fff-61292ca8d159 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:45.535156 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07ab6b-33d8-4515-8fff-61292ca8d159 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:45.535443 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07ab6b-33d8-4515-8fff-61292ca8d159 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:45.536868 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 686/1392] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:58:45.542422 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc1e50-b427-43ea-b667-305efcab5961 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:45.542720 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc1e50-b427-43ea-b667-305efcab5961 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:45.543006 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc1e50-b427-43ea-b667-305efcab5961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:45.618207 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-ffdc1e50-b427-43ea-b667-305efcab5961 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:58:45.619478 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-ffdc1e50-b427-43ea-b667-305efcab5961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:45.686655 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:45.726565 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 707/1393] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:58:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:58:45.782503 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0469b5-6dc4-41ae-a3f9-f24881f3c07b None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:45.783038 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0469b5-6dc4-41ae-a3f9-f24881f3c07b None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:45.783131 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0469b5-6dc4-41ae-a3f9-f24881f3c07b None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:45.784491 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 687/1394] 10.222.0.40 () {54 vars in 962 bytes} [Mon Jul 11 20:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:58:45.790259 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbd1fe-7839-417a-9c59-cc8e5890caa6 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:45.790557 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbd1fe-7839-417a-9c59-cc8e5890caa6 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:45.790841 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbd1fe-7839-417a-9c59-cc8e5890caa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:45.868848 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-59fbd1fe-7839-417a-9c59-cc8e5890caa6 None None] MFA Rules not processed for user `da488c75631e4e5992304ff6c0579aab`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:58:45.870086 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-59fbd1fe-7839-417a-9c59-cc8e5890caa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:45.948326 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 708/1395] 10.222.0.40 () {58 vars in 1059 bytes} [Mon Jul 11 20:58:45 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:58:45.956008 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0469b5-6dc4-41ae-a3f9-f24881f3c07b None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:58:45.957488 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-7d0469b5-6dc4-41ae-a3f9-f24881f3c07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:45.971077 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:46.062286 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0469b5-6dc4-41ae-a3f9-f24881f3c07b None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:58:46.135243 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e558e68-3636-4702-94a7-3d858b1100c8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da488c75631e4e5992304ff6c0579aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:58:46.135902 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e558e68-3636-4702-94a7-3d858b1100c8 service glance] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:46.136220 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e558e68-3636-4702-94a7-3d858b1100c8 service glance] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:46.136498 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e558e68-3636-4702-94a7-3d858b1100c8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:46.138124 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-2e558e68-3636-4702-94a7-3d858b1100c8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:46.206369 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:46.247735 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e558e68-3636-4702-94a7-3d858b1100c8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:58:46.249200 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e558e68-3636-4702-94a7-3d858b1100c8 service glance] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:58:46.268073 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 688/1396] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:58:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:58:47.155989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcd11e-473b-4e0f-ab13-6da4dcc9c198 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:47.156472 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcd11e-473b-4e0f-ab13-6da4dcc9c198 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:47.156588 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcd11e-473b-4e0f-ab13-6da4dcc9c198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:47.226665 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-25dcd11e-473b-4e0f-ab13-6da4dcc9c198 None None] MFA Rules not processed for user `90ea5d52fd6d4068b7837d363eebb94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:58:47.228392 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-25dcd11e-473b-4e0f-ab13-6da4dcc9c198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:47.238566 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:47.320453 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 709/1397] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Jul 11 20:58:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:58:47.368755 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253eb6b4-548d-476b-85d0-e21ee78b547b None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:47.369779 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253eb6b4-548d-476b-85d0-e21ee78b547b None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:47.370219 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253eb6b4-548d-476b-85d0-e21ee78b547b None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:47.372574 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 689/1398] 10.222.0.40 () {54 vars in 942 bytes} [Mon Jul 11 20:58:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:58:47.378539 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edbbba-d27d-47c9-896a-eb8efacc2eef None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:47.378836 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edbbba-d27d-47c9-896a-eb8efacc2eef None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:47.379115 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edbbba-d27d-47c9-896a-eb8efacc2eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:47.462444 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-c6edbbba-d27d-47c9-896a-eb8efacc2eef None None] MFA Rules not processed for user `dc950dfb1d3b4308a33f3d430fe34c1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:58:47.463645 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-c6edbbba-d27d-47c9-896a-eb8efacc2eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:47.534615 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3e4a9-2b8c-441b-aa74-3dbd2912bb90 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:47.534822 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3e4a9-2b8c-441b-aa74-3dbd2912bb90 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:47.535092 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3e4a9-2b8c-441b-aa74-3dbd2912bb90 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:47.536602 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 690/1399] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 20:58:47.541382 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972eb04-b483-426b-b5e3-d4167df01e77 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:47.541667 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972eb04-b483-426b-b5e3-d4167df01e77 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:47.541950 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972eb04-b483-426b-b5e3-d4167df01e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:47.550374 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:47.615798 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-9972eb04-b483-426b-b5e3-d4167df01e77 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:58:47.617103 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-9972eb04-b483-426b-b5e3-d4167df01e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:47.694447 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 710/1400] 10.222.0.40 () {58 vars in 1039 bytes} [Mon Jul 11 20:58:47 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:58:47.703814 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6edbbba-d27d-47c9-896a-eb8efacc2eef None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:58:47.713260 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6edbbba-d27d-47c9-896a-eb8efacc2eef None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:58:47.725674 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 691/1401] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 20:58:47.771209 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972eb04-b483-426b-b5e3-d4167df01e77 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:58:47.772593 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-9972eb04-b483-426b-b5e3-d4167df01e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:47.799160 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:47.821982 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb28ae6-1526-4ec4-b42f-7f083d414e54 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc950dfb1d3b4308a33f3d430fe34c1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:58:47.822645 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb28ae6-1526-4ec4-b42f-7f083d414e54 service swift] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:47.822936 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb28ae6-1526-4ec4-b42f-7f083d414e54 service swift] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:47.823221 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb28ae6-1526-4ec4-b42f-7f083d414e54 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:47.825075 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-ddb28ae6-1526-4ec4-b42f-7f083d414e54 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:47.890952 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972eb04-b483-426b-b5e3-d4167df01e77 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:58:47.912245 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb28ae6-1526-4ec4-b42f-7f083d414e54 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:58:47.913863 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb28ae6-1526-4ec4-b42f-7f083d414e54 service swift] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:58:47.922152 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 711/1402] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jul 11 20:58:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 20:58:48.007787 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5589b56-a3b6-4d0d-9f05-f96b0ee8256c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:58:48.008477 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5589b56-a3b6-4d0d-9f05-f96b0ee8256c service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:48.008768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5589b56-a3b6-4d0d-9f05-f96b0ee8256c service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:48.009051 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5589b56-a3b6-4d0d-9f05-f96b0ee8256c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:48.010989 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-f5589b56-a3b6-4d0d-9f05-f96b0ee8256c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:48.028616 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:48.100888 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5589b56-a3b6-4d0d-9f05-f96b0ee8256c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:58:48.102507 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5589b56-a3b6-4d0d-9f05-f96b0ee8256c service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:58:48.120980 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 692/1403] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:58:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 20:58:50.364771 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9be08-1bd3-4a29-aed7-7b4d167215b5 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:50.365283 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9be08-1bd3-4a29-aed7-7b4d167215b5 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:50.365402 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9be08-1bd3-4a29-aed7-7b4d167215b5 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:50.366711 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 712/1404] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:58:50.372128 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d1300-4a49-4075-aee0-ccd71cd3d20c None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:50.372595 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d1300-4a49-4075-aee0-ccd71cd3d20c None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:50.372699 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d1300-4a49-4075-aee0-ccd71cd3d20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:50.447455 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-763d1300-4a49-4075-aee0-ccd71cd3d20c None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:58:50.449215 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-763d1300-4a49-4075-aee0-ccd71cd3d20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:50.549371 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:50.572477 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 693/1405] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:58:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:58:50.601096 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9be08-1bd3-4a29-aed7-7b4d167215b5 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:58:50.602858 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-00b9be08-1bd3-4a29-aed7-7b4d167215b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:50.613732 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:50.768444 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9be08-1bd3-4a29-aed7-7b4d167215b5 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:58:50.858973 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:50.895210 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be422c03-8dd4-402a-b20f-568986aa822e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:58:50.896582 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be422c03-8dd4-402a-b20f-568986aa822e service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:50.896881 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be422c03-8dd4-402a-b20f-568986aa822e service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:50.897163 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be422c03-8dd4-402a-b20f-568986aa822e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:50.899764 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-be422c03-8dd4-402a-b20f-568986aa822e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:51.000930 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be422c03-8dd4-402a-b20f-568986aa822e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:58:51.002943 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be422c03-8dd4-402a-b20f-568986aa822e service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:58:51.022932 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 713/1406] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:58:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:58:53.389492 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e916e-15b6-46fc-bda2-027073a61c0c None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:53.390068 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e916e-15b6-46fc-bda2-027073a61c0c None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:53.390068 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e916e-15b6-46fc-bda2-027073a61c0c None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:53.391570 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 694/1407] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 20:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:58:53.397005 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfa9c8-9b8a-401e-a1bf-4f185738ac05 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:53.397427 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfa9c8-9b8a-401e-a1bf-4f185738ac05 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:53.397559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfa9c8-9b8a-401e-a1bf-4f185738ac05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:53.464894 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-eabfa9c8-9b8a-401e-a1bf-4f185738ac05 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:58:53.466122 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-eabfa9c8-9b8a-401e-a1bf-4f185738ac05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:53.526627 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:53.592520 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 714/1408] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 20:58:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:58:53.643781 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e916e-15b6-46fc-bda2-027073a61c0c None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:58:53.645293 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-926e916e-15b6-46fc-bda2-027073a61c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:53.811787 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e916e-15b6-46fc-bda2-027073a61c0c None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:58:53.886276 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:58:53.936012 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa631f-6d1a-4821-a86e-996e25853cbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:58:53.936588 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa631f-6d1a-4821-a86e-996e25853cbb service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:58:53.936878 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa631f-6d1a-4821-a86e-996e25853cbb service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:58:53.937157 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa631f-6d1a-4821-a86e-996e25853cbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:58:53.938827 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-f1aa631f-6d1a-4821-a86e-996e25853cbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:58:54.120655 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa631f-6d1a-4821-a86e-996e25853cbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:58:54.122402 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa631f-6d1a-4821-a86e-996e25853cbb service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:58:54.161071 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 695/1409] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:58:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:59:03.609829 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=23 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:04.154494 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=64 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:11.056808 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e102702-09c5-4289-a312-fb32227f4b10 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:11.057464 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e102702-09c5-4289-a312-fb32227f4b10 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:11.057464 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e102702-09c5-4289-a312-fb32227f4b10 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:11.058748 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 715/1410] 10.222.0.40 () {54 vars in 918 bytes} [Mon Jul 11 20:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:59:11.063705 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656f4b6-60f2-4652-ae0e-17bbba572596 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:11.064185 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656f4b6-60f2-4652-ae0e-17bbba572596 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:11.064285 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656f4b6-60f2-4652-ae0e-17bbba572596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:11.137295 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-3656f4b6-60f2-4652-ae0e-17bbba572596 None None] MFA Rules not processed for user `177a912380ad43b6a5e31b787a07ce7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:59:11.138492 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-3656f4b6-60f2-4652-ae0e-17bbba572596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:11.246845 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 696/1411] 10.222.0.40 () {58 vars in 1015 bytes} [Mon Jul 11 20:59:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:59:11.261720 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4ad36-a288-4129-9384-8e20f89c75fc None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:11.262014 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4ad36-a288-4129-9384-8e20f89c75fc None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:11.262299 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4ad36-a288-4129-9384-8e20f89c75fc None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:11.263699 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 716/1412] 10.222.0.40 () {54 vars in 918 bytes} [Mon Jul 11 20:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:59:11.268545 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ba8c9-8cc1-4223-9f60-16ec3cd571c3 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:11.268840 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ba8c9-8cc1-4223-9f60-16ec3cd571c3 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:11.269122 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ba8c9-8cc1-4223-9f60-16ec3cd571c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:11.356236 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:11.359602 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-603ba8c9-8cc1-4223-9f60-16ec3cd571c3 None None] MFA Rules not processed for user `8ac15411c75f4bd4a86f6753c9240a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:59:11.360911 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-603ba8c9-8cc1-4223-9f60-16ec3cd571c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:11.477370 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 697/1413] 10.222.0.40 () {58 vars in 1015 bytes} [Mon Jul 11 20:59:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 20:59:13.942772 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac90ff-51c0-4ffa-8d12-5190e7c6283e None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:13.943303 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac90ff-51c0-4ffa-8d12-5190e7c6283e None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:13.943414 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac90ff-51c0-4ffa-8d12-5190e7c6283e None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:13.945399 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 717/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 20:59:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:59:13.950470 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45391d-1a64-4bd2-92df-803820737110 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:13.950910 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45391d-1a64-4bd2-92df-803820737110 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:13.951024 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45391d-1a64-4bd2-92df-803820737110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:14.019623 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-ec45391d-1a64-4bd2-92df-803820737110 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:59:14.023189 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-ec45391d-1a64-4bd2-92df-803820737110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:14.077816 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:14.119563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 698/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 20:59:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:59:14.162872 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac90ff-51c0-4ffa-8d12-5190e7c6283e None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:59:14.164431 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-eaac90ff-51c0-4ffa-8d12-5190e7c6283e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:14.309648 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac90ff-51c0-4ffa-8d12-5190e7c6283e None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:59:14.381411 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:14.422285 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13e9b5-60bc-4129-bc04-104c2e0aa43c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:59:14.422938 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13e9b5-60bc-4129-bc04-104c2e0aa43c service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:14.423225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13e9b5-60bc-4129-bc04-104c2e0aa43c service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:14.423504 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13e9b5-60bc-4129-bc04-104c2e0aa43c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:14.425175 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-2c13e9b5-60bc-4129-bc04-104c2e0aa43c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:14.514142 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13e9b5-60bc-4129-bc04-104c2e0aa43c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:59:14.515717 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13e9b5-60bc-4129-bc04-104c2e0aa43c service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:59:14.533063 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 718/1416] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:59:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 20:59:15.437144 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8b170-f3c2-4a2e-b426-b6b57400bcb1 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:15.437704 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8b170-f3c2-4a2e-b426-b6b57400bcb1 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:15.437704 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8b170-f3c2-4a2e-b426-b6b57400bcb1 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:15.439099 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 699/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 20:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:59:15.444727 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ef58a-5e15-4b73-8766-0cc2dba911f9 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:15.445133 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ef58a-5e15-4b73-8766-0cc2dba911f9 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:15.445287 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ef58a-5e15-4b73-8766-0cc2dba911f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:15.518064 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-070ef58a-5e15-4b73-8766-0cc2dba911f9 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:59:15.519252 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-070ef58a-5e15-4b73-8766-0cc2dba911f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:15.545223 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:15.616269 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 719/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 20:59:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:59:15.766045 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8b170-f3c2-4a2e-b426-b6b57400bcb1 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:59:15.767557 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-4bd8b170-f3c2-4a2e-b426-b6b57400bcb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:15.914904 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8b170-f3c2-4a2e-b426-b6b57400bcb1 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:59:15.954794 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:16.026438 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae23ccf-06c8-4b93-9438-766f3c6ddfb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:59:16.027022 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae23ccf-06c8-4b93-9438-766f3c6ddfb6 service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:16.027308 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae23ccf-06c8-4b93-9438-766f3c6ddfb6 service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:16.027587 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae23ccf-06c8-4b93-9438-766f3c6ddfb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:16.029238 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-bae23ccf-06c8-4b93-9438-766f3c6ddfb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:16.118607 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae23ccf-06c8-4b93-9438-766f3c6ddfb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:59:16.120235 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae23ccf-06c8-4b93-9438-766f3c6ddfb6 service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:59:16.138009 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 700/1419] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:59:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:59:17.038378 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323caa8-c51d-4600-8e35-8f53386f8a57 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:17.038949 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323caa8-c51d-4600-8e35-8f53386f8a57 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:17.038949 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323caa8-c51d-4600-8e35-8f53386f8a57 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:17.040339 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 720/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 20:59:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:59:17.045357 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3dd60-2eed-43c4-bba8-73ec19c9540c None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:17.045763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3dd60-2eed-43c4-bba8-73ec19c9540c None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:17.045932 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3dd60-2eed-43c4-bba8-73ec19c9540c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:17.100697 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:17.121871 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-efc3dd60-2eed-43c4-bba8-73ec19c9540c None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:59:17.123084 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-efc3dd60-2eed-43c4-bba8-73ec19c9540c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:17.220571 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 701/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 20:59:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:59:17.373015 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323caa8-c51d-4600-8e35-8f53386f8a57 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:59:17.374496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-3323caa8-c51d-4600-8e35-8f53386f8a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:17.523166 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323caa8-c51d-4600-8e35-8f53386f8a57 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:59:17.535006 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:17.635597 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a4946-e7c9-41d3-8fc2-e2bd2feeb1f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:59:17.636201 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a4946-e7c9-41d3-8fc2-e2bd2feeb1f7 service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:17.636491 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a4946-e7c9-41d3-8fc2-e2bd2feeb1f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:17.636772 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a4946-e7c9-41d3-8fc2-e2bd2feeb1f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:17.638412 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-566a4946-e7c9-41d3-8fc2-e2bd2feeb1f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:17.727737 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a4946-e7c9-41d3-8fc2-e2bd2feeb1f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:59:17.729348 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a4946-e7c9-41d3-8fc2-e2bd2feeb1f7 service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:59:17.747208 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 721/1422] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:59:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:59:18.609760 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61420a2b-f62b-413a-a9da-9921deede9d9 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:18.610313 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61420a2b-f62b-413a-a9da-9921deede9d9 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:18.610313 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61420a2b-f62b-413a-a9da-9921deede9d9 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:18.611705 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 702/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 20:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:59:18.617398 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e8ec4-0750-4eba-9830-fecea21903d3 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:18.617798 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e8ec4-0750-4eba-9830-fecea21903d3 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:18.617966 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e8ec4-0750-4eba-9830-fecea21903d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:18.637064 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:18.692392 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-772e8ec4-0750-4eba-9830-fecea21903d3 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:59:18.694319 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-772e8ec4-0750-4eba-9830-fecea21903d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:18.791744 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 722/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 20:59:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:59:18.942518 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61420a2b-f62b-413a-a9da-9921deede9d9 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:59:18.944478 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-61420a2b-f62b-413a-a9da-9921deede9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:19.053045 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:19.090386 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61420a2b-f62b-413a-a9da-9921deede9d9 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:59:19.201742 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d39e6-3674-4eef-937b-21a3ac2c141f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:59:19.202396 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d39e6-3674-4eef-937b-21a3ac2c141f service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:19.202683 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d39e6-3674-4eef-937b-21a3ac2c141f service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:19.202971 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d39e6-3674-4eef-937b-21a3ac2c141f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:19.204617 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-773d39e6-3674-4eef-937b-21a3ac2c141f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:19.279118 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:19.292325 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d39e6-3674-4eef-937b-21a3ac2c141f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:59:19.293921 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d39e6-3674-4eef-937b-21a3ac2c141f service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:59:19.312898 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 703/1425] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:59:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:59:20.168553 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ddd8b-bac4-47e2-abc9-d1b73aa38ad7 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:20.169097 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ddd8b-bac4-47e2-abc9-d1b73aa38ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:20.169097 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ddd8b-bac4-47e2-abc9-d1b73aa38ad7 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:20.170531 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 723/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 20:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:59:20.175525 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029d46b-115d-4c8b-8a25-7fcd134fd520 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:20.175949 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029d46b-115d-4c8b-8a25-7fcd134fd520 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:20.176136 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029d46b-115d-4c8b-8a25-7fcd134fd520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:20.252448 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-9029d46b-115d-4c8b-8a25-7fcd134fd520 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:59:20.253661 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-9029d46b-115d-4c8b-8a25-7fcd134fd520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:20.352039 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 704/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 20:59:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:59:20.508235 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ddd8b-bac4-47e2-abc9-d1b73aa38ad7 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:59:20.510005 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-aa0ddd8b-bac4-47e2-abc9-d1b73aa38ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:20.592499 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:20.655139 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ddd8b-bac4-47e2-abc9-d1b73aa38ad7 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:59:20.766622 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08612b33-4dcb-4c32-9c34-df1f3108a88f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:59:20.767200 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08612b33-4dcb-4c32-9c34-df1f3108a88f service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:20.767484 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08612b33-4dcb-4c32-9c34-df1f3108a88f service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:20.767761 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08612b33-4dcb-4c32-9c34-df1f3108a88f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:20.769418 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-08612b33-4dcb-4c32-9c34-df1f3108a88f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:20.816891 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:20.859080 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08612b33-4dcb-4c32-9c34-df1f3108a88f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:59:20.860716 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08612b33-4dcb-4c32-9c34-df1f3108a88f service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:59:20.879148 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 724/1428] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:59:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:59:21.713233 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4bdad-a8e4-4303-b5e6-39ce44faa074 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:21.713726 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4bdad-a8e4-4303-b5e6-39ce44faa074 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:21.713825 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4bdad-a8e4-4303-b5e6-39ce44faa074 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:21.715206 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 705/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 20:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:59:21.720113 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fb575-df7b-4f09-b816-9622438f834c None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:21.720535 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fb575-df7b-4f09-b816-9622438f834c None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:21.720676 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fb575-df7b-4f09-b816-9622438f834c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:21.793451 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-631fb575-df7b-4f09-b816-9622438f834c None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:59:21.794661 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-631fb575-df7b-4f09-b816-9622438f834c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:21.888696 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 725/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 20:59:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:59:22.036995 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4bdad-a8e4-4303-b5e6-39ce44faa074 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:59:22.038561 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-11e4bdad-a8e4-4303-b5e6-39ce44faa074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:22.091249 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:22.189498 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4bdad-a8e4-4303-b5e6-39ce44faa074 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:59:22.299179 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf89beb-4d90-49b4-8cf0-d253572895f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:59:22.299756 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf89beb-4d90-49b4-8cf0-d253572895f4 service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:22.300064 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf89beb-4d90-49b4-8cf0-d253572895f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:22.300342 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf89beb-4d90-49b4-8cf0-d253572895f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:22.301983 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-3bf89beb-4d90-49b4-8cf0-d253572895f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:22.308725 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:22.390139 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf89beb-4d90-49b4-8cf0-d253572895f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:59:22.391768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf89beb-4d90-49b4-8cf0-d253572895f4 service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:59:22.410228 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 706/1431] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:59:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:59:23.259531 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150efe1e-203c-431d-9921-c49a352b921b None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:23.260311 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150efe1e-203c-431d-9921-c49a352b921b None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:23.260513 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150efe1e-203c-431d-9921-c49a352b921b None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:23.261736 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 726/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 20:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:59:23.266672 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ccaa8-2201-43b0-a2a3-9b33643e6f2f None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:23.267097 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ccaa8-2201-43b0-a2a3-9b33643e6f2f None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:23.267243 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ccaa8-2201-43b0-a2a3-9b33643e6f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:23.340843 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-9f1ccaa8-2201-43b0-a2a3-9b33643e6f2f None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:59:23.342045 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-9f1ccaa8-2201-43b0-a2a3-9b33643e6f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:23.408560 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:23.436365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 707/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 20:59:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:59:23.592241 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150efe1e-203c-431d-9921-c49a352b921b None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:59:23.593741 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-150efe1e-203c-431d-9921-c49a352b921b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:23.611124 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:23.738984 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150efe1e-203c-431d-9921-c49a352b921b None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:59:23.827051 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:23.852435 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a979d6d-c1e1-4c8b-b977-18470ed49797 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:59:23.853032 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a979d6d-c1e1-4c8b-b977-18470ed49797 service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:23.853320 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a979d6d-c1e1-4c8b-b977-18470ed49797 service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:23.853601 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a979d6d-c1e1-4c8b-b977-18470ed49797 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:23.855252 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-4a979d6d-c1e1-4c8b-b977-18470ed49797 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:23.945537 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a979d6d-c1e1-4c8b-b977-18470ed49797 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:59:23.947123 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a979d6d-c1e1-4c8b-b977-18470ed49797 service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:59:23.964935 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 727/1434] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:59:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:59:24.823476 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263213e5-4f33-457b-8229-0d1f03734e30 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:24.824088 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263213e5-4f33-457b-8229-0d1f03734e30 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:24.824088 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263213e5-4f33-457b-8229-0d1f03734e30 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:24.825469 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 708/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 20:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:59:24.830552 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353b3f2-d769-402b-8aa1-568db217ca69 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:24.835163 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353b3f2-d769-402b-8aa1-568db217ca69 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:24.835163 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353b3f2-d769-402b-8aa1-568db217ca69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:24.905934 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-b353b3f2-d769-402b-8aa1-568db217ca69 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:59:24.907133 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-b353b3f2-d769-402b-8aa1-568db217ca69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:24.947516 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:25.010304 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 728/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 20:59:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:59:25.159863 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263213e5-4f33-457b-8229-0d1f03734e30 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:59:25.161439 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-263213e5-4f33-457b-8229-0d1f03734e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:25.306164 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263213e5-4f33-457b-8229-0d1f03734e30 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:59:25.358538 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:25.416554 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b2fd9-9d82-482f-a6c6-8c2cabc00e69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:59:25.417328 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b2fd9-9d82-482f-a6c6-8c2cabc00e69 service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:25.417616 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b2fd9-9d82-482f-a6c6-8c2cabc00e69 service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:25.417893 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b2fd9-9d82-482f-a6c6-8c2cabc00e69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:25.419566 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-696b2fd9-9d82-482f-a6c6-8c2cabc00e69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:25.510533 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b2fd9-9d82-482f-a6c6-8c2cabc00e69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:59:25.512140 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b2fd9-9d82-482f-a6c6-8c2cabc00e69 service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:59:25.529711 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 709/1437] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:59:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:59:26.412563 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90f531-2d31-42fb-89f2-7eb38803d0c6 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:26.413050 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90f531-2d31-42fb-89f2-7eb38803d0c6 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:26.413155 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90f531-2d31-42fb-89f2-7eb38803d0c6 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:26.414513 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 729/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 20:59:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:59:26.419642 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94907b-f953-497a-95ae-0e38c9e77b3c None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:26.420102 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94907b-f953-497a-95ae-0e38c9e77b3c None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:26.420217 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94907b-f953-497a-95ae-0e38c9e77b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:26.493719 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-3e94907b-f953-497a-95ae-0e38c9e77b3c None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:59:26.494908 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-3e94907b-f953-497a-95ae-0e38c9e77b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:26.496938 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:26.590864 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 710/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 20:59:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:59:26.742430 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90f531-2d31-42fb-89f2-7eb38803d0c6 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:59:26.743959 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-ef90f531-2d31-42fb-89f2-7eb38803d0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:26.891629 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90f531-2d31-42fb-89f2-7eb38803d0c6 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:59:26.918132 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:27.005909 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacccb67-c780-461f-afac-d03f95fb08b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:59:27.006568 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacccb67-c780-461f-afac-d03f95fb08b4 service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:27.006857 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacccb67-c780-461f-afac-d03f95fb08b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:27.007135 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacccb67-c780-461f-afac-d03f95fb08b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:27.008824 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-bacccb67-c780-461f-afac-d03f95fb08b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:27.096906 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacccb67-c780-461f-afac-d03f95fb08b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:59:27.098479 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacccb67-c780-461f-afac-d03f95fb08b4 service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:59:27.116933 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 730/1440] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:59:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:59:29.030557 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d71a3-e071-4038-8dd7-d1134536ab05 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:29.031135 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d71a3-e071-4038-8dd7-d1134536ab05 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:29.031135 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d71a3-e071-4038-8dd7-d1134536ab05 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:29.032566 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 711/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 20:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:59:29.038399 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cad9cd-79f3-489c-9e58-cfaba76494f0 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:29.038830 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cad9cd-79f3-489c-9e58-cfaba76494f0 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:29.038945 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cad9cd-79f3-489c-9e58-cfaba76494f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:29.077527 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:29.102022 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-b1cad9cd-79f3-489c-9e58-cfaba76494f0 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:59:29.103222 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-b1cad9cd-79f3-489c-9e58-cfaba76494f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:29.198633 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 731/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 20:59:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:59:29.236530 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d71a3-e071-4038-8dd7-d1134536ab05 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:59:29.238043 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-844d71a3-e071-4038-8dd7-d1134536ab05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:29.341885 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d71a3-e071-4038-8dd7-d1134536ab05 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:59:29.374256 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:29.415018 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d9bea-588d-4f39-be6b-7162380f2471 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:59:29.415673 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d9bea-588d-4f39-be6b-7162380f2471 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:29.415959 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d9bea-588d-4f39-be6b-7162380f2471 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:29.416270 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d9bea-588d-4f39-be6b-7162380f2471 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:29.417900 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-6d6d9bea-588d-4f39-be6b-7162380f2471 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:29.525239 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d9bea-588d-4f39-be6b-7162380f2471 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:59:29.526664 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d9bea-588d-4f39-be6b-7162380f2471 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:59:29.544803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 712/1443] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:59:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:59:31.736436 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10a2ff-76a5-4b2b-bfbb-36c5fc9eff61 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:31.737007 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10a2ff-76a5-4b2b-bfbb-36c5fc9eff61 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:31.737007 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10a2ff-76a5-4b2b-bfbb-36c5fc9eff61 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:31.738356 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 732/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 20:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:59:31.744025 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598f666-c316-47cf-aef0-1efdb22cb4d7 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:31.744456 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598f666-c316-47cf-aef0-1efdb22cb4d7 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:31.744583 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598f666-c316-47cf-aef0-1efdb22cb4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:31.809636 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-0598f666-c316-47cf-aef0-1efdb22cb4d7 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:59:31.810852 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-0598f666-c316-47cf-aef0-1efdb22cb4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:31.824437 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:31.908941 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 713/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 20:59:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:59:31.946849 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10a2ff-76a5-4b2b-bfbb-36c5fc9eff61 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:59:31.948434 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-2d10a2ff-76a5-4b2b-bfbb-36c5fc9eff61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:32.049404 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10a2ff-76a5-4b2b-bfbb-36c5fc9eff61 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:59:32.062134 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:32.123109 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf0514-8ba1-4b14-ab19-1387da734d65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:59:32.123757 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf0514-8ba1-4b14-ab19-1387da734d65 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:32.124069 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf0514-8ba1-4b14-ab19-1387da734d65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:32.124351 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf0514-8ba1-4b14-ab19-1387da734d65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:32.125975 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-65cf0514-8ba1-4b14-ab19-1387da734d65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:32.233948 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf0514-8ba1-4b14-ab19-1387da734d65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:59:32.235389 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf0514-8ba1-4b14-ab19-1387da734d65 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:59:32.254157 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 733/1446] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:59:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:59:34.688437 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6542ce-b0c9-4295-8a7e-3a5c580623bc None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:34.688889 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6542ce-b0c9-4295-8a7e-3a5c580623bc None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:34.689014 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6542ce-b0c9-4295-8a7e-3a5c580623bc None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:34.690372 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 714/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 20:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:59:34.695587 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c677a-263f-46ee-a43f-a5c125cf84c0 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:34.696036 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c677a-263f-46ee-a43f-a5c125cf84c0 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:34.696226 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c677a-263f-46ee-a43f-a5c125cf84c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:34.743718 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:34.761832 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-c21c677a-263f-46ee-a43f-a5c125cf84c0 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:59:34.763049 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-c21c677a-263f-46ee-a43f-a5c125cf84c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:34.859878 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 734/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 20:59:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:59:34.899553 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6542ce-b0c9-4295-8a7e-3a5c580623bc None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:59:34.901128 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-0d6542ce-b0c9-4295-8a7e-3a5c580623bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:35.004490 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6542ce-b0c9-4295-8a7e-3a5c580623bc None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:59:35.044858 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:35.080469 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36be8a4-ad13-45af-a5ae-3ced4c1ecd77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:59:35.081117 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36be8a4-ad13-45af-a5ae-3ced4c1ecd77 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:35.081400 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36be8a4-ad13-45af-a5ae-3ced4c1ecd77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:35.081676 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36be8a4-ad13-45af-a5ae-3ced4c1ecd77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:35.083441 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b36be8a4-ad13-45af-a5ae-3ced4c1ecd77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:35.190100 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36be8a4-ad13-45af-a5ae-3ced4c1ecd77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:59:35.191531 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36be8a4-ad13-45af-a5ae-3ced4c1ecd77 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:59:35.210011 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 715/1449] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:59:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:59:37.349012 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369c525-6a23-48c2-994e-f857d3f62274 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:37.349593 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369c525-6a23-48c2-994e-f857d3f62274 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:37.349593 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369c525-6a23-48c2-994e-f857d3f62274 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:37.350952 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 735/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 20:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:59:37.356164 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef26e6-98fa-4a4b-97d1-68b33c29549e None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:37.356567 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef26e6-98fa-4a4b-97d1-68b33c29549e None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:37.356725 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef26e6-98fa-4a4b-97d1-68b33c29549e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:37.420377 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-abef26e6-98fa-4a4b-97d1-68b33c29549e None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:59:37.421572 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-abef26e6-98fa-4a4b-97d1-68b33c29549e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:37.443082 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:37.519752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 716/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 20:59:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:59:37.558146 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369c525-6a23-48c2-994e-f857d3f62274 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:59:37.559666 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-7369c525-6a23-48c2-994e-f857d3f62274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:37.661864 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369c525-6a23-48c2-994e-f857d3f62274 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:59:37.683002 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:37.736422 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8723e00-2be3-4dbf-bfcb-a7367eb26f4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:59:37.737077 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8723e00-2be3-4dbf-bfcb-a7367eb26f4d service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:37.737357 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8723e00-2be3-4dbf-bfcb-a7367eb26f4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:37.737641 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8723e00-2be3-4dbf-bfcb-a7367eb26f4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:37.739856 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-b8723e00-2be3-4dbf-bfcb-a7367eb26f4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:37.847946 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8723e00-2be3-4dbf-bfcb-a7367eb26f4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:59:37.850107 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8723e00-2be3-4dbf-bfcb-a7367eb26f4d service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:59:37.868144 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 736/1452] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:59:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:59:39.965735 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd885411-4602-443b-8a03-52bceb7a133d None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:39.966251 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd885411-4602-443b-8a03-52bceb7a133d None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:39.966368 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd885411-4602-443b-8a03-52bceb7a133d None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:39.967682 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 717/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 20:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:59:39.973010 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f57b72-a39c-4dd6-af59-d13b00b2ce74 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:39.973453 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f57b72-a39c-4dd6-af59-d13b00b2ce74 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:39.974084 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f57b72-a39c-4dd6-af59-d13b00b2ce74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:40.037647 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:40.040764 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-64f57b72-a39c-4dd6-af59-d13b00b2ce74 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:59:40.041988 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-64f57b72-a39c-4dd6-af59-d13b00b2ce74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:40.139990 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 737/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 20:59:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:59:40.178706 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd885411-4602-443b-8a03-52bceb7a133d None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:59:40.180308 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-dd885411-4602-443b-8a03-52bceb7a133d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:40.283880 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd885411-4602-443b-8a03-52bceb7a133d None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:59:40.333943 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:40.359042 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55952f5-994b-4e29-9835-932d0e3ec394 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:59:40.359700 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55952f5-994b-4e29-9835-932d0e3ec394 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:40.360012 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55952f5-994b-4e29-9835-932d0e3ec394 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:40.360304 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55952f5-994b-4e29-9835-932d0e3ec394 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:40.361992 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d55952f5-994b-4e29-9835-932d0e3ec394 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:40.474973 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55952f5-994b-4e29-9835-932d0e3ec394 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:59:40.480293 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55952f5-994b-4e29-9835-932d0e3ec394 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:59:40.495251 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 718/1455] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:59:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:59:42.585302 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78cb2f2-6921-4b2e-ba67-cdb4c41fbf0f None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:42.585861 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78cb2f2-6921-4b2e-ba67-cdb4c41fbf0f None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:42.585861 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78cb2f2-6921-4b2e-ba67-cdb4c41fbf0f None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:42.587236 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 738/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 20:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:59:42.592557 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafaa036-3947-46e7-aee2-e5119ea3f6d1 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:42.592985 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafaa036-3947-46e7-aee2-e5119ea3f6d1 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:42.593119 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafaa036-3947-46e7-aee2-e5119ea3f6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:42.663322 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-eafaa036-3947-46e7-aee2-e5119ea3f6d1 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:59:42.663634 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-eafaa036-3947-46e7-aee2-e5119ea3f6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:42.694915 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:42.761481 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 719/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 20:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:59:42.799524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78cb2f2-6921-4b2e-ba67-cdb4c41fbf0f None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:59:42.801157 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-e78cb2f2-6921-4b2e-ba67-cdb4c41fbf0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:42.909461 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78cb2f2-6921-4b2e-ba67-cdb4c41fbf0f None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:59:42.937503 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:42.982774 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e4d0e-faf8-4b94-b077-5bde33f8d21d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:59:42.983426 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e4d0e-faf8-4b94-b077-5bde33f8d21d service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:42.983714 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e4d0e-faf8-4b94-b077-5bde33f8d21d service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:42.984022 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e4d0e-faf8-4b94-b077-5bde33f8d21d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:42.985651 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-b70e4d0e-faf8-4b94-b077-5bde33f8d21d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:43.093254 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70e4d0e-faf8-4b94-b077-5bde33f8d21d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:59:43.094765 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70e4d0e-faf8-4b94-b077-5bde33f8d21d service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:59:43.113012 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 739/1458] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:59:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:59:45.209204 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdffa2-266d-4ee1-9446-c14cc1c597b8 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:45.209766 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdffa2-266d-4ee1-9446-c14cc1c597b8 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:45.209766 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdffa2-266d-4ee1-9446-c14cc1c597b8 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:45.211152 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 720/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 20:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:59:45.216413 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeef9ba-af65-46a7-8074-b6198895b0c3 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:45.216829 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeef9ba-af65-46a7-8074-b6198895b0c3 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:45.216986 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeef9ba-af65-46a7-8074-b6198895b0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:45.281763 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-6eeef9ba-af65-46a7-8074-b6198895b0c3 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:59:45.282961 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-6eeef9ba-af65-46a7-8074-b6198895b0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:45.291755 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:45.381630 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 740/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 20:59:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:59:45.418283 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdffa2-266d-4ee1-9446-c14cc1c597b8 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:59:45.419898 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-31fdffa2-266d-4ee1-9446-c14cc1c597b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:45.523337 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdffa2-266d-4ee1-9446-c14cc1c597b8 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:59:45.577383 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:45.594750 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aac066-1246-40ef-bcb3-b7de729d0153 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:59:45.595397 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aac066-1246-40ef-bcb3-b7de729d0153 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:45.595681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aac066-1246-40ef-bcb3-b7de729d0153 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:45.595956 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aac066-1246-40ef-bcb3-b7de729d0153 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:45.597600 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-52aac066-1246-40ef-bcb3-b7de729d0153 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:45.711313 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aac066-1246-40ef-bcb3-b7de729d0153 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:59:45.712769 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aac066-1246-40ef-bcb3-b7de729d0153 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:59:45.732703 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 721/1461] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:59:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:59:47.804148 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448d064-d129-49f5-a2e3-b7e914f2d757 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:47.804684 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448d064-d129-49f5-a2e3-b7e914f2d757 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:47.804814 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448d064-d129-49f5-a2e3-b7e914f2d757 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:47.806204 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 741/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 20:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:59:47.811483 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceef6fe-f2c1-4af9-9a29-b531b024fee2 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:47.812674 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceef6fe-f2c1-4af9-9a29-b531b024fee2 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:47.812674 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceef6fe-f2c1-4af9-9a29-b531b024fee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:47.876188 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-0ceef6fe-f2c1-4af9-9a29-b531b024fee2 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:59:47.877412 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-0ceef6fe-f2c1-4af9-9a29-b531b024fee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:47.915484 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:47.973220 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 722/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 20:59:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:59:48.011306 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448d064-d129-49f5-a2e3-b7e914f2d757 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:59:48.012890 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a448d064-d129-49f5-a2e3-b7e914f2d757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:48.113914 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448d064-d129-49f5-a2e3-b7e914f2d757 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:59:48.151335 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:48.187046 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55afd1d-cb29-4809-8850-a69ff2ebc022 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:59:48.187633 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55afd1d-cb29-4809-8850-a69ff2ebc022 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:48.187944 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55afd1d-cb29-4809-8850-a69ff2ebc022 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:48.188239 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55afd1d-cb29-4809-8850-a69ff2ebc022 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:48.189874 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-c55afd1d-cb29-4809-8850-a69ff2ebc022 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:48.295443 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55afd1d-cb29-4809-8850-a69ff2ebc022 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:59:48.296913 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55afd1d-cb29-4809-8850-a69ff2ebc022 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:59:48.314974 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 742/1464] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:59:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 20:59:50.338404 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facda3f7-9259-4927-a096-00721ec16bda None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:50.339028 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facda3f7-9259-4927-a096-00721ec16bda None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:50.339028 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facda3f7-9259-4927-a096-00721ec16bda None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:50.340407 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 723/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 20:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:59:50.345586 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f17c5-7537-4da1-9562-8905614c4fd2 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:50.346025 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f17c5-7537-4da1-9562-8905614c4fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:50.346134 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f17c5-7537-4da1-9562-8905614c4fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:50.412034 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-f85f17c5-7537-4da1-9562-8905614c4fd2 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:59:50.413243 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-f85f17c5-7537-4da1-9562-8905614c4fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:50.430745 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:50.509806 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 743/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 20:59:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:59:50.546310 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facda3f7-9259-4927-a096-00721ec16bda None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:59:50.547873 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-facda3f7-9259-4927-a096-00721ec16bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:50.651103 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facda3f7-9259-4927-a096-00721ec16bda None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:59:50.716933 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:50.723650 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52271593-d657-4f54-ba7f-2debac3bd554 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:59:50.724337 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52271593-d657-4f54-ba7f-2debac3bd554 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:50.724623 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52271593-d657-4f54-ba7f-2debac3bd554 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:50.725239 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52271593-d657-4f54-ba7f-2debac3bd554 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:50.726516 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-52271593-d657-4f54-ba7f-2debac3bd554 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:50.835782 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52271593-d657-4f54-ba7f-2debac3bd554 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:59:50.837343 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52271593-d657-4f54-ba7f-2debac3bd554 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:59:50.855461 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 724/1467] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:59:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 20:59:52.868962 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663c59c-0284-40d8-8a25-60f98b73af1c None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:52.869521 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663c59c-0284-40d8-8a25-60f98b73af1c None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:52.869521 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663c59c-0284-40d8-8a25-60f98b73af1c None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:52.870937 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 744/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 20:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 20:59:52.876263 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fa495-1279-414b-bc13-bf323412f30f None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:52.876643 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fa495-1279-414b-bc13-bf323412f30f None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:52.876828 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fa495-1279-414b-bc13-bf323412f30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:52.942799 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-595fa495-1279-414b-bc13-bf323412f30f None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 20:59:52.943803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-595fa495-1279-414b-bc13-bf323412f30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:52.991471 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:53.039759 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 725/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 20:59:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 20:59:53.076393 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663c59c-0284-40d8-8a25-60f98b73af1c None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 20:59:53.077907 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-6663c59c-0284-40d8-8a25-60f98b73af1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:53.182939 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663c59c-0284-40d8-8a25-60f98b73af1c None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 20:59:53.229641 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 20:59:53.255279 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd9350-1332-40fc-9a70-26ed4bf62468 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 20:59:53.255929 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd9350-1332-40fc-9a70-26ed4bf62468 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 20:59:53.256243 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd9350-1332-40fc-9a70-26ed4bf62468 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 20:59:53.256519 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd9350-1332-40fc-9a70-26ed4bf62468 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 20:59:53.258153 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-97bd9350-1332-40fc-9a70-26ed4bf62468 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 20:59:53.364778 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd9350-1332-40fc-9a70-26ed4bf62468 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 20:59:53.366213 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd9350-1332-40fc-9a70-26ed4bf62468 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 20:59:53.384563 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 745/1470] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 20:59:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:00:03.037907 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=22 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:00:03.382388 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=66 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:00:13.361927 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1db283-8b6c-47d8-9f94-6e21e07bc373 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:00:13.362509 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1db283-8b6c-47d8-9f94-6e21e07bc373 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:00:13.362509 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1db283-8b6c-47d8-9f94-6e21e07bc373 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:00:13.364446 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 726/1471] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 21:00:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 21:00:13.369651 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44da814-c344-4fd2-934f-6810962af011 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:00:13.370098 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44da814-c344-4fd2-934f-6810962af011 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:00:13.370205 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44da814-c344-4fd2-934f-6810962af011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:00:13.434221 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-d44da814-c344-4fd2-934f-6810962af011 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:00:13.435458 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-d44da814-c344-4fd2-934f-6810962af011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:00:13.531715 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 746/1472] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 21:00:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:00:13.615108 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed71f1a-dd02-4955-85f0-56fccacd9015 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:00:13.615339 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed71f1a-dd02-4955-85f0-56fccacd9015 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:00:13.615619 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed71f1a-dd02-4955-85f0-56fccacd9015 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:00:13.617032 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 727/1473] 10.222.0.40 () {54 vars in 962 bytes} [Mon Jul 11 21:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 21:00:13.621771 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6547534-f569-46c6-94db-d967f0a17d5f None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:00:13.622069 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6547534-f569-46c6-94db-d967f0a17d5f None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:00:13.622352 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6547534-f569-46c6-94db-d967f0a17d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:00:13.701395 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-c6547534-f569-46c6-94db-d967f0a17d5f None None] MFA Rules not processed for user `da488c75631e4e5992304ff6c0579aab`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:00:13.702613 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-c6547534-f569-46c6-94db-d967f0a17d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:00:13.725378 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:00:13.781073 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 747/1474] 10.222.0.40 () {58 vars in 1059 bytes} [Mon Jul 11 21:00:13 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:00:13.789265 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed71f1a-dd02-4955-85f0-56fccacd9015 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:00:13.790752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-fed71f1a-dd02-4955-85f0-56fccacd9015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:00:13.893376 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed71f1a-dd02-4955-85f0-56fccacd9015 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:00:13.964135 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c771344-2727-41f9-8532-50fe05492c7d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da488c75631e4e5992304ff6c0579aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:00:13.964785 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c771344-2727-41f9-8532-50fe05492c7d service glance] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:00:13.965068 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c771344-2727-41f9-8532-50fe05492c7d service glance] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:00:13.965340 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c771344-2727-41f9-8532-50fe05492c7d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:00:13.966949 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-7c771344-2727-41f9-8532-50fe05492c7d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:00:14.020356 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:00:14.076581 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c771344-2727-41f9-8532-50fe05492c7d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:00:14.078022 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c771344-2727-41f9-8532-50fe05492c7d service glance] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:00:14.096474 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 728/1475] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:00:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:00:16.191127 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d003f7-46c3-4b0f-a8d1-d8167d9d501f None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:00:16.191707 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d003f7-46c3-4b0f-a8d1-d8167d9d501f None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:00:16.191707 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d003f7-46c3-4b0f-a8d1-d8167d9d501f None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:00:16.193124 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 748/1476] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 21:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 21:00:16.198309 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18724875-288f-4a45-ae17-86ecdbc09dd1 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:00:16.198777 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18724875-288f-4a45-ae17-86ecdbc09dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:00:16.198895 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18724875-288f-4a45-ae17-86ecdbc09dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:00:16.262530 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-18724875-288f-4a45-ae17-86ecdbc09dd1 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:00:16.263722 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-18724875-288f-4a45-ae17-86ecdbc09dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:00:16.362109 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 729/1477] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 21:00:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:00:16.384730 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d003f7-46c3-4b0f-a8d1-d8167d9d501f None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:00:16.386489 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-40d003f7-46c3-4b0f-a8d1-d8167d9d501f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:00:16.509760 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d003f7-46c3-4b0f-a8d1-d8167d9d501f None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:00:16.558305 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:00:16.603601 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5a4a6-b378-407b-a3c3-573eb0e7d367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:00:16.604293 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5a4a6-b378-407b-a3c3-573eb0e7d367 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:00:16.604579 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5a4a6-b378-407b-a3c3-573eb0e7d367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:00:16.604856 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5a4a6-b378-407b-a3c3-573eb0e7d367 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:00:16.605584 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c5a4a6-b378-407b-a3c3-573eb0e7d367 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:00:16.607311 dv-cinder-849022-2-smb devstack@keystone.service[80375]: WARNING py.warnings [None req-29c5a4a6-b378-407b-a3c3-573eb0e7d367 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 21:00:16.607311 dv-cinder-849022-2-smb devstack@keystone.service[80375]: warnings.warn(msg) Jul 11 21:00:16.607311 dv-cinder-849022-2-smb devstack@keystone.service[80375]: Jul 11 21:00:16.608464 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c5a4a6-b378-407b-a3c3-573eb0e7d367 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:00:16.626912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 749/1478] 10.222.0.40 () {56 vars in 1108 bytes} [Mon Jul 11 21:00:16 2022] GET /identity/v3/projects => generated 2553 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:00:18.653942 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91d641-e880-40d0-826c-f5b7fa516edf None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:00:18.654492 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91d641-e880-40d0-826c-f5b7fa516edf None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:00:18.654492 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91d641-e880-40d0-826c-f5b7fa516edf None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:00:18.655854 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 730/1479] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 21:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 21:00:18.662305 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff8eee-9660-4ed3-9468-2cace72ce9f0 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:00:18.662759 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff8eee-9660-4ed3-9468-2cace72ce9f0 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:00:18.662869 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff8eee-9660-4ed3-9468-2cace72ce9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:00:18.728703 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-26ff8eee-9660-4ed3-9468-2cace72ce9f0 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:00:18.729898 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-26ff8eee-9660-4ed3-9468-2cace72ce9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:00:18.824783 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 750/1480] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 21:00:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:00:18.868102 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91d641-e880-40d0-826c-f5b7fa516edf None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:00:18.869614 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-2a91d641-e880-40d0-826c-f5b7fa516edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:00:18.879387 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:00:19.015241 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91d641-e880-40d0-826c-f5b7fa516edf None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:00:19.094109 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:00:19.127394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba2097-88b8-40a7-8e0e-1178cb9d6908 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:00:19.128088 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba2097-88b8-40a7-8e0e-1178cb9d6908 service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:00:19.128381 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba2097-88b8-40a7-8e0e-1178cb9d6908 service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:00:19.128672 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba2097-88b8-40a7-8e0e-1178cb9d6908 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:00:19.130531 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-11ba2097-88b8-40a7-8e0e-1178cb9d6908 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:00:19.219167 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba2097-88b8-40a7-8e0e-1178cb9d6908 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:00:19.220796 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba2097-88b8-40a7-8e0e-1178cb9d6908 service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:00:19.239629 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 731/1481] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:00:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:00:21.482818 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22fc67-2f74-4cd4-ac18-bd54b25922e0 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:00:21.483363 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22fc67-2f74-4cd4-ac18-bd54b25922e0 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:00:21.483363 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22fc67-2f74-4cd4-ac18-bd54b25922e0 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:00:21.484713 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 751/1482] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 21:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 21:00:21.490494 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c9a2a-3425-4848-b21a-064e774e91f2 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:00:21.490908 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c9a2a-3425-4848-b21a-064e774e91f2 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:00:21.491069 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c9a2a-3425-4848-b21a-064e774e91f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:00:21.556380 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-dc6c9a2a-3425-4848-b21a-064e774e91f2 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:00:21.557587 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-dc6c9a2a-3425-4848-b21a-064e774e91f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:00:21.603521 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:00:21.655764 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 732/1483] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 21:00:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:00:21.692494 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22fc67-2f74-4cd4-ac18-bd54b25922e0 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:00:21.694042 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-1c22fc67-2f74-4cd4-ac18-bd54b25922e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:00:21.716880 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:00:21.798310 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22fc67-2f74-4cd4-ac18-bd54b25922e0 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:00:21.870500 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92430cc4-c9bd-40fd-8fbc-3cfc52f76851 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:00:21.871141 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92430cc4-c9bd-40fd-8fbc-3cfc52f76851 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:00:21.871425 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92430cc4-c9bd-40fd-8fbc-3cfc52f76851 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:00:21.871702 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92430cc4-c9bd-40fd-8fbc-3cfc52f76851 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:00:21.873366 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-92430cc4-c9bd-40fd-8fbc-3cfc52f76851 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:00:21.946763 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:00:21.981816 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92430cc4-c9bd-40fd-8fbc-3cfc52f76851 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:00:21.983249 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92430cc4-c9bd-40fd-8fbc-3cfc52f76851 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:00:22.002060 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 752/1484] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:00:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:00:24.075129 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a496eb-6426-4f55-85c3-f666bcc54461 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:00:24.075699 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a496eb-6426-4f55-85c3-f666bcc54461 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:00:24.075699 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a496eb-6426-4f55-85c3-f666bcc54461 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:00:24.077090 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 733/1485] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 21:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 21:00:24.082880 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b19be93-d81e-4f10-a0b0-3e21d8394830 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:00:24.083340 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b19be93-d81e-4f10-a0b0-3e21d8394830 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:00:24.083439 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b19be93-d81e-4f10-a0b0-3e21d8394830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:00:24.147540 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-6b19be93-d81e-4f10-a0b0-3e21d8394830 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:00:24.148783 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-6b19be93-d81e-4f10-a0b0-3e21d8394830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:00:24.245107 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 753/1486] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 21:00:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:00:24.282523 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a496eb-6426-4f55-85c3-f666bcc54461 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:00:24.284096 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-56a496eb-6426-4f55-85c3-f666bcc54461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:00:24.385161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a496eb-6426-4f55-85c3-f666bcc54461 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:00:24.455610 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:00:24.457801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcedece-5dcf-4695-81af-69d2b15c7d19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:00:24.458459 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcedece-5dcf-4695-81af-69d2b15c7d19 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:00:24.458745 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcedece-5dcf-4695-81af-69d2b15c7d19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:00:24.459027 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcedece-5dcf-4695-81af-69d2b15c7d19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:00:24.460693 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-5bcedece-5dcf-4695-81af-69d2b15c7d19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:00:24.567707 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcedece-5dcf-4695-81af-69d2b15c7d19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:00:24.569189 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcedece-5dcf-4695-81af-69d2b15c7d19 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:00:24.587323 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 734/1487] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:00:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:00:26.743131 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db499a-3110-4dfe-9535-2e5dede53f29 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:00:26.743692 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db499a-3110-4dfe-9535-2e5dede53f29 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:00:26.743819 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db499a-3110-4dfe-9535-2e5dede53f29 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:00:26.745262 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 754/1488] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 21:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 21:00:26.750351 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb40fd-f625-47cf-809d-8bda19f6a6d7 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:00:26.750788 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb40fd-f625-47cf-809d-8bda19f6a6d7 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:00:26.750922 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb40fd-f625-47cf-809d-8bda19f6a6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:00:26.815958 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-64eb40fd-f625-47cf-809d-8bda19f6a6d7 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:00:26.817303 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-64eb40fd-f625-47cf-809d-8bda19f6a6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:00:26.870834 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:00:26.916087 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 735/1489] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 21:00:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:00:26.956731 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db499a-3110-4dfe-9535-2e5dede53f29 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:00:26.958884 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-37db499a-3110-4dfe-9535-2e5dede53f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:00:26.994885 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:00:27.064921 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db499a-3110-4dfe-9535-2e5dede53f29 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:00:27.137280 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d07124-0f3e-41bc-8551-5b37cf235656 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:00:27.137935 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d07124-0f3e-41bc-8551-5b37cf235656 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:00:27.138225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d07124-0f3e-41bc-8551-5b37cf235656 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:00:27.138506 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d07124-0f3e-41bc-8551-5b37cf235656 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:00:27.140201 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a6d07124-0f3e-41bc-8551-5b37cf235656 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:00:27.218786 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:00:27.248278 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d07124-0f3e-41bc-8551-5b37cf235656 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:00:27.249870 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d07124-0f3e-41bc-8551-5b37cf235656 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:00:27.268808 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 755/1490] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:00:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:00:29.713323 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14935bc7-c7c3-417d-9f6c-28e2f80fc52f None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:00:29.713985 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14935bc7-c7c3-417d-9f6c-28e2f80fc52f None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:00:29.713985 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14935bc7-c7c3-417d-9f6c-28e2f80fc52f None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:00:29.715342 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 736/1491] 10.222.0.40 () {54 vars in 926 bytes} [Mon Jul 11 21:00:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 21:00:29.720663 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd6667-ead5-444d-abe0-c92f1fcbacd1 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:00:29.721093 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd6667-ead5-444d-abe0-c92f1fcbacd1 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:00:29.721230 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd6667-ead5-444d-abe0-c92f1fcbacd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:00:29.785377 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-23cd6667-ead5-444d-abe0-c92f1fcbacd1 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:00:29.786614 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-23cd6667-ead5-444d-abe0-c92f1fcbacd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:00:29.884804 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 756/1492] 10.222.0.40 () {58 vars in 1023 bytes} [Mon Jul 11 21:00:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:00:29.923271 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14935bc7-c7c3-417d-9f6c-28e2f80fc52f None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:00:29.924865 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-14935bc7-c7c3-417d-9f6c-28e2f80fc52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:00:30.029500 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14935bc7-c7c3-417d-9f6c-28e2f80fc52f None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:00:30.101784 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e9469-611b-4f6c-85a5-a911740bbc60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:00:30.102433 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e9469-611b-4f6c-85a5-a911740bbc60 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:00:30.102719 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e9469-611b-4f6c-85a5-a911740bbc60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:00:30.102997 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e9469-611b-4f6c-85a5-a911740bbc60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:00:30.104670 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-646e9469-611b-4f6c-85a5-a911740bbc60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:00:30.114408 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:00:30.213854 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e9469-611b-4f6c-85a5-a911740bbc60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:00:30.215284 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e9469-611b-4f6c-85a5-a911740bbc60 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:00:30.234057 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 737/1493] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:00:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:00:39.882816 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=82 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:00:40.231687 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=50 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:02:24.845445 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c63031-6228-41b8-a17c-109bedaf0c1e None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:02:24.846035 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c63031-6228-41b8-a17c-109bedaf0c1e None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:02:24.846035 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c63031-6228-41b8-a17c-109bedaf0c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:02:24.924534 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-51c63031-6228-41b8-a17c-109bedaf0c1e None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:02:24.927323 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-51c63031-6228-41b8-a17c-109bedaf0c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:02:25.029379 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 757/1494] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:02:25.037474 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33767407-6624-4e1f-a969-a76dd32a5f6f None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:02:25.038504 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33767407-6624-4e1f-a969-a76dd32a5f6f None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:02:25.038610 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33767407-6624-4e1f-a969-a76dd32a5f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:02:25.057059 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-33767407-6624-4e1f-a969-a76dd32a5f6f None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:02:25.058249 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-33767407-6624-4e1f-a969-a76dd32a5f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:02:25.066531 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 738/1495] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:02:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:02:25.071111 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c63031-6228-41b8-a17c-109bedaf0c1e None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:02:25.080627 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c63031-6228-41b8-a17c-109bedaf0c1e None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:02:25.085347 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af896e1d-9c42-4ab7-ae1a-9840a37a429a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:02:25.086003 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af896e1d-9c42-4ab7-ae1a-9840a37a429a admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:02:25.086293 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af896e1d-9c42-4ab7-ae1a-9840a37a429a admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:02:25.086574 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af896e1d-9c42-4ab7-ae1a-9840a37a429a admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:02:25.087304 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af896e1d-9c42-4ab7-ae1a-9840a37a429a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:02:25.087618 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af896e1d-9c42-4ab7-ae1a-9840a37a429a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:02:25.088677 dv-cinder-849022-2-smb devstack@keystone.service[80375]: WARNING py.warnings [None req-af896e1d-9c42-4ab7-ae1a-9840a37a429a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 21:02:25.088677 dv-cinder-849022-2-smb devstack@keystone.service[80375]: warnings.warn(msg) Jul 11 21:02:25.088677 dv-cinder-849022-2-smb devstack@keystone.service[80375]: Jul 11 21:02:25.089575 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af896e1d-9c42-4ab7-ae1a-9840a37a429a admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:02:25.101581 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 758/1496] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:02:25.109476 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33767407-6624-4e1f-a969-a76dd32a5f6f None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:02:25.119247 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33767407-6624-4e1f-a969-a76dd32a5f6f None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:02:25.123750 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fced10-1af8-4478-8b81-265ca37eac19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:02:25.124438 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fced10-1af8-4478-8b81-265ca37eac19 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:02:25.124725 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fced10-1af8-4478-8b81-265ca37eac19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:02:25.125003 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fced10-1af8-4478-8b81-265ca37eac19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:02:25.125684 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fced10-1af8-4478-8b81-265ca37eac19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:02:25.127457 dv-cinder-849022-2-smb devstack@keystone.service[80374]: WARNING py.warnings [None req-34fced10-1af8-4478-8b81-265ca37eac19 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 21:02:25.127457 dv-cinder-849022-2-smb devstack@keystone.service[80374]: warnings.warn(msg) Jul 11 21:02:25.127457 dv-cinder-849022-2-smb devstack@keystone.service[80374]: Jul 11 21:02:25.128698 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fced10-1af8-4478-8b81-265ca37eac19 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:02:25.313319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 739/1497] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:02:25 2022] POST /identity/v3/projects => generated 379 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:02:25.317389 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af896e1d-9c42-4ab7-ae1a-9840a37a429a admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:02:25.327226 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af896e1d-9c42-4ab7-ae1a-9840a37a429a admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:02:25.375490 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:02:25.382084 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39450f-79ce-4870-af75-4616583a37cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:02:25.382764 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39450f-79ce-4870-af75-4616583a37cd admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:02:25.383055 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39450f-79ce-4870-af75-4616583a37cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:02:25.383339 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39450f-79ce-4870-af75-4616583a37cd admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:02:25.384085 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39450f-79ce-4870-af75-4616583a37cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:02:25.390037 dv-cinder-849022-2-smb devstack@keystone.service[80375]: WARNING py.warnings [None req-1a39450f-79ce-4870-af75-4616583a37cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 21:02:25.390037 dv-cinder-849022-2-smb devstack@keystone.service[80375]: warnings.warn(msg) Jul 11 21:02:25.390037 dv-cinder-849022-2-smb devstack@keystone.service[80375]: Jul 11 21:02:25.390037 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39450f-79ce-4870-af75-4616583a37cd admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:02:25.458780 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 759/1498] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:02:25 2022] POST /identity/v3/users => generated 290 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:02:25.463812 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fced10-1af8-4478-8b81-265ca37eac19 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:02:25.474119 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fced10-1af8-4478-8b81-265ca37eac19 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:02:25.479485 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6c7e3-6438-41c4-8354-5dc2330d3c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:02:25.480192 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6c7e3-6438-41c4-8354-5dc2330d3c6a admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:02:25.480481 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6c7e3-6438-41c4-8354-5dc2330d3c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:02:25.480786 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6c7e3-6438-41c4-8354-5dc2330d3c6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:02:25.481513 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f6c7e3-6438-41c4-8354-5dc2330d3c6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:02:25.482528 dv-cinder-849022-2-smb devstack@keystone.service[80374]: WARNING py.warnings [None req-d7f6c7e3-6438-41c4-8354-5dc2330d3c6a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 21:02:25.482528 dv-cinder-849022-2-smb devstack@keystone.service[80374]: warnings.warn(msg) Jul 11 21:02:25.482528 dv-cinder-849022-2-smb devstack@keystone.service[80374]: Jul 11 21:02:25.483406 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f6c7e3-6438-41c4-8354-5dc2330d3c6a admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:02:25.496182 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 740/1499] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:02:25.500021 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39450f-79ce-4870-af75-4616583a37cd admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:02:25.510080 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39450f-79ce-4870-af75-4616583a37cd admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:02:25.514809 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c8c26-6eb7-4df4-9423-d0a8ade0b7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:02:25.515462 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c8c26-6eb7-4df4-9423-d0a8ade0b7e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:02:25.515749 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c8c26-6eb7-4df4-9423-d0a8ade0b7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:02:25.516061 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c8c26-6eb7-4df4-9423-d0a8ade0b7e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:02:25.516783 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c8c26-6eb7-4df4-9423-d0a8ade0b7e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:02:25.517794 dv-cinder-849022-2-smb devstack@keystone.service[80375]: WARNING py.warnings [None req-559c8c26-6eb7-4df4-9423-d0a8ade0b7e7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 21:02:25.517794 dv-cinder-849022-2-smb devstack@keystone.service[80375]: warnings.warn(msg) Jul 11 21:02:25.517794 dv-cinder-849022-2-smb devstack@keystone.service[80375]: Jul 11 21:02:25.518667 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c8c26-6eb7-4df4-9423-d0a8ade0b7e7 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:02:25.532331 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 760/1500] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:02:25.536175 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6c7e3-6438-41c4-8354-5dc2330d3c6a admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:02:25.546423 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6c7e3-6438-41c4-8354-5dc2330d3c6a admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:02:25.550913 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90676c87-03b6-4020-9097-e51bd1266c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:02:25.551787 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90676c87-03b6-4020-9097-e51bd1266c97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:02:25.552107 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90676c87-03b6-4020-9097-e51bd1266c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:02:25.552383 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90676c87-03b6-4020-9097-e51bd1266c97 admin admin] PATH_INFO: `/v3/projects/b11f822785984157bb258d88077300f1/users/4c782394ad424b5ebb8b5131bb91af05/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:02:25.566933 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90676c87-03b6-4020-9097-e51bd1266c97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b11f822785984157bb258d88077300f1, user_id=4c782394ad424b5ebb8b5131bb91af05, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:02:25.568125 dv-cinder-849022-2-smb devstack@keystone.service[80374]: WARNING py.warnings [None req-90676c87-03b6-4020-9097-e51bd1266c97 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 21:02:25.568125 dv-cinder-849022-2-smb devstack@keystone.service[80374]: warnings.warn(msg) Jul 11 21:02:25.568125 dv-cinder-849022-2-smb devstack@keystone.service[80374]: Jul 11 21:02:25.570185 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90676c87-03b6-4020-9097-e51bd1266c97 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:02:25.630591 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 741/1501] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:02:25 2022] PUT /identity/v3/projects/b11f822785984157bb258d88077300f1/users/4c782394ad424b5ebb8b5131bb91af05/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:02:25.643332 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367666c-ffab-422e-a3ba-62654d34dc51 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:02:25.643656 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367666c-ffab-422e-a3ba-62654d34dc51 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:02:25.643940 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367666c-ffab-422e-a3ba-62654d34dc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:02:25.671473 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-5367666c-ffab-422e-a3ba-62654d34dc51 None None] MFA Rules not processed for user `4c782394ad424b5ebb8b5131bb91af05`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:02:25.672736 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-5367666c-ffab-422e-a3ba-62654d34dc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:02:25.735194 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 761/1502] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:02:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:02:25.748337 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16facd96-c98b-4f79-851b-cd279802c776 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:02:25.748632 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16facd96-c98b-4f79-851b-cd279802c776 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:02:25.748911 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16facd96-c98b-4f79-851b-cd279802c776 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:02:25.750260 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 742/1503] 10.222.0.40 () {54 vars in 963 bytes} [Mon Jul 11 21:02:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 21:02:25.754927 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2c982-a012-4309-94ca-0697848b95fb None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:02:25.755222 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2c982-a012-4309-94ca-0697848b95fb None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:02:25.755505 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2c982-a012-4309-94ca-0697848b95fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:02:25.813703 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-69f2c982-a012-4309-94ca-0697848b95fb None None] MFA Rules not processed for user `e4ae1169746141bc8993707b12cacd80`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:02:25.814920 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-69f2c982-a012-4309-94ca-0697848b95fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:02:25.891177 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 762/1504] 10.222.0.40 () {58 vars in 1060 bytes} [Mon Jul 11 21:02:25 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:02:25.899433 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16facd96-c98b-4f79-851b-cd279802c776 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:02:25.909838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16facd96-c98b-4f79-851b-cd279802c776 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:02:25.913329 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060fced-a1af-4e5f-8871-e74eab252c22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:02:25.913962 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060fced-a1af-4e5f-8871-e74eab252c22 service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:02:25.914250 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060fced-a1af-4e5f-8871-e74eab252c22 service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:02:25.914534 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060fced-a1af-4e5f-8871-e74eab252c22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:02:25.922680 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060fced-a1af-4e5f-8871-e74eab252c22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:02:25.924116 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060fced-a1af-4e5f-8871-e74eab252c22 service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:02:25.932763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 743/1505] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:02:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:02:25.980317 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252b052-8aea-44b3-ab26-8d7a52346c7a None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:02:25.980613 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252b052-8aea-44b3-ab26-8d7a52346c7a None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:02:25.980894 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252b052-8aea-44b3-ab26-8d7a52346c7a None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:02:25.982186 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 763/1506] 10.222.0.40 () {52 vars in 829 bytes} [Mon Jul 11 21:02:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 21:02:25.985936 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060fced-a1af-4e5f-8871-e74eab252c22 service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:02:26.048082 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060fced-a1af-4e5f-8871-e74eab252c22 service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:02:26.052644 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b51f3d-cc3b-4b6f-8536-e8a2b34dfc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:02:26.053556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b51f3d-cc3b-4b6f-8536-e8a2b34dfc5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:02:26.053849 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b51f3d-cc3b-4b6f-8536-e8a2b34dfc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:02:26.054130 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b51f3d-cc3b-4b6f-8536-e8a2b34dfc5b admin admin] PATH_INFO: `/v3/users/4c782394ad424b5ebb8b5131bb91af05` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:02:26.055349 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b51f3d-cc3b-4b6f-8536-e8a2b34dfc5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c782394ad424b5ebb8b5131bb91af05)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:02:26.056392 dv-cinder-849022-2-smb devstack@keystone.service[80374]: WARNING py.warnings [None req-69b51f3d-cc3b-4b6f-8536-e8a2b34dfc5b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 21:02:26.056392 dv-cinder-849022-2-smb devstack@keystone.service[80374]: warnings.warn(msg) Jul 11 21:02:26.056392 dv-cinder-849022-2-smb devstack@keystone.service[80374]: Jul 11 21:02:26.060527 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b51f3d-cc3b-4b6f-8536-e8a2b34dfc5b admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:02:26.220641 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-69b51f3d-cc3b-4b6f-8536-e8a2b34dfc5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c782394ad424b5ebb8b5131bb91af05'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:02:26.233663 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-69b51f3d-cc3b-4b6f-8536-e8a2b34dfc5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c782394ad424b5ebb8b5131bb91af05'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:02:26.234570 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-69b51f3d-cc3b-4b6f-8536-e8a2b34dfc5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c782394ad424b5ebb8b5131bb91af05'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:02:26.235580 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-69b51f3d-cc3b-4b6f-8536-e8a2b34dfc5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c782394ad424b5ebb8b5131bb91af05'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:02:26.333019 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-69b51f3d-cc3b-4b6f-8536-e8a2b34dfc5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c782394ad424b5ebb8b5131bb91af05'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:02:26.352191 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:02:26.360258 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 744/1507] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:02:25 2022] DELETE /identity/v3/users/4c782394ad424b5ebb8b5131bb91af05 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:02:26.364923 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ee221-c486-456b-b541-c2809cb54deb None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:02:26.365229 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ee221-c486-456b-b541-c2809cb54deb None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:02:26.365501 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ee221-c486-456b-b541-c2809cb54deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:02:26.384406 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-595ee221-c486-456b-b541-c2809cb54deb None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:02:26.385606 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-595ee221-c486-456b-b541-c2809cb54deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:02:26.450667 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:02:26.500904 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 764/1508] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:02:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:02:26.510400 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b51f3d-cc3b-4b6f-8536-e8a2b34dfc5b admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:02:26.511820 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-69b51f3d-cc3b-4b6f-8536-e8a2b34dfc5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:02:26.708129 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b51f3d-cc3b-4b6f-8536-e8a2b34dfc5b admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:02:26.711792 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7678c6-deb3-45e9-b574-eeaedd708b7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:02:26.712477 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7678c6-deb3-45e9-b574-eeaedd708b7d service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:02:26.712764 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7678c6-deb3-45e9-b574-eeaedd708b7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:02:26.713043 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7678c6-deb3-45e9-b574-eeaedd708b7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:02:26.722145 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7678c6-deb3-45e9-b574-eeaedd708b7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:02:26.723391 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7678c6-deb3-45e9-b574-eeaedd708b7d service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:02:26.733621 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 745/1509] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:02:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:02:27.164627 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595ee221-c486-456b-b541-c2809cb54deb None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:02:27.170607 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-595ee221-c486-456b-b541-c2809cb54deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:02:27.177868 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595ee221-c486-456b-b541-c2809cb54deb None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:02:27.182960 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debdab72-38c8-4b19-8810-169d6766691f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:02:27.183861 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdab72-38c8-4b19-8810-169d6766691f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:02:27.184185 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdab72-38c8-4b19-8810-169d6766691f admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:02:27.184471 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdab72-38c8-4b19-8810-169d6766691f admin admin] PATH_INFO: `/v3/projects/b11f822785984157bb258d88077300f1` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:02:27.185677 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debdab72-38c8-4b19-8810-169d6766691f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b11f822785984157bb258d88077300f1)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:02:27.186715 dv-cinder-849022-2-smb devstack@keystone.service[80375]: WARNING py.warnings [None req-debdab72-38c8-4b19-8810-169d6766691f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 21:02:27.186715 dv-cinder-849022-2-smb devstack@keystone.service[80375]: warnings.warn(msg) Jul 11 21:02:27.186715 dv-cinder-849022-2-smb devstack@keystone.service[80375]: Jul 11 21:02:27.188058 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debdab72-38c8-4b19-8810-169d6766691f admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:02:27.276700 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-debdab72-38c8-4b19-8810-169d6766691f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b11f822785984157bb258d88077300f1', 'request_id': 'req-debdab72-38c8-4b19-8810-169d6766691f'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:02:27.289718 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-debdab72-38c8-4b19-8810-169d6766691f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b11f822785984157bb258d88077300f1', 'request_id': 'req-debdab72-38c8-4b19-8810-169d6766691f'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:02:27.295990 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-debdab72-38c8-4b19-8810-169d6766691f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b11f822785984157bb258d88077300f1', 'request_id': 'req-debdab72-38c8-4b19-8810-169d6766691f'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:02:27.372967 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-debdab72-38c8-4b19-8810-169d6766691f admin admin] The token cache is being invalidate because project b11f822785984157bb258d88077300f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:02:27.373268 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-debdab72-38c8-4b19-8810-169d6766691f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:02:27.373989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-debdab72-38c8-4b19-8810-169d6766691f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:02:27.375531 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 765/1510] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:02:27 2022] DELETE /identity/v3/projects/b11f822785984157bb258d88077300f1 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:02:36.729347 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:DELETE=1,keystone:SELECT=37 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:02:37.369713 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:04:08.690643 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed846ab-89a5-4b23-ba07-617746afa95c None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:04:08.691163 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed846ab-89a5-4b23-ba07-617746afa95c None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:04:08.691266 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed846ab-89a5-4b23-ba07-617746afa95c None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:04:08.692596 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 746/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 21:04:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 21:04:08.697891 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23bef3c-5060-45be-a5b5-902dc79d12bf None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:04:08.698347 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23bef3c-5060-45be-a5b5-902dc79d12bf None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:04:08.698485 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23bef3c-5060-45be-a5b5-902dc79d12bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:04:08.717138 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-c23bef3c-5060-45be-a5b5-902dc79d12bf None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:04:08.718375 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-c23bef3c-5060-45be-a5b5-902dc79d12bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:04:08.775896 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 766/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 21:04:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:04:08.929671 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed846ab-89a5-4b23-ba07-617746afa95c None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:04:08.931360 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-9ed846ab-89a5-4b23-ba07-617746afa95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:04:09.034409 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed846ab-89a5-4b23-ba07-617746afa95c None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:04:09.039948 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f89f16-9ff3-4d41-b08c-ad8efc0dd5ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:04:09.040630 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f89f16-9ff3-4d41-b08c-ad8efc0dd5ca service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:04:09.040921 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f89f16-9ff3-4d41-b08c-ad8efc0dd5ca service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:04:09.041203 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f89f16-9ff3-4d41-b08c-ad8efc0dd5ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:04:09.049328 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f89f16-9ff3-4d41-b08c-ad8efc0dd5ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:04:09.050963 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f89f16-9ff3-4d41-b08c-ad8efc0dd5ca service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:04:09.060874 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 747/1513] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:04:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 21:04:09.895351 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b63de-6ece-4ce0-ba28-58f621ce9450 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:04:09.895880 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b63de-6ece-4ce0-ba28-58f621ce9450 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:04:09.895880 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b63de-6ece-4ce0-ba28-58f621ce9450 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:04:09.897810 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 767/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 21:04:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 21:04:09.902782 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4ce8a-8065-4525-b000-816416addfb3 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:04:09.903190 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4ce8a-8065-4525-b000-816416addfb3 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:04:09.903343 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4ce8a-8065-4525-b000-816416addfb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:04:09.921608 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-e8f4ce8a-8065-4525-b000-816416addfb3 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:04:09.922785 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-e8f4ce8a-8065-4525-b000-816416addfb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:04:09.930641 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 748/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 21:04:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:04:10.080901 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b63de-6ece-4ce0-ba28-58f621ce9450 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:04:10.096500 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b63de-6ece-4ce0-ba28-58f621ce9450 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:04:10.102408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf12b16-4a50-4834-8dd2-aa1604ad8f68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:04:10.103052 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf12b16-4a50-4834-8dd2-aa1604ad8f68 service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:04:10.103354 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf12b16-4a50-4834-8dd2-aa1604ad8f68 service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:04:10.103637 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf12b16-4a50-4834-8dd2-aa1604ad8f68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:04:10.111725 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf12b16-4a50-4834-8dd2-aa1604ad8f68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:04:10.113341 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf12b16-4a50-4834-8dd2-aa1604ad8f68 service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:04:10.123167 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 768/1516] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:04:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:04:10.641106 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f262c08-3b28-4b70-8174-4549ad8067d9 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:04:10.641400 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f262c08-3b28-4b70-8174-4549ad8067d9 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:04:10.641681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f262c08-3b28-4b70-8174-4549ad8067d9 None None] PATH_INFO: `/v3` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:04:10.643125 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 749/1517] 10.222.0.27 () {54 vars in 925 bytes} [Mon Jul 11 21:04:10 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:04:10.649219 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42bfce-fbcd-454b-aa95-612ec598e152 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:04:10.649522 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42bfce-fbcd-454b-aa95-612ec598e152 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:04:10.649808 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42bfce-fbcd-454b-aa95-612ec598e152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:04:10.698131 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-bc42bfce-fbcd-454b-aa95-612ec598e152 None None] MFA Rules not processed for user `177a912380ad43b6a5e31b787a07ce7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:04:10.699334 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-bc42bfce-fbcd-454b-aa95-612ec598e152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:04:10.768705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 769/1518] 10.222.0.27 () {58 vars in 1015 bytes} [Mon Jul 11 21:04:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:04:14.718281 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c83ac9-6de0-4c65-ade2-85781ecc038a None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:04:14.718766 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c83ac9-6de0-4c65-ade2-85781ecc038a None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:04:14.718876 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c83ac9-6de0-4c65-ade2-85781ecc038a None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:04:14.720260 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 750/1519] 10.222.0.40 () {54 vars in 960 bytes} [Mon Jul 11 21:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 21:04:14.725821 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900bc27-0602-4cc7-97f7-f5411c4b863e None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:04:14.726396 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900bc27-0602-4cc7-97f7-f5411c4b863e None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:04:14.726396 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900bc27-0602-4cc7-97f7-f5411c4b863e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:04:14.744807 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-7900bc27-0602-4cc7-97f7-f5411c4b863e None None] MFA Rules not processed for user `177a912380ad43b6a5e31b787a07ce7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:04:14.745996 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-7900bc27-0602-4cc7-97f7-f5411c4b863e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:04:14.754458 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 770/1520] 10.222.0.40 () {58 vars in 1057 bytes} [Mon Jul 11 21:04:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:04:14.761904 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c83ac9-6de0-4c65-ade2-85781ecc038a None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:04:14.775113 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c83ac9-6de0-4c65-ade2-85781ecc038a None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:04:14.779918 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536b314-00de-43e9-827e-57e88fd5d6f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '177a912380ad43b6a5e31b787a07ce7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:04:14.780571 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536b314-00de-43e9-827e-57e88fd5d6f5 service placement] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:04:14.780855 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536b314-00de-43e9-827e-57e88fd5d6f5 service placement] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:04:14.781131 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536b314-00de-43e9-827e-57e88fd5d6f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:04:14.789854 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2536b314-00de-43e9-827e-57e88fd5d6f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:04:14.791395 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2536b314-00de-43e9-827e-57e88fd5d6f5 service placement] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:04:14.800852 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 751/1521] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:04:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:04:21.361588 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec05a28-2b77-46ac-82f2-6607903c7592 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:04:21.362102 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec05a28-2b77-46ac-82f2-6607903c7592 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:04:21.362218 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec05a28-2b77-46ac-82f2-6607903c7592 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:04:21.363554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 771/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 21:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 21:04:21.369065 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b45a4-fef5-4391-84f6-ad08f1a3ba76 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:04:21.369508 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b45a4-fef5-4391-84f6-ad08f1a3ba76 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:04:21.369629 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b45a4-fef5-4391-84f6-ad08f1a3ba76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:04:21.387221 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-ac5b45a4-fef5-4391-84f6-ad08f1a3ba76 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:04:21.388694 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-ac5b45a4-fef5-4391-84f6-ad08f1a3ba76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:04:21.396454 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 752/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 21:04:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:04:21.549058 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec05a28-2b77-46ac-82f2-6607903c7592 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:04:21.564193 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec05a28-2b77-46ac-82f2-6607903c7592 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:04:21.569682 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80c046-db95-481b-a273-fb76c1f8e81b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:04:21.570325 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80c046-db95-481b-a273-fb76c1f8e81b service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:04:21.570619 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80c046-db95-481b-a273-fb76c1f8e81b service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:04:21.570919 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80c046-db95-481b-a273-fb76c1f8e81b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:04:21.579021 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc80c046-db95-481b-a273-fb76c1f8e81b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:04:21.580643 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc80c046-db95-481b-a273-fb76c1f8e81b service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:04:21.590878 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 772/1524] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:04:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:04:22.407476 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dab133-004e-482f-9c24-8c83f9854e4e None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:04:22.408094 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dab133-004e-482f-9c24-8c83f9854e4e None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:04:22.408094 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dab133-004e-482f-9c24-8c83f9854e4e None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:04:22.409459 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 753/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 21:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 21:04:22.414737 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fc203-7be1-45c1-af9a-f4c9e39db989 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:04:22.415184 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fc203-7be1-45c1-af9a-f4c9e39db989 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:04:22.415320 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fc203-7be1-45c1-af9a-f4c9e39db989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:04:22.434503 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-a82fc203-7be1-45c1-af9a-f4c9e39db989 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:04:22.435683 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a82fc203-7be1-45c1-af9a-f4c9e39db989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:04:22.443360 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 773/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 21:04:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:04:22.594353 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dab133-004e-482f-9c24-8c83f9854e4e None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:04:22.609308 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dab133-004e-482f-9c24-8c83f9854e4e None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:04:22.614978 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d768b-1597-4f01-ae5f-b59432bb3a6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:04:22.615735 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d768b-1597-4f01-ae5f-b59432bb3a6b service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:04:22.616068 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d768b-1597-4f01-ae5f-b59432bb3a6b service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:04:22.616396 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d768b-1597-4f01-ae5f-b59432bb3a6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:04:22.625132 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5d768b-1597-4f01-ae5f-b59432bb3a6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:04:22.626698 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5d768b-1597-4f01-ae5f-b59432bb3a6b service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:04:22.636331 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 754/1527] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:04:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:04:26.376694 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e4fbb-0cf0-49bf-903d-fa44735d4589 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:04:26.377253 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e4fbb-0cf0-49bf-903d-fa44735d4589 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:04:26.377253 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e4fbb-0cf0-49bf-903d-fa44735d4589 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:04:26.378672 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 774/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 21:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 21:04:26.384493 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a40717-5a66-4c8d-989f-e35de29397bf None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:04:26.384904 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a40717-5a66-4c8d-989f-e35de29397bf None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:04:26.385061 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a40717-5a66-4c8d-989f-e35de29397bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:04:26.402953 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-75a40717-5a66-4c8d-989f-e35de29397bf None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:04:26.404139 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-75a40717-5a66-4c8d-989f-e35de29397bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:04:26.411847 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 755/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 21:04:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:04:26.484158 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e4fbb-0cf0-49bf-903d-fa44735d4589 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:04:26.485738 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a55e4fbb-0cf0-49bf-903d-fa44735d4589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:04:26.514259 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:04:26.543390 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e4fbb-0cf0-49bf-903d-fa44735d4589 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:04:26.547261 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43af1c-abbd-4058-8923-ac9c01effc2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:04:26.548126 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43af1c-abbd-4058-8923-ac9c01effc2e service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:04:26.548255 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43af1c-abbd-4058-8923-ac9c01effc2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:04:26.548532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43af1c-abbd-4058-8923-ac9c01effc2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:04:26.558134 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43af1c-abbd-4058-8923-ac9c01effc2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:04:26.559558 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43af1c-abbd-4058-8923-ac9c01effc2e service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:04:26.568694 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 775/1530] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:04:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:04:28.587111 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37a92e-2140-4e94-bbfb-9362e4547398 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:04:28.587631 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37a92e-2140-4e94-bbfb-9362e4547398 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:04:28.587728 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37a92e-2140-4e94-bbfb-9362e4547398 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:04:28.589098 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 756/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 21:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 21:04:28.594258 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87c1cc-e4a6-4da8-b2ea-e0caf522d83c None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:04:28.594667 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87c1cc-e4a6-4da8-b2ea-e0caf522d83c None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:04:28.594830 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87c1cc-e4a6-4da8-b2ea-e0caf522d83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:04:28.613060 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-1e87c1cc-e4a6-4da8-b2ea-e0caf522d83c None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:04:28.614256 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-1e87c1cc-e4a6-4da8-b2ea-e0caf522d83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:04:28.622136 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 776/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 21:04:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:04:28.658063 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37a92e-2140-4e94-bbfb-9362e4547398 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:04:28.669258 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37a92e-2140-4e94-bbfb-9362e4547398 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:04:28.672777 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39325c-d065-4aec-b579-5e1c20e59d03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:04:28.673421 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39325c-d065-4aec-b579-5e1c20e59d03 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:04:28.673711 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39325c-d065-4aec-b579-5e1c20e59d03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:04:28.673989 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39325c-d065-4aec-b579-5e1c20e59d03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:04:28.683024 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e39325c-d065-4aec-b579-5e1c20e59d03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:04:28.684479 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e39325c-d065-4aec-b579-5e1c20e59d03 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:04:28.694331 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 757/1533] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:04:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:04:32.116327 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594b41d-a88c-4dba-83a7-3b305b59a4a8 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:04:32.116901 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594b41d-a88c-4dba-83a7-3b305b59a4a8 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:04:32.116901 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594b41d-a88c-4dba-83a7-3b305b59a4a8 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:04:32.118326 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 777/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 21:04:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 21:04:32.123489 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a7a14-2148-4ce2-847d-ef2fe6d0deff None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:04:32.123897 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a7a14-2148-4ce2-847d-ef2fe6d0deff None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:04:32.124069 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a7a14-2148-4ce2-847d-ef2fe6d0deff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:04:32.141793 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-595a7a14-2148-4ce2-847d-ef2fe6d0deff None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:04:32.142979 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-595a7a14-2148-4ce2-847d-ef2fe6d0deff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:04:32.151338 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 758/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 21:04:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:04:32.452415 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594b41d-a88c-4dba-83a7-3b305b59a4a8 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:04:32.454112 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-f594b41d-a88c-4dba-83a7-3b305b59a4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:04:32.511391 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594b41d-a88c-4dba-83a7-3b305b59a4a8 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:04:32.515181 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4502f-6967-436b-9c48-0595dd37784a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:04:32.515826 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4502f-6967-436b-9c48-0595dd37784a service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:04:32.516147 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4502f-6967-436b-9c48-0595dd37784a service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:04:32.516433 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4502f-6967-436b-9c48-0595dd37784a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:04:32.525878 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe4502f-6967-436b-9c48-0595dd37784a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:04:32.527302 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe4502f-6967-436b-9c48-0595dd37784a service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:04:32.536713 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 778/1536] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:04:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:04:34.603205 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17a805-a3fb-43e0-8ddd-d22b87d088e0 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:04:34.603737 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17a805-a3fb-43e0-8ddd-d22b87d088e0 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:04:34.603867 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17a805-a3fb-43e0-8ddd-d22b87d088e0 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:04:34.605164 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 759/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 21:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 21:04:34.610225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cf29a-9f19-418a-8097-f73b3b31fec6 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:04:34.610673 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cf29a-9f19-418a-8097-f73b3b31fec6 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:04:34.610787 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cf29a-9f19-418a-8097-f73b3b31fec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:04:34.628778 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-e79cf29a-9f19-418a-8097-f73b3b31fec6 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:04:34.630010 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-e79cf29a-9f19-418a-8097-f73b3b31fec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:04:34.637819 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 779/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 21:04:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:04:34.935074 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa17a805-a3fb-43e0-8ddd-d22b87d088e0 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:04:34.936786 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-fa17a805-a3fb-43e0-8ddd-d22b87d088e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:04:34.950278 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa17a805-a3fb-43e0-8ddd-d22b87d088e0 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:04:34.953791 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae94e4d-78d6-46a2-b5d5-62527a4f207c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:04:34.954440 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae94e4d-78d6-46a2-b5d5-62527a4f207c service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:04:34.954725 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae94e4d-78d6-46a2-b5d5-62527a4f207c service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:04:34.955005 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae94e4d-78d6-46a2-b5d5-62527a4f207c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:04:34.964763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae94e4d-78d6-46a2-b5d5-62527a4f207c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:04:34.966179 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae94e4d-78d6-46a2-b5d5-62527a4f207c service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:04:34.975627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 760/1539] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:04:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:04:44.623453 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=47 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:04:44.971333 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=82 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:05.739998 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fd5b8-4c33-49db-bdb2-c19131cd8fd0 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:05.740677 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fd5b8-4c33-49db-bdb2-c19131cd8fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:05.740677 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fd5b8-4c33-49db-bdb2-c19131cd8fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:05.768340 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-b96fd5b8-4c33-49db-bdb2-c19131cd8fd0 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:05.770166 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-b96fd5b8-4c33-49db-bdb2-c19131cd8fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:05.785660 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 780/1540] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:05.795274 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb967a-4516-425d-91a1-bc81d2b2e8e4 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:05.797186 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb967a-4516-425d-91a1-bc81d2b2e8e4 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:05.797186 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb967a-4516-425d-91a1-bc81d2b2e8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:05.820243 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-6ebb967a-4516-425d-91a1-bc81d2b2e8e4 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:05.821461 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-6ebb967a-4516-425d-91a1-bc81d2b2e8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:05.841146 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 761/1541] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:05.845785 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96fd5b8-4c33-49db-bdb2-c19131cd8fd0 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:05.862580 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96fd5b8-4c33-49db-bdb2-c19131cd8fd0 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:05.873407 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b6539-2d9e-4119-a4d3-44f86e4ce902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:05.874474 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b6539-2d9e-4119-a4d3-44f86e4ce902 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:05.874986 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b6539-2d9e-4119-a4d3-44f86e4ce902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:05.875503 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b6539-2d9e-4119-a4d3-44f86e4ce902 admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:05.876484 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b6539-2d9e-4119-a4d3-44f86e4ce902 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:06:05.877004 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b6539-2d9e-4119-a4d3-44f86e4ce902 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:05.878844 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b6539-2d9e-4119-a4d3-44f86e4ce902 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:05.898738 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 781/1542] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:06:05.907262 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb967a-4516-425d-91a1-bc81d2b2e8e4 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:05.921928 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb967a-4516-425d-91a1-bc81d2b2e8e4 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:05.932123 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468637dc-77d3-4017-9d89-29fa0cdcd130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:05.932826 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468637dc-77d3-4017-9d89-29fa0cdcd130 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:05.933112 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468637dc-77d3-4017-9d89-29fa0cdcd130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:05.933394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468637dc-77d3-4017-9d89-29fa0cdcd130 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:05.934648 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468637dc-77d3-4017-9d89-29fa0cdcd130 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:05.936625 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468637dc-77d3-4017-9d89-29fa0cdcd130 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:06.080462 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 762/1543] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:06:05 2022] POST /identity/v3/projects => generated 377 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:06.084850 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b6539-2d9e-4119-a4d3-44f86e4ce902 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:06.096631 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b6539-2d9e-4119-a4d3-44f86e4ce902 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:06.160773 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423b835-6ebc-4ee4-a5aa-bf0300edcb91 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:06.161134 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423b835-6ebc-4ee4-a5aa-bf0300edcb91 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:06.161343 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423b835-6ebc-4ee4-a5aa-bf0300edcb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:06.188247 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c427a-9951-4b86-b115-af20fab4ab6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:06.189462 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c427a-9951-4b86-b115-af20fab4ab6e admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:06.189976 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c427a-9951-4b86-b115-af20fab4ab6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:06.190458 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c427a-9951-4b86-b115-af20fab4ab6e admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:06.191391 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c427a-9951-4b86-b115-af20fab4ab6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:06.193566 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c427a-9951-4b86-b115-af20fab4ab6e admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:06.197904 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-e423b835-6ebc-4ee4-a5aa-bf0300edcb91 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:06.199143 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-e423b835-6ebc-4ee4-a5aa-bf0300edcb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:06.214509 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 763/1544] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:06:06.216784 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b8558-30cd-4286-b286-e9363f670697 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:06.217360 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b8558-30cd-4286-b286-e9363f670697 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:06.218264 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b8558-30cd-4286-b286-e9363f670697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:06.242010 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-285b8558-30cd-4286-b286-e9363f670697 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:06.243568 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-285b8558-30cd-4286-b286-e9363f670697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:06.253659 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 764/1545] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:06.258494 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a6e0e-1c8a-463f-9292-70309d44083c None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:06.258494 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a6e0e-1c8a-463f-9292-70309d44083c None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:06.258494 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a6e0e-1c8a-463f-9292-70309d44083c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:06.278211 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-7d5a6e0e-1c8a-463f-9292-70309d44083c None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:06.280025 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-7d5a6e0e-1c8a-463f-9292-70309d44083c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:06.288975 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 765/1546] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:06.290787 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b0cdc-4930-4140-8654-3512d92ce319 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:06.291314 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b0cdc-4930-4140-8654-3512d92ce319 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:06.291929 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b0cdc-4930-4140-8654-3512d92ce319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:06.313388 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 782/1547] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:06:06 2022] POST /identity/v3/users => generated 289 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:06.315753 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396ae95-9597-4f70-94b3-f32341e07d5b None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:06.315753 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396ae95-9597-4f70-94b3-f32341e07d5b None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:06.315753 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396ae95-9597-4f70-94b3-f32341e07d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:06.316069 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-a38b0cdc-4930-4140-8654-3512d92ce319 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:06.317721 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-a38b0cdc-4930-4140-8654-3512d92ce319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:06.326537 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 766/1548] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:06.328565 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d78f0-453a-4d98-afca-0c35892451fc None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:06.329042 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d78f0-453a-4d98-afca-0c35892451fc None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:06.329320 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d78f0-453a-4d98-afca-0c35892451fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:06.338213 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-c396ae95-9597-4f70-94b3-f32341e07d5b None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:06.339436 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-c396ae95-9597-4f70-94b3-f32341e07d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:06.347293 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-f47d78f0-453a-4d98-afca-0c35892451fc None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:06.348252 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 783/1549] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:06.348488 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-f47d78f0-453a-4d98-afca-0c35892451fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:06.349484 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fade992-8ca3-4e29-86e0-1d920216f26e None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:06.349781 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fade992-8ca3-4e29-86e0-1d920216f26e None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:06.350064 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fade992-8ca3-4e29-86e0-1d920216f26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:06.358876 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 767/1550] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:06.360213 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89b517-f5f1-4964-ae0d-9d59d84f6a5b None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:06.360634 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89b517-f5f1-4964-ae0d-9d59d84f6a5b None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:06.360919 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89b517-f5f1-4964-ae0d-9d59d84f6a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:06.372254 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-4fade992-8ca3-4e29-86e0-1d920216f26e None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:06.373473 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-4fade992-8ca3-4e29-86e0-1d920216f26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:06.379538 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-6b89b517-f5f1-4964-ae0d-9d59d84f6a5b None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:06.380716 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-6b89b517-f5f1-4964-ae0d-9d59d84f6a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:06.382278 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 784/1551] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:06.383547 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828b588-b623-4026-a70c-de47615d55a8 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:06.383944 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828b588-b623-4026-a70c-de47615d55a8 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:06.384163 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828b588-b623-4026-a70c-de47615d55a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:06.390086 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 768/1552] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:06.390868 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89b517-f5f1-4964-ae0d-9d59d84f6a5b None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:06.400333 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89b517-f5f1-4964-ae0d-9d59d84f6a5b None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:06.404419 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-9828b588-b623-4026-a70c-de47615d55a8 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:06.405601 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-9828b588-b623-4026-a70c-de47615d55a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:06.405915 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f071d-7165-49da-abd3-790efd4e7ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:06.406582 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f071d-7165-49da-abd3-790efd4e7ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:06.406871 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f071d-7165-49da-abd3-790efd4e7ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:06.407171 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f071d-7165-49da-abd3-790efd4e7ec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:06.407937 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f071d-7165-49da-abd3-790efd4e7ec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:06.409572 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f071d-7165-49da-abd3-790efd4e7ec3 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:06.413540 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 785/1553] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:06.414731 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc8df6-e71d-4235-8f74-57cdcf38068d None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:06.415021 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc8df6-e71d-4235-8f74-57cdcf38068d None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:06.415295 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc8df6-e71d-4235-8f74-57cdcf38068d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:06.422611 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 769/1554] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:06.423986 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e01f46-b276-4c2b-a617-fa46697b9fd4 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:06.424282 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e01f46-b276-4c2b-a617-fa46697b9fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:06.424566 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e01f46-b276-4c2b-a617-fa46697b9fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:06.436208 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-03dc8df6-e71d-4235-8f74-57cdcf38068d None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:06.437401 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-03dc8df6-e71d-4235-8f74-57cdcf38068d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:06.442146 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-04e01f46-b276-4c2b-a617-fa46697b9fd4 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:06.443255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-04e01f46-b276-4c2b-a617-fa46697b9fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:06.445198 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 786/1555] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:06.445954 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc8df6-e71d-4235-8f74-57cdcf38068d None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:06.454243 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 770/1556] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:06.455557 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254a9b3-8ce8-483f-a9af-6fde51d6eba5 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:06.455853 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254a9b3-8ce8-483f-a9af-6fde51d6eba5 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:06.456171 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254a9b3-8ce8-483f-a9af-6fde51d6eba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:06.457678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc8df6-e71d-4235-8f74-57cdcf38068d None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:06.462019 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc58da-9724-470b-8922-fb70d8cfa054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:06.462679 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc58da-9724-470b-8922-fb70d8cfa054 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:06.462968 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc58da-9724-470b-8922-fb70d8cfa054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:06.463254 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc58da-9724-470b-8922-fb70d8cfa054 admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:06.464037 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc58da-9724-470b-8922-fb70d8cfa054 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:06:06.464353 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc58da-9724-470b-8922-fb70d8cfa054 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:06.466739 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc58da-9724-470b-8922-fb70d8cfa054 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:06.475025 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-c254a9b3-8ce8-483f-a9af-6fde51d6eba5 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:06.476267 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c254a9b3-8ce8-483f-a9af-6fde51d6eba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:06.486375 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 787/1557] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:06:06.486375 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc58da-9724-470b-8922-fb70d8cfa054 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:06.489582 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc58da-9724-470b-8922-fb70d8cfa054 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:06.492176 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 771/1558] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:06.492983 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254a9b3-8ce8-483f-a9af-6fde51d6eba5 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:06.497727 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20255eaf-7288-49ed-8e09-59a0f77666bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:06.498391 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20255eaf-7288-49ed-8e09-59a0f77666bd admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:06.498682 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20255eaf-7288-49ed-8e09-59a0f77666bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:06.498965 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20255eaf-7288-49ed-8e09-59a0f77666bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:06.499684 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20255eaf-7288-49ed-8e09-59a0f77666bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:06:06.500024 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20255eaf-7288-49ed-8e09-59a0f77666bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:06.501616 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20255eaf-7288-49ed-8e09-59a0f77666bd admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:06.502556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254a9b3-8ce8-483f-a9af-6fde51d6eba5 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:06.507514 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f0b3e-998e-47f8-8a8d-85fa7b2c71a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:06.508193 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f0b3e-998e-47f8-8a8d-85fa7b2c71a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:06.508481 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f0b3e-998e-47f8-8a8d-85fa7b2c71a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:06.509150 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f0b3e-998e-47f8-8a8d-85fa7b2c71a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:06.509469 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f0b3e-998e-47f8-8a8d-85fa7b2c71a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:06:06.509778 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f0b3e-998e-47f8-8a8d-85fa7b2c71a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:06.510787 dv-cinder-849022-2-smb devstack@keystone.service[80374]: WARNING py.warnings [None req-825f0b3e-998e-47f8-8a8d-85fa7b2c71a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 21:06:06.510787 dv-cinder-849022-2-smb devstack@keystone.service[80374]: warnings.warn(msg) Jul 11 21:06:06.510787 dv-cinder-849022-2-smb devstack@keystone.service[80374]: Jul 11 21:06:06.511640 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f0b3e-998e-47f8-8a8d-85fa7b2c71a7 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:06.513973 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 788/1559] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:06:06.515360 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4488d-3ed4-467f-ade3-e3661f733b75 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:06.515650 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4488d-3ed4-467f-ade3-e3661f733b75 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:06.515929 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4488d-3ed4-467f-ade3-e3661f733b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:06.524014 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 772/1560] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:06:06.524447 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f0b3e-998e-47f8-8a8d-85fa7b2c71a7 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:06.535359 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-74f4488d-3ed4-467f-ade3-e3661f733b75 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:06.536574 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-74f4488d-3ed4-467f-ade3-e3661f733b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:06.540413 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f0b3e-998e-47f8-8a8d-85fa7b2c71a7 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:06.545271 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 789/1561] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:06.546490 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e06759-8311-4d42-99a3-c70009e5c086 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:06.546786 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e06759-8311-4d42-99a3-c70009e5c086 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:06.547069 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e06759-8311-4d42-99a3-c70009e5c086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:06.548518 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6dcc4c-79ee-4c7c-9d24-5b1a78ec61a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:06.549266 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6dcc4c-79ee-4c7c-9d24-5b1a78ec61a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:06.549568 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6dcc4c-79ee-4c7c-9d24-5b1a78ec61a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:06.549830 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6dcc4c-79ee-4c7c-9d24-5b1a78ec61a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:06.550550 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6dcc4c-79ee-4c7c-9d24-5b1a78ec61a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:06.552170 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6dcc4c-79ee-4c7c-9d24-5b1a78ec61a2 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:06.566465 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 773/1562] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:06.566465 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6dcc4c-79ee-4c7c-9d24-5b1a78ec61a2 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:06.566754 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-50e06759-8311-4d42-99a3-c70009e5c086 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:06.566754 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-50e06759-8311-4d42-99a3-c70009e5c086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:06.575178 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 790/1563] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:06.575928 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e06759-8311-4d42-99a3-c70009e5c086 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:06.576153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6dcc4c-79ee-4c7c-9d24-5b1a78ec61a2 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:06.580896 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bea695-12a7-4f63-acb1-6ca11d634f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:06.581998 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bea695-12a7-4f63-acb1-6ca11d634f82 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:06.581998 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bea695-12a7-4f63-acb1-6ca11d634f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:06.582246 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bea695-12a7-4f63-acb1-6ca11d634f82 admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:06.582799 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bea695-12a7-4f63-acb1-6ca11d634f82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:06:06.583107 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bea695-12a7-4f63-acb1-6ca11d634f82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:06.584712 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bea695-12a7-4f63-acb1-6ca11d634f82 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:06.585584 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e06759-8311-4d42-99a3-c70009e5c086 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:06.590602 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be775cc-c796-450a-9f54-acc2387759e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:06.591250 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be775cc-c796-450a-9f54-acc2387759e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:06.591539 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be775cc-c796-450a-9f54-acc2387759e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:06.591820 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be775cc-c796-450a-9f54-acc2387759e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:06.592558 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be775cc-c796-450a-9f54-acc2387759e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:06.593581 dv-cinder-849022-2-smb devstack@keystone.service[80375]: WARNING py.warnings [None req-6be775cc-c796-450a-9f54-acc2387759e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 21:06:06.593581 dv-cinder-849022-2-smb devstack@keystone.service[80375]: warnings.warn(msg) Jul 11 21:06:06.593581 dv-cinder-849022-2-smb devstack@keystone.service[80375]: Jul 11 21:06:06.594749 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be775cc-c796-450a-9f54-acc2387759e1 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:06.596523 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 774/1564] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:06:06.597318 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bea695-12a7-4f63-acb1-6ca11d634f82 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:06.609525 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bea695-12a7-4f63-acb1-6ca11d634f82 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:06.613810 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881961b-3796-4fe9-bf3e-25e707caff45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:06.614516 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881961b-3796-4fe9-bf3e-25e707caff45 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:06.614800 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881961b-3796-4fe9-bf3e-25e707caff45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:06.615075 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881961b-3796-4fe9-bf3e-25e707caff45 admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:06.615790 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8881961b-3796-4fe9-bf3e-25e707caff45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:06:06.616139 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8881961b-3796-4fe9-bf3e-25e707caff45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:06.619056 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8881961b-3796-4fe9-bf3e-25e707caff45 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:06.630656 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 775/1565] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:06:06.631430 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881961b-3796-4fe9-bf3e-25e707caff45 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:06.641748 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881961b-3796-4fe9-bf3e-25e707caff45 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:06.646256 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e3528-2c84-470b-a6b0-4a423552e2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:06.650053 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e3528-2c84-470b-a6b0-4a423552e2d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:06.650053 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e3528-2c84-470b-a6b0-4a423552e2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:06.650053 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e3528-2c84-470b-a6b0-4a423552e2d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:06.650053 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e3528-2c84-470b-a6b0-4a423552e2d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:06.650053 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e3528-2c84-470b-a6b0-4a423552e2d7 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:06.704921 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 791/1566] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:06:06 2022] POST /identity/v3/projects => generated 365 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:06.707681 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be775cc-c796-450a-9f54-acc2387759e1 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:06.731776 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 776/1567] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:06:06 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:06.731776 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e3528-2c84-470b-a6b0-4a423552e2d7 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:06.751960 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:06.771355 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be775cc-c796-450a-9f54-acc2387759e1 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:06.790460 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:06.796184 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e3528-2c84-470b-a6b0-4a423552e2d7 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:06.800945 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306fac32-09a7-48d6-bc69-7fb887ec866a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:06.805891 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306fac32-09a7-48d6-bc69-7fb887ec866a admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:06.805891 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306fac32-09a7-48d6-bc69-7fb887ec866a admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:06.805891 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306fac32-09a7-48d6-bc69-7fb887ec866a admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:06.805891 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306fac32-09a7-48d6-bc69-7fb887ec866a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:06:06.805891 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306fac32-09a7-48d6-bc69-7fb887ec866a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:06.805891 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306fac32-09a7-48d6-bc69-7fb887ec866a admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:06.817079 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 777/1568] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:06:06.817872 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306fac32-09a7-48d6-bc69-7fb887ec866a admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:06.827599 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97feb4b6-52d1-4fee-a5fa-9345875e118a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:06.828336 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97feb4b6-52d1-4fee-a5fa-9345875e118a admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:06.833699 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97feb4b6-52d1-4fee-a5fa-9345875e118a admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:06.833699 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97feb4b6-52d1-4fee-a5fa-9345875e118a admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:06.833699 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97feb4b6-52d1-4fee-a5fa-9345875e118a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:06.833959 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306fac32-09a7-48d6-bc69-7fb887ec866a admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:06.834203 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97feb4b6-52d1-4fee-a5fa-9345875e118a admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:06.834973 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757197e4-243b-4948-bd39-4cdf786eeff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:06.835872 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757197e4-243b-4948-bd39-4cdf786eeff6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:06.836225 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757197e4-243b-4948-bd39-4cdf786eeff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:06.836508 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757197e4-243b-4948-bd39-4cdf786eeff6 admin admin] PATH_INFO: `/v3/projects/cf0b76e26f5e448f8d51b55dd2132cf7/users/979d4af26ce14a2b952908e5ac3062f0/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:06.852101 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757197e4-243b-4948-bd39-4cdf786eeff6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf0b76e26f5e448f8d51b55dd2132cf7, user_id=979d4af26ce14a2b952908e5ac3062f0, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:06.854783 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757197e4-243b-4948-bd39-4cdf786eeff6 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:06.950988 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 792/1569] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:06:06 2022] POST /identity/v3/projects => generated 387 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:06.951821 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97feb4b6-52d1-4fee-a5fa-9345875e118a admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:06.978870 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 778/1570] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:06:06 2022] PUT /identity/v3/projects/cf0b76e26f5e448f8d51b55dd2132cf7/users/979d4af26ce14a2b952908e5ac3062f0/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:06.979612 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757197e4-243b-4948-bd39-4cdf786eeff6 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:07.021686 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97feb4b6-52d1-4fee-a5fa-9345875e118a admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:07.040797 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757197e4-243b-4948-bd39-4cdf786eeff6 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:07.045675 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c6b60-9bd6-4d23-90c0-2349d6afb328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:07.046344 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c6b60-9bd6-4d23-90c0-2349d6afb328 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:07.046635 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c6b60-9bd6-4d23-90c0-2349d6afb328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:07.046918 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c6b60-9bd6-4d23-90c0-2349d6afb328 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:07.047606 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c6b60-9bd6-4d23-90c0-2349d6afb328 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:07.049690 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c6b60-9bd6-4d23-90c0-2349d6afb328 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:07.077083 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f9dfc-415b-442e-a1c6-60e3158997d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:07.077750 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f9dfc-415b-442e-a1c6-60e3158997d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:07.078038 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f9dfc-415b-442e-a1c6-60e3158997d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:07.078352 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f9dfc-415b-442e-a1c6-60e3158997d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:07.079049 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f9dfc-415b-442e-a1c6-60e3158997d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:06:07.079567 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f9dfc-415b-442e-a1c6-60e3158997d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:07.081563 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f9dfc-415b-442e-a1c6-60e3158997d7 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:07.127709 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 793/1571] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:06:07.128624 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f9dfc-415b-442e-a1c6-60e3158997d7 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:07.139065 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f9dfc-415b-442e-a1c6-60e3158997d7 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:07.144060 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70ba2e-8d66-44ff-b3eb-06905d66b52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:07.144738 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70ba2e-8d66-44ff-b3eb-06905d66b52c admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:07.145027 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70ba2e-8d66-44ff-b3eb-06905d66b52c admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:07.146935 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70ba2e-8d66-44ff-b3eb-06905d66b52c admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:07.146935 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70ba2e-8d66-44ff-b3eb-06905d66b52c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:07.147942 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70ba2e-8d66-44ff-b3eb-06905d66b52c admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:07.161476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:07.202089 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 779/1572] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:06:06 2022] POST /identity/v3/projects => generated 405 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:07.202897 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c6b60-9bd6-4d23-90c0-2349d6afb328 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:07.271740 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 794/1573] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:06:07 2022] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:07.271740 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70ba2e-8d66-44ff-b3eb-06905d66b52c admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:07.274787 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c6b60-9bd6-4d23-90c0-2349d6afb328 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:07.325377 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:07.331192 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f4a8c3-87dc-4495-bd12-1ceca17089b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:07.331864 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4a8c3-87dc-4495-bd12-1ceca17089b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:07.332052 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70ba2e-8d66-44ff-b3eb-06905d66b52c admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:07.332186 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4a8c3-87dc-4495-bd12-1ceca17089b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:07.332471 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4a8c3-87dc-4495-bd12-1ceca17089b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:07.333167 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f4a8c3-87dc-4495-bd12-1ceca17089b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:07.334187 dv-cinder-849022-2-smb devstack@keystone.service[80374]: WARNING py.warnings [None req-37f4a8c3-87dc-4495-bd12-1ceca17089b7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 21:06:07.334187 dv-cinder-849022-2-smb devstack@keystone.service[80374]: warnings.warn(msg) Jul 11 21:06:07.334187 dv-cinder-849022-2-smb devstack@keystone.service[80374]: Jul 11 21:06:07.335374 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f4a8c3-87dc-4495-bd12-1ceca17089b7 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:07.336726 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d0c74-4c9c-45ee-b10b-acb60ed9fbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:07.337400 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d0c74-4c9c-45ee-b10b-acb60ed9fbab admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:07.337685 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d0c74-4c9c-45ee-b10b-acb60ed9fbab admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:07.337966 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d0c74-4c9c-45ee-b10b-acb60ed9fbab admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:07.338651 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d0c74-4c9c-45ee-b10b-acb60ed9fbab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:07.340709 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d0c74-4c9c-45ee-b10b-acb60ed9fbab admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:07.437168 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 780/1574] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:06:07 2022] POST /identity/v3/users => generated 283 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:07.438036 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f4a8c3-87dc-4495-bd12-1ceca17089b7 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:07.447626 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f4a8c3-87dc-4495-bd12-1ceca17089b7 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:07.452994 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3697d135-d451-4828-8ade-24ce887c77ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:07.453627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697d135-d451-4828-8ade-24ce887c77ff admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:07.453914 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697d135-d451-4828-8ade-24ce887c77ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:07.454194 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697d135-d451-4828-8ade-24ce887c77ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:07.454869 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3697d135-d451-4828-8ade-24ce887c77ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:07.456907 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3697d135-d451-4828-8ade-24ce887c77ff admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:07.464025 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 795/1575] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:06:07 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:07.465110 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d0c74-4c9c-45ee-b10b-acb60ed9fbab admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:07.475799 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d0c74-4c9c-45ee-b10b-acb60ed9fbab admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:07.480348 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc1269-44d8-467f-9f06-5363362ff946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:07.481068 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc1269-44d8-467f-9f06-5363362ff946 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:07.481363 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc1269-44d8-467f-9f06-5363362ff946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:07.481644 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc1269-44d8-467f-9f06-5363362ff946 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:07.482324 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cc1269-44d8-467f-9f06-5363362ff946 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:07.484259 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cc1269-44d8-467f-9f06-5363362ff946 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:07.570057 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 781/1576] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:06:07 2022] POST /identity/v3/projects => generated 375 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:07.571269 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee8ae8-ce8a-42ff-98a4-b159590b226d None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:07.571565 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee8ae8-ce8a-42ff-98a4-b159590b226d None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:07.571844 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee8ae8-ce8a-42ff-98a4-b159590b226d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:07.582930 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 796/1577] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:06:07 2022] POST /identity/v3/users => generated 294 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:07.583811 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc1269-44d8-467f-9f06-5363362ff946 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:07.589511 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-5cee8ae8-ce8a-42ff-98a4-b159590b226d None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:07.590793 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-5cee8ae8-ce8a-42ff-98a4-b159590b226d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:07.593850 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc1269-44d8-467f-9f06-5363362ff946 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:07.654522 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179dc46-57c3-4305-b8c7-45b63199ddf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:07.655487 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179dc46-57c3-4305-b8c7-45b63199ddf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:07.655882 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179dc46-57c3-4305-b8c7-45b63199ddf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:07.656300 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179dc46-57c3-4305-b8c7-45b63199ddf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:07.657102 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179dc46-57c3-4305-b8c7-45b63199ddf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:07.657870 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 782/1578] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:07.658775 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee8ae8-ce8a-42ff-98a4-b159590b226d None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:07.659366 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179dc46-57c3-4305-b8c7-45b63199ddf2 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:07.670124 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee8ae8-ce8a-42ff-98a4-b159590b226d None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:07.674738 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88dd469-2b77-49db-a7e8-fc1a3a7a0fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:07.675413 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88dd469-2b77-49db-a7e8-fc1a3a7a0fbd admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:07.675703 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88dd469-2b77-49db-a7e8-fc1a3a7a0fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:07.676033 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88dd469-2b77-49db-a7e8-fc1a3a7a0fbd admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:07.676727 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88dd469-2b77-49db-a7e8-fc1a3a7a0fbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:07.678615 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88dd469-2b77-49db-a7e8-fc1a3a7a0fbd admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:07.747267 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 797/1579] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:06:07 2022] POST /identity/v3/projects => generated 391 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:07.748177 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179dc46-57c3-4305-b8c7-45b63199ddf2 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:07.769880 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 783/1580] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:06:07 2022] POST /identity/v3/users => generated 303 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:07.770826 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88dd469-2b77-49db-a7e8-fc1a3a7a0fbd admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:07.780626 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88dd469-2b77-49db-a7e8-fc1a3a7a0fbd admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:07.803495 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:07.814305 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179dc46-57c3-4305-b8c7-45b63199ddf2 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:07.819190 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab23b36-9869-4549-8cc7-94be2bf2466b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:07.819869 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab23b36-9869-4549-8cc7-94be2bf2466b admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:07.820247 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab23b36-9869-4549-8cc7-94be2bf2466b admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:07.820487 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab23b36-9869-4549-8cc7-94be2bf2466b admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:07.821177 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab23b36-9869-4549-8cc7-94be2bf2466b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:07.823139 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab23b36-9869-4549-8cc7-94be2bf2466b admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:07.837879 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2bcf1-0e55-46e6-a4ba-757c4ab6a440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:07.838558 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2bcf1-0e55-46e6-a4ba-757c4ab6a440 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:07.838844 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2bcf1-0e55-46e6-a4ba-757c4ab6a440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:07.839120 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2bcf1-0e55-46e6-a4ba-757c4ab6a440 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:07.839844 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea2bcf1-0e55-46e6-a4ba-757c4ab6a440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:07.841685 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea2bcf1-0e55-46e6-a4ba-757c4ab6a440 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:07.852140 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 784/1581] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:07.852922 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2bcf1-0e55-46e6-a4ba-757c4ab6a440 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:07.862698 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2bcf1-0e55-46e6-a4ba-757c4ab6a440 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:07.867173 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d211e-dd6b-4fa9-993f-89ea3e217c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:07.867803 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d211e-dd6b-4fa9-993f-89ea3e217c16 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:07.868170 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d211e-dd6b-4fa9-993f-89ea3e217c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:07.872117 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d211e-dd6b-4fa9-993f-89ea3e217c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:07.872117 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d211e-dd6b-4fa9-993f-89ea3e217c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:07.872117 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d211e-dd6b-4fa9-993f-89ea3e217c16 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:07.881175 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 785/1582] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:07.881929 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d211e-dd6b-4fa9-993f-89ea3e217c16 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:07.891781 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d211e-dd6b-4fa9-993f-89ea3e217c16 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:07.896300 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45beb23a-49dd-4288-b83b-d9983589898d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:07.896987 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45beb23a-49dd-4288-b83b-d9983589898d admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:07.897271 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45beb23a-49dd-4288-b83b-d9983589898d admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:07.897404 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 798/1583] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:06:07 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:07.897546 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45beb23a-49dd-4288-b83b-d9983589898d admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:07.898217 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45beb23a-49dd-4288-b83b-d9983589898d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:07.898332 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab23b36-9869-4549-8cc7-94be2bf2466b admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:07.900152 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45beb23a-49dd-4288-b83b-d9983589898d admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:07.909339 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab23b36-9869-4549-8cc7-94be2bf2466b admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:07.914310 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7793358-fbdb-4398-a265-ca4c6928f4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:07.914971 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7793358-fbdb-4398-a265-ca4c6928f4b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:07.915256 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7793358-fbdb-4398-a265-ca4c6928f4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:07.915532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7793358-fbdb-4398-a265-ca4c6928f4b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:07.916285 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7793358-fbdb-4398-a265-ca4c6928f4b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:07.917866 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7793358-fbdb-4398-a265-ca4c6928f4b5 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:07.928536 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 799/1584] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:07.929310 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7793358-fbdb-4398-a265-ca4c6928f4b5 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:07.981777 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7793358-fbdb-4398-a265-ca4c6928f4b5 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:07.985375 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3ba33-97d5-466c-8244-67fe5005168c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:07.986004 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3ba33-97d5-466c-8244-67fe5005168c service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:07.986293 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3ba33-97d5-466c-8244-67fe5005168c service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:07.986573 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3ba33-97d5-466c-8244-67fe5005168c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:07.995430 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 786/1585] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:06:07 2022] POST /identity/v3/users => generated 288 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:08.002748 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45beb23a-49dd-4288-b83b-d9983589898d admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:08.002902 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba3ba33-97d5-466c-8244-67fe5005168c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:08.002902 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba3ba33-97d5-466c-8244-67fe5005168c service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:08.006711 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45beb23a-49dd-4288-b83b-d9983589898d admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:08.007936 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 800/1586] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:06:08.008739 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3ba33-97d5-466c-8244-67fe5005168c service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:08.011540 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e8c2b-ba85-4d6e-aaee-798db76d3219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:08.012295 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e8c2b-ba85-4d6e-aaee-798db76d3219 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:08.012667 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e8c2b-ba85-4d6e-aaee-798db76d3219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:08.013023 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e8c2b-ba85-4d6e-aaee-798db76d3219 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:08.013776 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881e8c2b-ba85-4d6e-aaee-798db76d3219 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:08.016043 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881e8c2b-ba85-4d6e-aaee-798db76d3219 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:08.018009 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3ba33-97d5-466c-8244-67fe5005168c service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:08.023427 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303dfa9-9d9d-4382-a19a-90e22f2c4fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:08.023886 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303dfa9-9d9d-4382-a19a-90e22f2c4fef admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:08.024258 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303dfa9-9d9d-4382-a19a-90e22f2c4fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:08.024790 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303dfa9-9d9d-4382-a19a-90e22f2c4fef admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:08.025968 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f303dfa9-9d9d-4382-a19a-90e22f2c4fef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:08.027357 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f303dfa9-9d9d-4382-a19a-90e22f2c4fef admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:08.038830 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 801/1587] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:08.039644 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303dfa9-9d9d-4382-a19a-90e22f2c4fef admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:08.051457 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303dfa9-9d9d-4382-a19a-90e22f2c4fef admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:08.055993 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b900f3-3ad1-4905-ae72-6b23e4f31073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:08.056636 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b900f3-3ad1-4905-ae72-6b23e4f31073 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:08.056926 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b900f3-3ad1-4905-ae72-6b23e4f31073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:08.057347 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b900f3-3ad1-4905-ae72-6b23e4f31073 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:08.058055 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b900f3-3ad1-4905-ae72-6b23e4f31073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:08.059802 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b900f3-3ad1-4905-ae72-6b23e4f31073 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:08.069451 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 802/1588] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:08.070215 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b900f3-3ad1-4905-ae72-6b23e4f31073 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:08.080559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b900f3-3ad1-4905-ae72-6b23e4f31073 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:08.085344 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a2fa5-8c33-46d3-a9ff-1cb6a896698c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:08.085973 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a2fa5-8c33-46d3-a9ff-1cb6a896698c admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:08.086263 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a2fa5-8c33-46d3-a9ff-1cb6a896698c admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:08.086546 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a2fa5-8c33-46d3-a9ff-1cb6a896698c admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:08.087248 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a2fa5-8c33-46d3-a9ff-1cb6a896698c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:08.088823 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a2fa5-8c33-46d3-a9ff-1cb6a896698c admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:08.099737 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 803/1589] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:08.100543 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a2fa5-8c33-46d3-a9ff-1cb6a896698c admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:08.103881 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:08.110924 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a2fa5-8c33-46d3-a9ff-1cb6a896698c admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:08.111081 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 787/1590] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:06:07 2022] POST /identity/v3/users => generated 296 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:08.114554 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e8c2b-ba85-4d6e-aaee-798db76d3219 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:08.115388 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde0dfe-f2c9-4b44-ae89-96b98f41b92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:08.116074 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde0dfe-f2c9-4b44-ae89-96b98f41b92a admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:08.116366 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde0dfe-f2c9-4b44-ae89-96b98f41b92a admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:08.116648 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde0dfe-f2c9-4b44-ae89-96b98f41b92a admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:08.117367 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bde0dfe-f2c9-4b44-ae89-96b98f41b92a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:08.118970 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bde0dfe-f2c9-4b44-ae89-96b98f41b92a admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:08.125668 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e8c2b-ba85-4d6e-aaee-798db76d3219 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:08.130455 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 804/1591] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:08.130455 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde0dfe-f2c9-4b44-ae89-96b98f41b92a admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:08.132267 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae090e5-faba-486b-a3e1-4ed26a6121b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:08.133122 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae090e5-faba-486b-a3e1-4ed26a6121b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:08.133417 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae090e5-faba-486b-a3e1-4ed26a6121b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:08.133702 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae090e5-faba-486b-a3e1-4ed26a6121b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:08.134438 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae090e5-faba-486b-a3e1-4ed26a6121b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:08.136229 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae090e5-faba-486b-a3e1-4ed26a6121b9 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:08.144138 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde0dfe-f2c9-4b44-ae89-96b98f41b92a admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:08.149037 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ced88-e7b6-455f-beae-76128999ef1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:08.149734 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ced88-e7b6-455f-beae-76128999ef1d admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:08.150031 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ced88-e7b6-455f-beae-76128999ef1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:08.150678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ced88-e7b6-455f-beae-76128999ef1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:08.151146 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0ced88-e7b6-455f-beae-76128999ef1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:08.152122 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 788/1592] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:08.154070 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0ced88-e7b6-455f-beae-76128999ef1d admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:08.154193 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae090e5-faba-486b-a3e1-4ed26a6121b9 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:08.167302 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 805/1593] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:08.167518 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae090e5-faba-486b-a3e1-4ed26a6121b9 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:08.167617 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ced88-e7b6-455f-beae-76128999ef1d admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:08.171234 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48714cd6-a3f9-465e-999c-e2c8bfbd37d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:08.171916 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48714cd6-a3f9-465e-999c-e2c8bfbd37d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:08.173254 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48714cd6-a3f9-465e-999c-e2c8bfbd37d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:08.173723 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48714cd6-a3f9-465e-999c-e2c8bfbd37d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:08.174471 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48714cd6-a3f9-465e-999c-e2c8bfbd37d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:08.177153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48714cd6-a3f9-465e-999c-e2c8bfbd37d4 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:08.181111 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ced88-e7b6-455f-beae-76128999ef1d admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:08.187269 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3034e97-f9ba-4f7b-b0b0-458b7152a0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:08.188368 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3034e97-f9ba-4f7b-b0b0-458b7152a0dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:08.188797 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3034e97-f9ba-4f7b-b0b0-458b7152a0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:08.189304 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3034e97-f9ba-4f7b-b0b0-458b7152a0dc admin admin] PATH_INFO: `/v3/projects/c0c24689b9624724a37196b7dd3ced5f/users/5e6e3be3b9a34602979a701110c53fa1/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:08.192862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 789/1594] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:08.192862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48714cd6-a3f9-465e-999c-e2c8bfbd37d4 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:08.203521 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48714cd6-a3f9-465e-999c-e2c8bfbd37d4 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:08.208727 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3034e97-f9ba-4f7b-b0b0-458b7152a0dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0c24689b9624724a37196b7dd3ced5f, user_id=5e6e3be3b9a34602979a701110c53fa1, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:08.209049 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0502e43-6224-40a7-8dc2-bb8ed6634314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:08.210127 dv-cinder-849022-2-smb devstack@keystone.service[80375]: WARNING py.warnings [None req-c3034e97-f9ba-4f7b-b0b0-458b7152a0dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 21:06:08.210127 dv-cinder-849022-2-smb devstack@keystone.service[80375]: warnings.warn(msg) Jul 11 21:06:08.210127 dv-cinder-849022-2-smb devstack@keystone.service[80375]: Jul 11 21:06:08.210453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0502e43-6224-40a7-8dc2-bb8ed6634314 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:08.210725 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0502e43-6224-40a7-8dc2-bb8ed6634314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:08.211069 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0502e43-6224-40a7-8dc2-bb8ed6634314 admin admin] PATH_INFO: `/v3/projects/f14a2a00a1f741c28eb294f2631b9a6f/users/6eafda35315b4bf4b559bbea445aaae5/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:08.212484 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3034e97-f9ba-4f7b-b0b0-458b7152a0dc admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:08.226664 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0502e43-6224-40a7-8dc2-bb8ed6634314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f14a2a00a1f741c28eb294f2631b9a6f, user_id=6eafda35315b4bf4b559bbea445aaae5, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:08.229322 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0502e43-6224-40a7-8dc2-bb8ed6634314 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:08.295347 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 806/1595] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:06:08 2022] PUT /identity/v3/projects/c0c24689b9624724a37196b7dd3ced5f/users/5e6e3be3b9a34602979a701110c53fa1/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:08.296227 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3034e97-f9ba-4f7b-b0b0-458b7152a0dc admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:08.323951 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 790/1596] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:06:08 2022] PUT /identity/v3/projects/f14a2a00a1f741c28eb294f2631b9a6f/users/6eafda35315b4bf4b559bbea445aaae5/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:08.327748 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0502e43-6224-40a7-8dc2-bb8ed6634314 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:08.374942 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:08.386618 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3034e97-f9ba-4f7b-b0b0-458b7152a0dc admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:08.412241 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0502e43-6224-40a7-8dc2-bb8ed6634314 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:08.417914 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c62683-0333-40f6-9dfa-4b1411a23094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:08.419382 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c62683-0333-40f6-9dfa-4b1411a23094 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:08.419780 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c62683-0333-40f6-9dfa-4b1411a23094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:08.420159 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c62683-0333-40f6-9dfa-4b1411a23094 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:08.421055 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c62683-0333-40f6-9dfa-4b1411a23094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:08.422675 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c62683-0333-40f6-9dfa-4b1411a23094 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:08.434585 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 791/1597] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:08.435282 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c62683-0333-40f6-9dfa-4b1411a23094 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:08.445749 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c62683-0333-40f6-9dfa-4b1411a23094 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:08.451519 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b32f6-fa3a-40b3-93e6-bba5ea0609dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:08.452452 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b32f6-fa3a-40b3-93e6-bba5ea0609dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:08.452738 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b32f6-fa3a-40b3-93e6-bba5ea0609dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:08.453026 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b32f6-fa3a-40b3-93e6-bba5ea0609dc admin admin] PATH_INFO: `/v3/projects/1240d0b0448d46ee93554e14279ac41d/users/d5840212e5c24ee4aa61d74126b41858/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:08.453138 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ec753-14e1-423a-888b-a08fb83dae0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:08.453977 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ec753-14e1-423a-888b-a08fb83dae0e admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:08.454410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ec753-14e1-423a-888b-a08fb83dae0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:08.454698 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ec753-14e1-423a-888b-a08fb83dae0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:08.455657 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ec753-14e1-423a-888b-a08fb83dae0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:08.457269 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ec753-14e1-423a-888b-a08fb83dae0e admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:08.467383 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 807/1598] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:08.468212 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ec753-14e1-423a-888b-a08fb83dae0e admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:08.471243 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b32f6-fa3a-40b3-93e6-bba5ea0609dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1240d0b0448d46ee93554e14279ac41d, user_id=d5840212e5c24ee4aa61d74126b41858, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:08.474123 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b32f6-fa3a-40b3-93e6-bba5ea0609dc admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:08.477606 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ec753-14e1-423a-888b-a08fb83dae0e admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:08.483694 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f935e-3ca7-441c-ae05-8d0670d101a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:08.484391 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f935e-3ca7-441c-ae05-8d0670d101a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:08.484708 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f935e-3ca7-441c-ae05-8d0670d101a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:08.484994 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f935e-3ca7-441c-ae05-8d0670d101a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:08.485764 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f935e-3ca7-441c-ae05-8d0670d101a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:08.487366 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f935e-3ca7-441c-ae05-8d0670d101a9 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:08.498188 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 808/1599] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:08.498937 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f935e-3ca7-441c-ae05-8d0670d101a9 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:08.508472 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f935e-3ca7-441c-ae05-8d0670d101a9 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:08.513235 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e52ad-237b-46ad-8ce8-91c5aafc61eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:08.514351 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e52ad-237b-46ad-8ce8-91c5aafc61eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:08.514983 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e52ad-237b-46ad-8ce8-91c5aafc61eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:08.515268 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e52ad-237b-46ad-8ce8-91c5aafc61eb admin admin] PATH_INFO: `/v3/projects/10106cf84dd34d8c8f514193601e18b4/users/d90c507f58f4468ca8f7b021977eddb3/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:08.531848 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e52ad-237b-46ad-8ce8-91c5aafc61eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=10106cf84dd34d8c8f514193601e18b4, user_id=d90c507f58f4468ca8f7b021977eddb3, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:08.534811 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e52ad-237b-46ad-8ce8-91c5aafc61eb admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:08.541281 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 792/1600] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:06:08 2022] PUT /identity/v3/projects/1240d0b0448d46ee93554e14279ac41d/users/d5840212e5c24ee4aa61d74126b41858/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:08.542751 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e4020-53d3-4eb1-b881-286def46596a None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:08.543589 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e4020-53d3-4eb1-b881-286def46596a None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:08.543944 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e4020-53d3-4eb1-b881-286def46596a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:08.574175 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-635e4020-53d3-4eb1-b881-286def46596a None None] MFA Rules not processed for user `5e6e3be3b9a34602979a701110c53fa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:08.575785 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-635e4020-53d3-4eb1-b881-286def46596a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:08.636102 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 809/1601] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:06:08 2022] PUT /identity/v3/projects/10106cf84dd34d8c8f514193601e18b4/users/d90c507f58f4468ca8f7b021977eddb3/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:08.640197 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf7ec9-d781-42ce-aae9-2badb4bb6949 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:08.640197 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf7ec9-d781-42ce-aae9-2badb4bb6949 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:08.640197 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf7ec9-d781-42ce-aae9-2badb4bb6949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:08.663120 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 793/1602] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:08 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:08.664216 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e4020-53d3-4eb1-b881-286def46596a None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:08.676088 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-93bf7ec9-d781-42ce-aae9-2badb4bb6949 None None] MFA Rules not processed for user `6eafda35315b4bf4b559bbea445aaae5`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:08.677546 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-93bf7ec9-d781-42ce-aae9-2badb4bb6949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:08.681015 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:08.735384 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e4020-53d3-4eb1-b881-286def46596a None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:08.749247 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 810/1603] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:08.750086 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf7ec9-d781-42ce-aae9-2badb4bb6949 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:08.811294 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50871aa6-4c19-422b-b3a8-21b660be28d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:08.812262 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50871aa6-4c19-422b-b3a8-21b660be28d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:08.812547 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50871aa6-4c19-422b-b3a8-21b660be28d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:08.812855 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50871aa6-4c19-422b-b3a8-21b660be28d1 admin admin] PATH_INFO: `/v3/projects/2625cd522bf34842b5be2fac16d8dbff/users/6b67d92f0f644bc0861995318d10441c/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:08.814392 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:08.827683 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf7ec9-d781-42ce-aae9-2badb4bb6949 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:08.828321 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50871aa6-4c19-422b-b3a8-21b660be28d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2625cd522bf34842b5be2fac16d8dbff, user_id=6b67d92f0f644bc0861995318d10441c, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:08.831430 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50871aa6-4c19-422b-b3a8-21b660be28d1 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:08.834098 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e0553-1d5e-4801-9014-9882895ec2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:08.834912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e0553-1d5e-4801-9014-9882895ec2d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:08.835307 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e0553-1d5e-4801-9014-9882895ec2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:08.835697 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e0553-1d5e-4801-9014-9882895ec2d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:08.836672 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e0553-1d5e-4801-9014-9882895ec2d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:08.838401 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e0553-1d5e-4801-9014-9882895ec2d9 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:08.850117 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 811/1604] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:08.851149 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e0553-1d5e-4801-9014-9882895ec2d9 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:08.862271 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e0553-1d5e-4801-9014-9882895ec2d9 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:08.866832 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca20b981-6ec0-442b-b3f4-100e61e7e6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:08.869148 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20b981-6ec0-442b-b3f4-100e61e7e6b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:08.869148 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20b981-6ec0-442b-b3f4-100e61e7e6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:08.869148 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20b981-6ec0-442b-b3f4-100e61e7e6b9 admin admin] PATH_INFO: `/v3/projects/0d64562344e44802a06d533da2c765fd/users/1c19d61152474a0bb1e373a9ce0310bc/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:08.884550 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca20b981-6ec0-442b-b3f4-100e61e7e6b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d64562344e44802a06d533da2c765fd, user_id=1c19d61152474a0bb1e373a9ce0310bc, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:08.888035 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca20b981-6ec0-442b-b3f4-100e61e7e6b9 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:08.923258 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 794/1605] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:06:08 2022] PUT /identity/v3/projects/2625cd522bf34842b5be2fac16d8dbff/users/6b67d92f0f644bc0861995318d10441c/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:08.924623 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6491eda-a7f0-4a84-9211-d6336c592b32 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:08.924918 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6491eda-a7f0-4a84-9211-d6336c592b32 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:08.925200 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6491eda-a7f0-4a84-9211-d6336c592b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:08.952036 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-b6491eda-a7f0-4a84-9211-d6336c592b32 None None] MFA Rules not processed for user `d5840212e5c24ee4aa61d74126b41858`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:08.953293 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b6491eda-a7f0-4a84-9211-d6336c592b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:08.998534 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 812/1606] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:06:08 2022] PUT /identity/v3/projects/0d64562344e44802a06d533da2c765fd/users/1c19d61152474a0bb1e373a9ce0310bc/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:09.000329 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb0b3a-ddfa-46ab-8d81-cfc92e1bf694 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:09.000895 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb0b3a-ddfa-46ab-8d81-cfc92e1bf694 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:09.001190 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb0b3a-ddfa-46ab-8d81-cfc92e1bf694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:09.026639 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-26cb0b3a-ddfa-46ab-8d81-cfc92e1bf694 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:09.026639 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-26cb0b3a-ddfa-46ab-8d81-cfc92e1bf694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:09.029533 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 795/1607] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:09.030650 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6491eda-a7f0-4a84-9211-d6336c592b32 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:09.067124 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:09.088123 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 813/1608] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:09.089772 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5a283-e348-4b04-bb48-2b0d64098490 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:09.090188 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5a283-e348-4b04-bb48-2b0d64098490 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:09.090528 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba5a283-e348-4b04-bb48-2b0d64098490 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:09.092289 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 814/1609] 10.222.0.40 () {54 vars in 961 bytes} [Mon Jul 11 21:06:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 21:06:09.092621 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba5a283-e348-4b04-bb48-2b0d64098490 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:09.096396 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6491eda-a7f0-4a84-9211-d6336c592b32 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:09.101392 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd06a4b6-c5a9-44bd-a803-70d577ea6c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:09.102066 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06a4b6-c5a9-44bd-a803-70d577ea6c5f admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:09.102357 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06a4b6-c5a9-44bd-a803-70d577ea6c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:09.102632 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06a4b6-c5a9-44bd-a803-70d577ea6c5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:09.103331 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd06a4b6-c5a9-44bd-a803-70d577ea6c5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:09.105309 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd06a4b6-c5a9-44bd-a803-70d577ea6c5f admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:09.106472 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba5a283-e348-4b04-bb48-2b0d64098490 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:09.111249 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409db4c5-0d21-434f-a207-c4937a751814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:09.112191 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409db4c5-0d21-434f-a207-c4937a751814 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:09.112531 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409db4c5-0d21-434f-a207-c4937a751814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:09.112753 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409db4c5-0d21-434f-a207-c4937a751814 admin admin] PATH_INFO: `/v3/projects/79eb7f97891749029266ad3b96d75866/users/01541b7e5e984884bf87ef6d31b9480c/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:09.127192 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409db4c5-0d21-434f-a207-c4937a751814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79eb7f97891749029266ad3b96d75866, user_id=01541b7e5e984884bf87ef6d31b9480c, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:09.129884 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409db4c5-0d21-434f-a207-c4937a751814 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:09.195412 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 796/1610] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:06:09 2022] POST /identity/v3/projects => generated 363 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:09.196806 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaad8fc-7e06-4dfa-a25c-ad5114dff4f5 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:09.197155 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaad8fc-7e06-4dfa-a25c-ad5114dff4f5 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:09.197495 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaad8fc-7e06-4dfa-a25c-ad5114dff4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:09.213942 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-aaaad8fc-7e06-4dfa-a25c-ad5114dff4f5 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:09.215724 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-aaaad8fc-7e06-4dfa-a25c-ad5114dff4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:09.245662 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 815/1611] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:06:09 2022] PUT /identity/v3/projects/79eb7f97891749029266ad3b96d75866/users/01541b7e5e984884bf87ef6d31b9480c/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:09.247845 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366d448-9ffb-4e29-b2d4-67be4b8e8c89 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:09.248337 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366d448-9ffb-4e29-b2d4-67be4b8e8c89 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:09.248770 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366d448-9ffb-4e29-b2d4-67be4b8e8c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:09.267066 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-4366d448-9ffb-4e29-b2d4-67be4b8e8c89 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:09.268492 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-4366d448-9ffb-4e29-b2d4-67be4b8e8c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:09.275333 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 797/1612] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:09.275333 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaad8fc-7e06-4dfa-a25c-ad5114dff4f5 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:09.293443 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaad8fc-7e06-4dfa-a25c-ad5114dff4f5 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:09.337377 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 816/1613] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:09.339479 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e9e00-96cc-43d4-a13a-d3b7f926a823 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:09.340805 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e9e00-96cc-43d4-a13a-d3b7f926a823 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:09.341414 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e9e00-96cc-43d4-a13a-d3b7f926a823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:09.358638 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0f86f-18a7-4e02-b497-e564e14e5d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:09.359327 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0f86f-18a7-4e02-b497-e564e14e5d7e admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:09.359612 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0f86f-18a7-4e02-b497-e564e14e5d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:09.359895 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0f86f-18a7-4e02-b497-e564e14e5d7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:09.360625 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0f86f-18a7-4e02-b497-e564e14e5d7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:09.362519 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0f86f-18a7-4e02-b497-e564e14e5d7e admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:09.391155 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-fe3e9e00-96cc-43d4-a13a-d3b7f926a823 None None] MFA Rules not processed for user `8ac15411c75f4bd4a86f6753c9240a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:09.392482 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-fe3e9e00-96cc-43d4-a13a-d3b7f926a823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:09.414581 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:09.461279 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 817/1614] 10.222.0.40 () {58 vars in 1058 bytes} [Mon Jul 11 21:06:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:09.461993 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e9e00-96cc-43d4-a13a-d3b7f926a823 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:09.463278 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-fe3e9e00-96cc-43d4-a13a-d3b7f926a823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:09.473455 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 798/1615] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:06:09 2022] POST /identity/v3/projects => generated 387 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:09.474850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0f86f-18a7-4e02-b497-e564e14e5d7e admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:09.529756 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:09.547321 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e9e00-96cc-43d4-a13a-d3b7f926a823 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:09.554365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0f86f-18a7-4e02-b497-e564e14e5d7e admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:09.560403 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5472f-9fef-4d62-a089-681288fca6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:09.564998 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5472f-9fef-4d62-a089-681288fca6e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:09.564998 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5472f-9fef-4d62-a089-681288fca6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:09.564998 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5472f-9fef-4d62-a089-681288fca6e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:09.564998 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe5472f-9fef-4d62-a089-681288fca6e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:09.564998 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe5472f-9fef-4d62-a089-681288fca6e1 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:09.612569 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d66ae-c66b-4093-b5d0-0bfde53f8113 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:09.613383 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d66ae-c66b-4093-b5d0-0bfde53f8113 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:09.613736 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d66ae-c66b-4093-b5d0-0bfde53f8113 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:09.614026 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d66ae-c66b-4093-b5d0-0bfde53f8113 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:09.628134 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46d66ae-c66b-4093-b5d0-0bfde53f8113 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:09.628134 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46d66ae-c66b-4093-b5d0-0bfde53f8113 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:09.636865 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 818/1616] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:06:09.638422 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f95889-dbe8-429b-a971-6759d4d63fc2 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:09.638898 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f95889-dbe8-429b-a971-6759d4d63fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:09.638898 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f95889-dbe8-429b-a971-6759d4d63fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:09.668058 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-a0f95889-dbe8-429b-a971-6759d4d63fc2 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:09.672210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 799/1617] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:06:09 2022] POST /identity/v3/users => generated 288 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:09.672415 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a0f95889-dbe8-429b-a971-6759d4d63fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:09.672520 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5472f-9fef-4d62-a089-681288fca6e1 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:09.680538 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 819/1618] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:09.681623 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f95889-dbe8-429b-a971-6759d4d63fc2 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:09.683003 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5472f-9fef-4d62-a089-681288fca6e1 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:09.693000 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a68252-7db7-46ba-9307-3c4cfee450da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:09.693908 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a68252-7db7-46ba-9307-3c4cfee450da service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:09.694309 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a68252-7db7-46ba-9307-3c4cfee450da service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:09.694842 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a68252-7db7-46ba-9307-3c4cfee450da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:09.700340 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f95889-dbe8-429b-a971-6759d4d63fc2 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:09.706789 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494130ee-fce8-431a-8be3-75018135da7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:09.708389 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494130ee-fce8-431a-8be3-75018135da7c service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:09.708723 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a68252-7db7-46ba-9307-3c4cfee450da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:09.709030 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494130ee-fce8-431a-8be3-75018135da7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:09.709673 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494130ee-fce8-431a-8be3-75018135da7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:09.710433 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a68252-7db7-46ba-9307-3c4cfee450da service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:09.726089 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494130ee-fce8-431a-8be3-75018135da7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:09.728974 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494130ee-fce8-431a-8be3-75018135da7c service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:09.731499 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 800/1619] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:06:09.744096 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a68252-7db7-46ba-9307-3c4cfee450da service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:09.750976 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 820/1620] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:06:09.752467 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494130ee-fce8-431a-8be3-75018135da7c service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:09.773219 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494130ee-fce8-431a-8be3-75018135da7c service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:09.783212 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9fda8-fb1d-433d-9108-91aa41f113df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:09.784901 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9fda8-fb1d-433d-9108-91aa41f113df admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:09.785504 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9fda8-fb1d-433d-9108-91aa41f113df admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:09.786113 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9fda8-fb1d-433d-9108-91aa41f113df admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:09.788940 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9fda8-fb1d-433d-9108-91aa41f113df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:09.793797 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9fda8-fb1d-433d-9108-91aa41f113df admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:09.916862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a68252-7db7-46ba-9307-3c4cfee450da service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:09.927363 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41799934-f512-41d2-be61-0fd85f7e79e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:09.928499 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41799934-f512-41d2-be61-0fd85f7e79e2 service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:09.929013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41799934-f512-41d2-be61-0fd85f7e79e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:09.929512 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41799934-f512-41d2-be61-0fd85f7e79e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:09.939614 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 821/1621] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:06:09 2022] POST /identity/v3/users => generated 300 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:09.939614 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9fda8-fb1d-433d-9108-91aa41f113df admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:09.947340 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9fda8-fb1d-433d-9108-91aa41f113df admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:09.954530 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a41b1-d894-4c19-abb5-8072ce987efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:09.955327 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a41b1-d894-4c19-abb5-8072ce987efd admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:09.955912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a41b1-d894-4c19-abb5-8072ce987efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:09.956270 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a41b1-d894-4c19-abb5-8072ce987efd admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:09.957029 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a41b1-d894-4c19-abb5-8072ce987efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:09.958651 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a41b1-d894-4c19-abb5-8072ce987efd admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:09.971350 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 822/1622] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:09.974147 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a41b1-d894-4c19-abb5-8072ce987efd admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:10.005149 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a41b1-d894-4c19-abb5-8072ce987efd admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:10.010412 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41799934-f512-41d2-be61-0fd85f7e79e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:10.012962 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41799934-f512-41d2-be61-0fd85f7e79e2 service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:10.016088 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13b6d8-0582-4d87-8879-546756c5927c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:10.017447 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13b6d8-0582-4d87-8879-546756c5927c service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:10.018318 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13b6d8-0582-4d87-8879-546756c5927c service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:10.018833 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13b6d8-0582-4d87-8879-546756c5927c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:10.027246 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 801/1623] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:06:10.029294 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41799934-f512-41d2-be61-0fd85f7e79e2 service nova] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:10.042648 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41799934-f512-41d2-be61-0fd85f7e79e2 service nova] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:10.048813 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4b528-15c0-42a4-b94d-7f553f38d26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:10.049931 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4b528-15c0-42a4-b94d-7f553f38d26a admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:10.050493 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4b528-15c0-42a4-b94d-7f553f38d26a admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:10.050932 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4b528-15c0-42a4-b94d-7f553f38d26a admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:10.052086 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e4b528-15c0-42a4-b94d-7f553f38d26a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:10.054433 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e4b528-15c0-42a4-b94d-7f553f38d26a admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:10.070410 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 802/1624] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:10.071485 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4b528-15c0-42a4-b94d-7f553f38d26a admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:10.084661 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13b6d8-0582-4d87-8879-546756c5927c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:10.087825 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4b528-15c0-42a4-b94d-7f553f38d26a admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:10.088590 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13b6d8-0582-4d87-8879-546756c5927c service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:10.094721 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475c716-762c-482f-9eff-322859bad460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:10.096825 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475c716-762c-482f-9eff-322859bad460 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:10.097519 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475c716-762c-482f-9eff-322859bad460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:10.097811 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475c716-762c-482f-9eff-322859bad460 admin admin] PATH_INFO: `/v3/projects/284749ca251d4543a6bd37c713d86b6f/users/1f3d1464703644b1af00ecfe2e68c973/roles/86273ff072f3438d822e870272491768` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:10.124587 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475c716-762c-482f-9eff-322859bad460 admin admin] RBAC: Authorizing `identity:create_grant(project_id=284749ca251d4543a6bd37c713d86b6f, user_id=1f3d1464703644b1af00ecfe2e68c973, role_id=86273ff072f3438d822e870272491768)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:10.128175 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475c716-762c-482f-9eff-322859bad460 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:10.144442 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 823/1625] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:06:10.146097 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13b6d8-0582-4d87-8879-546756c5927c service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:10.177949 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13b6d8-0582-4d87-8879-546756c5927c service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:10.213898 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70b057-7df5-4ab8-9be8-149484d2109b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:10.216083 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70b057-7df5-4ab8-9be8-149484d2109b admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:10.216604 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70b057-7df5-4ab8-9be8-149484d2109b admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:10.217121 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70b057-7df5-4ab8-9be8-149484d2109b admin admin] PATH_INFO: `/v3/projects/ae49aad42851477c9e171d3fcd8ad998/users/b99b24eba135422cb3270e16b440eb6c/roles/86273ff072f3438d822e870272491768` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:10.231554 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 803/1626] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:06:10 2022] PUT /identity/v3/projects/284749ca251d4543a6bd37c713d86b6f/users/1f3d1464703644b1af00ecfe2e68c973/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:10.237171 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475c716-762c-482f-9eff-322859bad460 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:10.277092 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:10.300385 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:10.315370 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad70b057-7df5-4ab8-9be8-149484d2109b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae49aad42851477c9e171d3fcd8ad998, user_id=b99b24eba135422cb3270e16b440eb6c, role_id=86273ff072f3438d822e870272491768)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:10.328425 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475c716-762c-482f-9eff-322859bad460 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:10.331295 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad70b057-7df5-4ab8-9be8-149484d2109b admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:10.346739 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ebff4b-4b2b-43d5-9ace-2c1667f18036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:10.348550 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebff4b-4b2b-43d5-9ace-2c1667f18036 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:10.350100 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebff4b-4b2b-43d5-9ace-2c1667f18036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:10.351878 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebff4b-4b2b-43d5-9ace-2c1667f18036 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:10.356119 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ebff4b-4b2b-43d5-9ace-2c1667f18036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:10.362220 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ebff4b-4b2b-43d5-9ace-2c1667f18036 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:10.398937 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 804/1627] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:10.406152 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ebff4b-4b2b-43d5-9ace-2c1667f18036 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:10.432150 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ebff4b-4b2b-43d5-9ace-2c1667f18036 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:10.446369 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 824/1628] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:06:10 2022] PUT /identity/v3/projects/ae49aad42851477c9e171d3fcd8ad998/users/b99b24eba135422cb3270e16b440eb6c/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:10.450790 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70b057-7df5-4ab8-9be8-149484d2109b admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:10.614055 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a24ef4-6b18-43e5-9186-2dc8d32c938c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:10.616050 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a24ef4-6b18-43e5-9186-2dc8d32c938c admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:10.616607 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a24ef4-6b18-43e5-9186-2dc8d32c938c admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:10.617154 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a24ef4-6b18-43e5-9186-2dc8d32c938c admin admin] PATH_INFO: `/v3/projects/284749ca251d4543a6bd37c713d86b6f/users/1f3d1464703644b1af00ecfe2e68c973/roles/86273ff072f3438d822e870272491768` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:10.622601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a24ef4-6b18-43e5-9186-2dc8d32c938c admin admin] RBAC: Authorizing `identity:create_grant(project_id=284749ca251d4543a6bd37c713d86b6f, user_id=1f3d1464703644b1af00ecfe2e68c973, role_id=86273ff072f3438d822e870272491768)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:10.624906 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70b057-7df5-4ab8-9be8-149484d2109b admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:10.628996 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a24ef4-6b18-43e5-9186-2dc8d32c938c admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:10.631642 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a9dec5-0991-4e9e-8977-953f4832c1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:10.641984 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9dec5-0991-4e9e-8977-953f4832c1ee admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:10.641984 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9dec5-0991-4e9e-8977-953f4832c1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:10.641984 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9dec5-0991-4e9e-8977-953f4832c1ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:10.641984 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a9dec5-0991-4e9e-8977-953f4832c1ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:10.641984 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a9dec5-0991-4e9e-8977-953f4832c1ee admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:10.665496 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 805/1629] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:06:10 2022] PUT /identity/v3/projects/284749ca251d4543a6bd37c713d86b6f/users/1f3d1464703644b1af00ecfe2e68c973/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:10.665812 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 825/1630] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:10.666010 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15a667-adf5-481e-8240-69d46b3fcd10 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:10.666010 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15a667-adf5-481e-8240-69d46b3fcd10 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:10.666010 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15a667-adf5-481e-8240-69d46b3fcd10 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:10.669124 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 806/1631] 10.222.0.40 () {54 vars in 912 bytes} [Mon Jul 11 21:06:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 21:06:10.682843 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a9dec5-0991-4e9e-8977-953f4832c1ee admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:10.683017 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b40024-8f4a-4c79-b7d3-f3234b7aeb86 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:10.683017 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b40024-8f4a-4c79-b7d3-f3234b7aeb86 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:10.683660 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b40024-8f4a-4c79-b7d3-f3234b7aeb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:10.697761 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a9dec5-0991-4e9e-8977-953f4832c1ee admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:10.732119 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-94b40024-8f4a-4c79-b7d3-f3234b7aeb86 None None] MFA Rules not processed for user `8ac15411c75f4bd4a86f6753c9240a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:10.737012 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-94b40024-8f4a-4c79-b7d3-f3234b7aeb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:10.815295 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f8db5-b4a2-4dc0-a5cb-141bef17547e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:10.816420 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f8db5-b4a2-4dc0-a5cb-141bef17547e admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:10.816708 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f8db5-b4a2-4dc0-a5cb-141bef17547e admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:10.816994 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f8db5-b4a2-4dc0-a5cb-141bef17547e admin admin] PATH_INFO: `/v3/projects/ae49aad42851477c9e171d3fcd8ad998/users/b99b24eba135422cb3270e16b440eb6c/roles/86273ff072f3438d822e870272491768` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:10.828941 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f8db5-b4a2-4dc0-a5cb-141bef17547e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae49aad42851477c9e171d3fcd8ad998, user_id=b99b24eba135422cb3270e16b440eb6c, role_id=86273ff072f3438d822e870272491768)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:10.842629 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f8db5-b4a2-4dc0-a5cb-141bef17547e admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:10.984629 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 826/1632] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:06:10 2022] PUT /identity/v3/projects/ae49aad42851477c9e171d3fcd8ad998/users/b99b24eba135422cb3270e16b440eb6c/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:10.984629 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21893231-096b-4538-a15f-b0ff725e4642 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:10.984629 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21893231-096b-4538-a15f-b0ff725e4642 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:10.984629 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21893231-096b-4538-a15f-b0ff725e4642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:10.999563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 807/1633] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Jul 11 21:06:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:11.001530 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-21893231-096b-4538-a15f-b0ff725e4642 None None] MFA Rules not processed for user `1f3d1464703644b1af00ecfe2e68c973`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:11.003001 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-21893231-096b-4538-a15f-b0ff725e4642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:11.003278 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc668fe8-afbf-4783-a50e-ef0bc3394eb8 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:11.003846 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc668fe8-afbf-4783-a50e-ef0bc3394eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:11.004967 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc668fe8-afbf-4783-a50e-ef0bc3394eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:11.071369 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-dc668fe8-afbf-4783-a50e-ef0bc3394eb8 None None] MFA Rules not processed for user `b99b24eba135422cb3270e16b440eb6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:11.073565 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-dc668fe8-afbf-4783-a50e-ef0bc3394eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:11.143706 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:11.181358 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 827/1634] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:10 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:11.182332 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21893231-096b-4538-a15f-b0ff725e4642 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:11.230174 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:11.241606 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 808/1635] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:10 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:11.241606 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc668fe8-afbf-4783-a50e-ef0bc3394eb8 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:11.312196 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21893231-096b-4538-a15f-b0ff725e4642 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:11.319768 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921cccb2-878b-47f4-88c6-783416b4beb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:11.326834 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cccb2-878b-47f4-88c6-783416b4beb5 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:11.326834 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cccb2-878b-47f4-88c6-783416b4beb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:11.326834 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cccb2-878b-47f4-88c6-783416b4beb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:11.335031 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc668fe8-afbf-4783-a50e-ef0bc3394eb8 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:11.339761 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c0992-dece-4c42-ae39-068d728f404d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:11.341376 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c0992-dece-4c42-ae39-068d728f404d service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:11.341737 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c0992-dece-4c42-ae39-068d728f404d service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:11.342231 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c0992-dece-4c42-ae39-068d728f404d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:11.354147 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c0992-dece-4c42-ae39-068d728f404d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:11.356800 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c0992-dece-4c42-ae39-068d728f404d service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:11.369689 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 809/1636] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:11 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:06:11.423113 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921cccb2-878b-47f4-88c6-783416b4beb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:11.425688 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921cccb2-878b-47f4-88c6-783416b4beb5 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:11.440646 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 828/1637] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:06:11.493287 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c0992-dece-4c42-ae39-068d728f404d service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:11.502340 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c0992-dece-4c42-ae39-068d728f404d service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:11.506590 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04cd5df-f081-4a7a-8d94-90c844a96f4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:11.507379 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04cd5df-f081-4a7a-8d94-90c844a96f4d service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:11.507779 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04cd5df-f081-4a7a-8d94-90c844a96f4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:11.508184 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04cd5df-f081-4a7a-8d94-90c844a96f4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:11.523553 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04cd5df-f081-4a7a-8d94-90c844a96f4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:11.525619 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04cd5df-f081-4a7a-8d94-90c844a96f4d service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:11.554631 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 810/1638] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:11 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:06:11.612094 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921cccb2-878b-47f4-88c6-783416b4beb5 service cinder] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:11.809729 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921cccb2-878b-47f4-88c6-783416b4beb5 service cinder] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:11.818058 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56559e-6e3e-43b4-8283-2c5aa91d697e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:11.818964 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56559e-6e3e-43b4-8283-2c5aa91d697e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:11.819248 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56559e-6e3e-43b4-8283-2c5aa91d697e admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:11.820297 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56559e-6e3e-43b4-8283-2c5aa91d697e admin admin] PATH_INFO: `/v3/users/d5840212e5c24ee4aa61d74126b41858` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:11.824902 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a56559e-6e3e-43b4-8283-2c5aa91d697e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5840212e5c24ee4aa61d74126b41858)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:11.828184 dv-cinder-849022-2-smb devstack@keystone.service[80375]: WARNING py.warnings [None req-9a56559e-6e3e-43b4-8283-2c5aa91d697e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 21:06:11.828184 dv-cinder-849022-2-smb devstack@keystone.service[80375]: warnings.warn(msg) Jul 11 21:06:11.828184 dv-cinder-849022-2-smb devstack@keystone.service[80375]: Jul 11 21:06:11.833486 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a56559e-6e3e-43b4-8283-2c5aa91d697e admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:11.852032 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04cd5df-f081-4a7a-8d94-90c844a96f4d service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:11.881660 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04cd5df-f081-4a7a-8d94-90c844a96f4d service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:11.894285 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d7987-c873-42d8-8636-6f3ccc8bf467 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:11.897269 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d7987-c873-42d8-8636-6f3ccc8bf467 service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:11.898386 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d7987-c873-42d8-8636-6f3ccc8bf467 service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:11.899460 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d7987-c873-42d8-8636-6f3ccc8bf467 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:12.093169 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d7987-c873-42d8-8636-6f3ccc8bf467 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:12.094304 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d7987-c873-42d8-8636-6f3ccc8bf467 service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:12.106407 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 811/1639] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:11 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:06:12.146949 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e68cb-a027-4d96-911c-80fa8ba083d3 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:12.148093 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e68cb-a027-4d96-911c-80fa8ba083d3 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:12.148393 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e68cb-a027-4d96-911c-80fa8ba083d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:12.200968 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-558e68cb-a027-4d96-911c-80fa8ba083d3 None None] MFA Rules not processed for user `d90c507f58f4468ca8f7b021977eddb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:12.205904 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-558e68cb-a027-4d96-911c-80fa8ba083d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:12.221900 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-9a56559e-6e3e-43b4-8283-2c5aa91d697e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5840212e5c24ee4aa61d74126b41858'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:12.237194 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:12.247997 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-9a56559e-6e3e-43b4-8283-2c5aa91d697e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5840212e5c24ee4aa61d74126b41858'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:12.248810 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-9a56559e-6e3e-43b4-8283-2c5aa91d697e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5840212e5c24ee4aa61d74126b41858'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:12.249408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-9a56559e-6e3e-43b4-8283-2c5aa91d697e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5840212e5c24ee4aa61d74126b41858'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:12.337297 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-9a56559e-6e3e-43b4-8283-2c5aa91d697e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5840212e5c24ee4aa61d74126b41858'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:12.370119 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:12.407775 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 829/1640] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:06:11 2022] DELETE /identity/v3/users/d5840212e5c24ee4aa61d74126b41858 => generated 0 bytes in 806 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:12.411050 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 812/1641] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:12 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:12.412647 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3383dd5-6684-4972-809c-36ff64b69591 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:12.412993 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3383dd5-6684-4972-809c-36ff64b69591 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:12.413996 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e68cb-a027-4d96-911c-80fa8ba083d3 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:12.414884 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3383dd5-6684-4972-809c-36ff64b69591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:12.424315 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-558e68cb-a027-4d96-911c-80fa8ba083d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:12.458847 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e68cb-a027-4d96-911c-80fa8ba083d3 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:12.462708 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-a3383dd5-6684-4972-809c-36ff64b69591 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:12.464322 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a3383dd5-6684-4972-809c-36ff64b69591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:12.594532 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088335d-e4cf-404a-b769-a7b0b6212558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:12.601638 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088335d-e4cf-404a-b769-a7b0b6212558 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:12.601638 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088335d-e4cf-404a-b769-a7b0b6212558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:12.601638 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088335d-e4cf-404a-b769-a7b0b6212558 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:12.601638 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c088335d-e4cf-404a-b769-a7b0b6212558 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:12.601638 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c088335d-e4cf-404a-b769-a7b0b6212558 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:12.604922 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 830/1642] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:12.727803 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3383dd5-6684-4972-809c-36ff64b69591 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:12.732892 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a3383dd5-6684-4972-809c-36ff64b69591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:12.734718 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 813/1643] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:06:12 2022] POST /identity/v3/projects => generated 401 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:12.748618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088335d-e4cf-404a-b769-a7b0b6212558 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:12.848337 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3383dd5-6684-4972-809c-36ff64b69591 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:12.863131 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088335d-e4cf-404a-b769-a7b0b6212558 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:13.147327 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e25a4c-5b9b-40e1-909d-94d7310fe42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:13.147327 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e25a4c-5b9b-40e1-909d-94d7310fe42d admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:13.147327 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e25a4c-5b9b-40e1-909d-94d7310fe42d admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:13.147327 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e25a4c-5b9b-40e1-909d-94d7310fe42d admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:13.152946 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e25a4c-5b9b-40e1-909d-94d7310fe42d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:13.152946 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e25a4c-5b9b-40e1-909d-94d7310fe42d admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:13.155042 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59a881-fe0e-4382-a642-4fd4431fe096 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:13.155042 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59a881-fe0e-4382-a642-4fd4431fe096 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:13.155042 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59a881-fe0e-4382-a642-4fd4431fe096 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:13.155042 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59a881-fe0e-4382-a642-4fd4431fe096 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:13.158532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59a881-fe0e-4382-a642-4fd4431fe096 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:13.158532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59a881-fe0e-4382-a642-4fd4431fe096 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:13.158532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 831/1644] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 21:06:13.159709 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 814/1645] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:06:12 2022] POST /identity/v3/users => generated 307 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:13.164235 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59a881-fe0e-4382-a642-4fd4431fe096 service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:13.164235 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59a881-fe0e-4382-a642-4fd4431fe096 service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:13.164235 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3bfcb-4af1-4f86-a5fe-027156714773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:13.164235 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3bfcb-4af1-4f86-a5fe-027156714773 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:13.164729 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3bfcb-4af1-4f86-a5fe-027156714773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:13.164729 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3bfcb-4af1-4f86-a5fe-027156714773 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:13.164729 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac3bfcb-4af1-4f86-a5fe-027156714773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:13.164729 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac3bfcb-4af1-4f86-a5fe-027156714773 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:13.172408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 832/1646] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:13.176111 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e25a4c-5b9b-40e1-909d-94d7310fe42d admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:13.206254 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e25a4c-5b9b-40e1-909d-94d7310fe42d admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:13.219512 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8871f1e-9ff7-457e-b448-ba26789fdcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:13.220786 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8871f1e-9ff7-457e-b448-ba26789fdcbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:13.221077 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8871f1e-9ff7-457e-b448-ba26789fdcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:13.221364 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8871f1e-9ff7-457e-b448-ba26789fdcbe admin admin] PATH_INFO: `/v3/projects/1ccd12be61034571ba9e720e809809a6/users/6fe4ceabd9684405bedc977b7fd64e7b/roles/86273ff072f3438d822e870272491768` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:13.242020 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8871f1e-9ff7-457e-b448-ba26789fdcbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ccd12be61034571ba9e720e809809a6, user_id=6fe4ceabd9684405bedc977b7fd64e7b, role_id=86273ff072f3438d822e870272491768)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:13.246951 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8871f1e-9ff7-457e-b448-ba26789fdcbe admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:13.328351 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 815/1647] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:06:13 2022] PUT /identity/v3/projects/1ccd12be61034571ba9e720e809809a6/users/6fe4ceabd9684405bedc977b7fd64e7b/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:13.332470 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3bfcb-4af1-4f86-a5fe-027156714773 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:13.350953 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc88be-0aa2-4430-ae48-7143e88da3f6 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:13.351252 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc88be-0aa2-4430-ae48-7143e88da3f6 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:13.351860 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc88be-0aa2-4430-ae48-7143e88da3f6 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:13.353723 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 816/1648] 10.222.0.40 () {54 vars in 961 bytes} [Mon Jul 11 21:06:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 21:06:13.353830 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3bfcb-4af1-4f86-a5fe-027156714773 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:13.362848 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71847bf9-3218-4964-86f3-699112cd1f00 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:13.363196 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71847bf9-3218-4964-86f3-699112cd1f00 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:13.363466 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71847bf9-3218-4964-86f3-699112cd1f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:13.401460 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:13.418499 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-71847bf9-3218-4964-86f3-699112cd1f00 None None] MFA Rules not processed for user `8ac15411c75f4bd4a86f6753c9240a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:13.419829 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-71847bf9-3218-4964-86f3-699112cd1f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:13.517898 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:13.528942 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d7dc4-f098-4b06-80ad-cdf0fd8dfb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:13.530093 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d7dc4-f098-4b06-80ad-cdf0fd8dfb35 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:13.530568 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d7dc4-f098-4b06-80ad-cdf0fd8dfb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:13.530925 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d7dc4-f098-4b06-80ad-cdf0fd8dfb35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:13.531669 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d7dc4-f098-4b06-80ad-cdf0fd8dfb35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:13.536348 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d7dc4-f098-4b06-80ad-cdf0fd8dfb35 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:13.565067 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 833/1649] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:13.580691 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d7dc4-f098-4b06-80ad-cdf0fd8dfb35 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:13.583893 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 817/1650] 10.222.0.40 () {58 vars in 1058 bytes} [Mon Jul 11 21:06:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:13.589662 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3efaa-df6e-48a4-882e-30df13247a3f None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:13.590349 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3efaa-df6e-48a4-882e-30df13247a3f None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:13.591654 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3efaa-df6e-48a4-882e-30df13247a3f None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:13.594318 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 818/1651] 10.222.0.40 () {54 vars in 912 bytes} [Mon Jul 11 21:06:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 21:06:13.600460 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0eddd-5739-4675-9df1-32d89d92c849 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:13.601053 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0eddd-5739-4675-9df1-32d89d92c849 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:13.601478 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0eddd-5739-4675-9df1-32d89d92c849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:13.608160 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d7dc4-f098-4b06-80ad-cdf0fd8dfb35 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:13.621949 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4c76c-90c0-4ae7-82ae-10e2503c4694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:13.622989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4c76c-90c0-4ae7-82ae-10e2503c4694 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:13.623948 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4c76c-90c0-4ae7-82ae-10e2503c4694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:13.624372 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4c76c-90c0-4ae7-82ae-10e2503c4694 admin admin] PATH_INFO: `/v3/projects/1ccd12be61034571ba9e720e809809a6/users/6fe4ceabd9684405bedc977b7fd64e7b/roles/86273ff072f3438d822e870272491768` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:13.629001 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4c76c-90c0-4ae7-82ae-10e2503c4694 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ccd12be61034571ba9e720e809809a6, user_id=6fe4ceabd9684405bedc977b7fd64e7b, role_id=86273ff072f3438d822e870272491768)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:13.635363 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-c6e0eddd-5739-4675-9df1-32d89d92c849 None None] MFA Rules not processed for user `8ac15411c75f4bd4a86f6753c9240a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:13.635761 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4c76c-90c0-4ae7-82ae-10e2503c4694 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:13.635841 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c6e0eddd-5739-4675-9df1-32d89d92c849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:13.652230 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 819/1653] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Jul 11 21:06:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:13.654206 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 834/1653] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:06:13 2022] PUT /identity/v3/projects/1ccd12be61034571ba9e720e809809a6/users/6fe4ceabd9684405bedc977b7fd64e7b/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:13.666956 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0eddd-5739-4675-9df1-32d89d92c849 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:13.669144 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c6e0eddd-5739-4675-9df1-32d89d92c849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:13.748386 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0eddd-5739-4675-9df1-32d89d92c849 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:13.832538 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a98f0a-23dd-4691-b7d3-d7426d63b902 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:13.833794 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a98f0a-23dd-4691-b7d3-d7426d63b902 service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:13.834336 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a98f0a-23dd-4691-b7d3-d7426d63b902 service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:13.834786 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a98f0a-23dd-4691-b7d3-d7426d63b902 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:13.984459 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a98f0a-23dd-4691-b7d3-d7426d63b902 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:13.985921 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a98f0a-23dd-4691-b7d3-d7426d63b902 service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:14.021871 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 820/1654] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:06:14.151497 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4c76c-90c0-4ae7-82ae-10e2503c4694 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:14.154276 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-23a4c76c-90c0-4ae7-82ae-10e2503c4694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:14.281785 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4c76c-90c0-4ae7-82ae-10e2503c4694 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:14.301570 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32cc0b5-762d-4813-a86b-44f43341b0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:14.303825 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cc0b5-762d-4813-a86b-44f43341b0ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:14.304438 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cc0b5-762d-4813-a86b-44f43341b0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:14.305573 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cc0b5-762d-4813-a86b-44f43341b0ea admin admin] PATH_INFO: `/v3/projects/1240d0b0448d46ee93554e14279ac41d` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:14.310689 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32cc0b5-762d-4813-a86b-44f43341b0ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=1240d0b0448d46ee93554e14279ac41d)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:14.314432 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32cc0b5-762d-4813-a86b-44f43341b0ea admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:14.474138 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a32cc0b5-762d-4813-a86b-44f43341b0ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1240d0b0448d46ee93554e14279ac41d', 'request_id': 'req-a32cc0b5-762d-4813-a86b-44f43341b0ea'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:14.483535 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a32cc0b5-762d-4813-a86b-44f43341b0ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1240d0b0448d46ee93554e14279ac41d', 'request_id': 'req-a32cc0b5-762d-4813-a86b-44f43341b0ea'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:14.493672 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a32cc0b5-762d-4813-a86b-44f43341b0ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1240d0b0448d46ee93554e14279ac41d', 'request_id': 'req-a32cc0b5-762d-4813-a86b-44f43341b0ea'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:14.639027 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a32cc0b5-762d-4813-a86b-44f43341b0ea admin admin] The token cache is being invalidate because project 1240d0b0448d46ee93554e14279ac41d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:06:14.639591 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a32cc0b5-762d-4813-a86b-44f43341b0ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:14.641671 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a32cc0b5-762d-4813-a86b-44f43341b0ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:14.644504 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 835/1655] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:06:14 2022] DELETE /identity/v3/projects/1240d0b0448d46ee93554e14279ac41d => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:14.649537 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a98f0a-23dd-4691-b7d3-d7426d63b902 service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:14.667530 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a98f0a-23dd-4691-b7d3-d7426d63b902 service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:14.854742 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271733a6-a782-408d-b190-49f7a486071e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:14.856062 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271733a6-a782-408d-b190-49f7a486071e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:14.856332 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271733a6-a782-408d-b190-49f7a486071e admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:14.856654 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271733a6-a782-408d-b190-49f7a486071e admin admin] PATH_INFO: `/v3/users/b99b24eba135422cb3270e16b440eb6c` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:14.858373 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271733a6-a782-408d-b190-49f7a486071e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b99b24eba135422cb3270e16b440eb6c)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:14.860650 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271733a6-a782-408d-b190-49f7a486071e admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:15.164345 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-271733a6-a782-408d-b190-49f7a486071e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b99b24eba135422cb3270e16b440eb6c'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:15.182632 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-271733a6-a782-408d-b190-49f7a486071e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b99b24eba135422cb3270e16b440eb6c'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:15.187222 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-271733a6-a782-408d-b190-49f7a486071e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b99b24eba135422cb3270e16b440eb6c'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:15.188237 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-271733a6-a782-408d-b190-49f7a486071e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b99b24eba135422cb3270e16b440eb6c'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:15.311480 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-271733a6-a782-408d-b190-49f7a486071e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b99b24eba135422cb3270e16b440eb6c'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:15.352188 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:15.358202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 821/1656] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:06:14 2022] DELETE /identity/v3/users/b99b24eba135422cb3270e16b440eb6c => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:16.945050 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32cc0b5-762d-4813-a86b-44f43341b0ea admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:16.950518 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a32cc0b5-762d-4813-a86b-44f43341b0ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:16.998181 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32cc0b5-762d-4813-a86b-44f43341b0ea admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:17.066805 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:17.148147 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad101f-ac46-4fb5-ba22-7da496808bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:17.150143 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad101f-ac46-4fb5-ba22-7da496808bd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:17.150434 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad101f-ac46-4fb5-ba22-7da496808bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:17.150718 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad101f-ac46-4fb5-ba22-7da496808bd6 admin admin] PATH_INFO: `/v3/projects/ae49aad42851477c9e171d3fcd8ad998` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:17.153895 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad101f-ac46-4fb5-ba22-7da496808bd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae49aad42851477c9e171d3fcd8ad998)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:17.161613 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad101f-ac46-4fb5-ba22-7da496808bd6 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:17.392771 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-bdad101f-ac46-4fb5-ba22-7da496808bd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae49aad42851477c9e171d3fcd8ad998', 'request_id': 'req-bdad101f-ac46-4fb5-ba22-7da496808bd6'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:17.406481 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-bdad101f-ac46-4fb5-ba22-7da496808bd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae49aad42851477c9e171d3fcd8ad998', 'request_id': 'req-bdad101f-ac46-4fb5-ba22-7da496808bd6'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:17.434431 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-bdad101f-ac46-4fb5-ba22-7da496808bd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae49aad42851477c9e171d3fcd8ad998', 'request_id': 'req-bdad101f-ac46-4fb5-ba22-7da496808bd6'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:18.023961 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-bdad101f-ac46-4fb5-ba22-7da496808bd6 admin admin] The token cache is being invalidate because project ae49aad42851477c9e171d3fcd8ad998 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:06:18.024603 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-bdad101f-ac46-4fb5-ba22-7da496808bd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:18.025194 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-bdad101f-ac46-4fb5-ba22-7da496808bd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:18.032129 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 836/1657] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:06:16 2022] DELETE /identity/v3/projects/ae49aad42851477c9e171d3fcd8ad998 => generated 0 bytes in 1089 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:18.035958 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600b6e5-8771-42e5-9ec3-973df3a845cb None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:18.037415 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600b6e5-8771-42e5-9ec3-973df3a845cb None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:18.038067 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600b6e5-8771-42e5-9ec3-973df3a845cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:18.119573 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-d600b6e5-8771-42e5-9ec3-973df3a845cb None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:18.122630 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d600b6e5-8771-42e5-9ec3-973df3a845cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:18.222153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 822/1658] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:18.231529 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098a9c7-4200-42f5-ad18-4a731fb8dc38 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:18.236774 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098a9c7-4200-42f5-ad18-4a731fb8dc38 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:18.236774 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098a9c7-4200-42f5-ad18-4a731fb8dc38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:18.271189 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-5098a9c7-4200-42f5-ad18-4a731fb8dc38 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:18.272727 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-5098a9c7-4200-42f5-ad18-4a731fb8dc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:18.297290 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 837/1659] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:18.302776 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d600b6e5-8771-42e5-9ec3-973df3a845cb None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:18.316681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d600b6e5-8771-42e5-9ec3-973df3a845cb None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:18.327528 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb55be-7424-4265-a902-3b31ceddc1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:18.328698 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb55be-7424-4265-a902-3b31ceddc1cb admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:18.329364 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb55be-7424-4265-a902-3b31ceddc1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:18.329915 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb55be-7424-4265-a902-3b31ceddc1cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:18.332709 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb55be-7424-4265-a902-3b31ceddc1cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:06:18.333130 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb55be-7424-4265-a902-3b31ceddc1cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:18.337337 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb55be-7424-4265-a902-3b31ceddc1cb admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:18.366543 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 823/1660] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:06:18.372365 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098a9c7-4200-42f5-ad18-4a731fb8dc38 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:18.422098 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098a9c7-4200-42f5-ad18-4a731fb8dc38 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:18.436676 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6060ec7-f645-4119-853e-51a9aced56e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:18.437646 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6060ec7-f645-4119-853e-51a9aced56e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:18.439423 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6060ec7-f645-4119-853e-51a9aced56e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:18.440711 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6060ec7-f645-4119-853e-51a9aced56e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:18.449949 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6060ec7-f645-4119-853e-51a9aced56e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:18.452370 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6060ec7-f645-4119-853e-51a9aced56e1 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:18.607728 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 838/1661] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:06:18 2022] POST /identity/v3/projects => generated 381 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:18.611855 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb55be-7424-4265-a902-3b31ceddc1cb admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:18.627602 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb55be-7424-4265-a902-3b31ceddc1cb admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:18.736437 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:18.870788 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdaba0c-b460-4a38-b94e-d14e3100f38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:18.872052 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdaba0c-b460-4a38-b94e-d14e3100f38d admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:18.872562 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdaba0c-b460-4a38-b94e-d14e3100f38d admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:18.872837 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdaba0c-b460-4a38-b94e-d14e3100f38d admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:18.873570 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdaba0c-b460-4a38-b94e-d14e3100f38d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:18.878625 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdaba0c-b460-4a38-b94e-d14e3100f38d admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:19.001776 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 824/1662] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:06:18 2022] POST /identity/v3/users => generated 291 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:19.006294 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6060ec7-f645-4119-853e-51a9aced56e1 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:19.021666 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6060ec7-f645-4119-853e-51a9aced56e1 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:19.038505 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf179fe-f880-4303-bf02-b32840c7b70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:19.039293 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf179fe-f880-4303-bf02-b32840c7b70c admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:19.039652 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf179fe-f880-4303-bf02-b32840c7b70c admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:19.040048 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf179fe-f880-4303-bf02-b32840c7b70c admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:19.041806 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf179fe-f880-4303-bf02-b32840c7b70c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:19.044295 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf179fe-f880-4303-bf02-b32840c7b70c admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:19.093661 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 839/1663] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:19 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:19.102379 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdaba0c-b460-4a38-b94e-d14e3100f38d admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:19.125181 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdaba0c-b460-4a38-b94e-d14e3100f38d admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:19.125648 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d7e00-6ea4-48c2-a34a-257ff94c5bd1 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:19.126031 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d7e00-6ea4-48c2-a34a-257ff94c5bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:19.126385 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d7e00-6ea4-48c2-a34a-257ff94c5bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:19.137601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec393e-1d40-4a94-bbf9-1ddadfdcc25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:19.138336 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec393e-1d40-4a94-bbf9-1ddadfdcc25c admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:19.142081 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec393e-1d40-4a94-bbf9-1ddadfdcc25c admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:19.142587 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec393e-1d40-4a94-bbf9-1ddadfdcc25c admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:19.144188 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cec393e-1d40-4a94-bbf9-1ddadfdcc25c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:19.145829 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cec393e-1d40-4a94-bbf9-1ddadfdcc25c admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:19.179189 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 825/1664] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:19 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 21:06:19.182266 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec393e-1d40-4a94-bbf9-1ddadfdcc25c admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:19.207935 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec393e-1d40-4a94-bbf9-1ddadfdcc25c admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:19.232725 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30937a8c-0ae7-43bc-9b24-b168e532930c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:19.232725 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30937a8c-0ae7-43bc-9b24-b168e532930c admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:19.232725 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30937a8c-0ae7-43bc-9b24-b168e532930c admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:19.234028 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30937a8c-0ae7-43bc-9b24-b168e532930c admin admin] PATH_INFO: `/v3/projects/7668c642854f423bbaed838b13e44e98/users/589cf6faf1fe4d8fa76ffd7f6e93f580/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:19.239123 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-043d7e00-6ea4-48c2-a34a-257ff94c5bd1 None None] MFA Rules not processed for user `6fe4ceabd9684405bedc977b7fd64e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:19.241821 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-043d7e00-6ea4-48c2-a34a-257ff94c5bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:19.281830 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30937a8c-0ae7-43bc-9b24-b168e532930c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7668c642854f423bbaed838b13e44e98, user_id=589cf6faf1fe4d8fa76ffd7f6e93f580, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:19.287170 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30937a8c-0ae7-43bc-9b24-b168e532930c admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:19.393662 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 826/1665] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:06:19 2022] PUT /identity/v3/projects/7668c642854f423bbaed838b13e44e98/users/589cf6faf1fe4d8fa76ffd7f6e93f580/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:19.414807 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887f9a8-c15a-4531-b651-2f3d4432e8b7 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:19.415448 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887f9a8-c15a-4531-b651-2f3d4432e8b7 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:19.415931 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887f9a8-c15a-4531-b651-2f3d4432e8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:19.484736 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-0887f9a8-c15a-4531-b651-2f3d4432e8b7 None None] MFA Rules not processed for user `589cf6faf1fe4d8fa76ffd7f6e93f580`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:19.491399 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-0887f9a8-c15a-4531-b651-2f3d4432e8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:19.507083 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 840/1666] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:19 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:06:19.738218 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 827/1667] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:06:19.742503 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d7e00-6ea4-48c2-a34a-257ff94c5bd1 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:19.757149 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:19.773347 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d7e00-6ea4-48c2-a34a-257ff94c5bd1 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:19.914051 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07b237-2281-47a1-a8c0-fb3d1456eb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:19.915080 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07b237-2281-47a1-a8c0-fb3d1456eb50 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:19.915080 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07b237-2281-47a1-a8c0-fb3d1456eb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:19.915628 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07b237-2281-47a1-a8c0-fb3d1456eb50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:19.916389 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d07b237-2281-47a1-a8c0-fb3d1456eb50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:19.921527 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d07b237-2281-47a1-a8c0-fb3d1456eb50 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:20.060608 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 841/1668] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:06:19 2022] POST /identity/v3/projects => generated 379 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:20.065169 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0887f9a8-c15a-4531-b651-2f3d4432e8b7 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:20.094535 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0887f9a8-c15a-4531-b651-2f3d4432e8b7 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:20.199222 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560bc02-6609-4288-9f49-abdb17d4a6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:20.200292 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560bc02-6609-4288-9f49-abdb17d4a6cd admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:20.203889 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560bc02-6609-4288-9f49-abdb17d4a6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:20.203889 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560bc02-6609-4288-9f49-abdb17d4a6cd admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:20.203889 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6560bc02-6609-4288-9f49-abdb17d4a6cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:20.204380 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6560bc02-6609-4288-9f49-abdb17d4a6cd admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:20.327071 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 828/1669] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:06:20 2022] POST /identity/v3/users => generated 296 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:20.331235 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07b237-2281-47a1-a8c0-fb3d1456eb50 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:20.342509 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07b237-2281-47a1-a8c0-fb3d1456eb50 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:20.365104 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140a573-c0a4-4814-8259-251b9adfac8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:20.366992 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140a573-c0a4-4814-8259-251b9adfac8a admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:20.369982 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140a573-c0a4-4814-8259-251b9adfac8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:20.370492 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140a573-c0a4-4814-8259-251b9adfac8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:20.372069 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140a573-c0a4-4814-8259-251b9adfac8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:20.374899 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140a573-c0a4-4814-8259-251b9adfac8a admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:20.406832 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 842/1670] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:20.414144 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560bc02-6609-4288-9f49-abdb17d4a6cd admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:20.421805 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:20.440868 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560bc02-6609-4288-9f49-abdb17d4a6cd admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:20.448122 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4bcf75-ed7e-4067-b56c-bef86506e867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:20.450761 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4bcf75-ed7e-4067-b56c-bef86506e867 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:20.450761 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4bcf75-ed7e-4067-b56c-bef86506e867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:20.450761 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4bcf75-ed7e-4067-b56c-bef86506e867 admin admin] PATH_INFO: `/v3/projects/7286fd19a4e04c108e0c3c085476ae29/users/18a5017ff94143c2b441a0d7b0b82a5d/roles/86273ff072f3438d822e870272491768` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:20.493185 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4bcf75-ed7e-4067-b56c-bef86506e867 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7286fd19a4e04c108e0c3c085476ae29, user_id=18a5017ff94143c2b441a0d7b0b82a5d, role_id=86273ff072f3438d822e870272491768)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:20.498140 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4bcf75-ed7e-4067-b56c-bef86506e867 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:20.613313 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 829/1671] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:06:20 2022] PUT /identity/v3/projects/7286fd19a4e04c108e0c3c085476ae29/users/18a5017ff94143c2b441a0d7b0b82a5d/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:20.617287 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140a573-c0a4-4814-8259-251b9adfac8a admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:20.634787 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140a573-c0a4-4814-8259-251b9adfac8a admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:20.814845 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5dfb6-a8cd-4958-9003-6653a6638489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:20.815562 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5dfb6-a8cd-4958-9003-6653a6638489 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:20.815852 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5dfb6-a8cd-4958-9003-6653a6638489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:20.816155 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5dfb6-a8cd-4958-9003-6653a6638489 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:20.819138 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5dfb6-a8cd-4958-9003-6653a6638489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:20.826828 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5dfb6-a8cd-4958-9003-6653a6638489 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:20.850964 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 843/1672] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:20.854947 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4bcf75-ed7e-4067-b56c-bef86506e867 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:20.876675 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4bcf75-ed7e-4067-b56c-bef86506e867 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:20.882244 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5505b-51d9-4e32-afc9-70a6ca65bf87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:20.883409 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5505b-51d9-4e32-afc9-70a6ca65bf87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:20.883770 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5505b-51d9-4e32-afc9-70a6ca65bf87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:20.885067 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5505b-51d9-4e32-afc9-70a6ca65bf87 admin admin] PATH_INFO: `/v3/projects/7286fd19a4e04c108e0c3c085476ae29/users/18a5017ff94143c2b441a0d7b0b82a5d/roles/86273ff072f3438d822e870272491768` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:20.888192 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e5505b-51d9-4e32-afc9-70a6ca65bf87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7286fd19a4e04c108e0c3c085476ae29, user_id=18a5017ff94143c2b441a0d7b0b82a5d, role_id=86273ff072f3438d822e870272491768)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:20.891507 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e5505b-51d9-4e32-afc9-70a6ca65bf87 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:20.908639 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 830/1673] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:06:20 2022] PUT /identity/v3/projects/7286fd19a4e04c108e0c3c085476ae29/users/18a5017ff94143c2b441a0d7b0b82a5d/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:20.919259 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e238d-2114-4945-9caf-18c135bcf573 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:20.919786 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e238d-2114-4945-9caf-18c135bcf573 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:20.920713 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e238d-2114-4945-9caf-18c135bcf573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:20.973725 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-b96e238d-2114-4945-9caf-18c135bcf573 None None] MFA Rules not processed for user `18a5017ff94143c2b441a0d7b0b82a5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:20.976562 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-b96e238d-2114-4945-9caf-18c135bcf573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:21.074525 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5505b-51d9-4e32-afc9-70a6ca65bf87 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:21.076890 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-a7e5505b-51d9-4e32-afc9-70a6ca65bf87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:21.135452 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 844/1674] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:20 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:21.153407 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e238d-2114-4945-9caf-18c135bcf573 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:21.156048 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-b96e238d-2114-4945-9caf-18c135bcf573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:21.211450 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5505b-51d9-4e32-afc9-70a6ca65bf87 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:21.217716 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ae3e1-2daa-4dad-b450-6f84bd812b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:21.218794 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ae3e1-2daa-4dad-b450-6f84bd812b03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:21.219207 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ae3e1-2daa-4dad-b450-6f84bd812b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:21.219726 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ae3e1-2daa-4dad-b450-6f84bd812b03 admin admin] PATH_INFO: `/v3/users/6eafda35315b4bf4b559bbea445aaae5` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:21.221535 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ae3e1-2daa-4dad-b450-6f84bd812b03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eafda35315b4bf4b559bbea445aaae5)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:21.224915 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ae3e1-2daa-4dad-b450-6f84bd812b03 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:21.306031 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e238d-2114-4945-9caf-18c135bcf573 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:21.311554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3bbeca-a456-40fa-96cc-8f0d09a6dd56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:21.312461 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bbeca-a456-40fa-96cc-8f0d09a6dd56 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:21.313037 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bbeca-a456-40fa-96cc-8f0d09a6dd56 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:21.313688 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bbeca-a456-40fa-96cc-8f0d09a6dd56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:21.326092 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3bbeca-a456-40fa-96cc-8f0d09a6dd56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:21.328564 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3bbeca-a456-40fa-96cc-8f0d09a6dd56 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:21.348420 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 845/1675] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:21 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 21:06:21.356424 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21a00d-707a-47f6-a950-77385cf06009 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:21.356975 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21a00d-707a-47f6-a950-77385cf06009 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:21.357077 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21a00d-707a-47f6-a950-77385cf06009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:21.414676 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-ed21a00d-707a-47f6-a950-77385cf06009 None None] MFA Rules not processed for user `979d4af26ce14a2b952908e5ac3062f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:21.419510 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-ed21a00d-707a-47f6-a950-77385cf06009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:21.501252 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-cb4ae3e1-2daa-4dad-b450-6f84bd812b03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eafda35315b4bf4b559bbea445aaae5'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:21.525769 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-cb4ae3e1-2daa-4dad-b450-6f84bd812b03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eafda35315b4bf4b559bbea445aaae5'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:21.527718 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-cb4ae3e1-2daa-4dad-b450-6f84bd812b03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eafda35315b4bf4b559bbea445aaae5'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:21.530199 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-cb4ae3e1-2daa-4dad-b450-6f84bd812b03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eafda35315b4bf4b559bbea445aaae5'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:21.626488 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-cb4ae3e1-2daa-4dad-b450-6f84bd812b03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eafda35315b4bf4b559bbea445aaae5'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:21.672237 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 846/1676] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:21.719820 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf453ec7-7f56-4520-80ab-52dc24d01d80 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:21.720157 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf453ec7-7f56-4520-80ab-52dc24d01d80 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:21.720430 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf453ec7-7f56-4520-80ab-52dc24d01d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:21.736551 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 831/1677] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:06:21 2022] DELETE /identity/v3/users/6eafda35315b4bf4b559bbea445aaae5 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:21.741324 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa45bb-97d9-4d0a-9e28-c2db462428be None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:21.745822 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa45bb-97d9-4d0a-9e28-c2db462428be None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:21.745822 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa45bb-97d9-4d0a-9e28-c2db462428be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:21.791033 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-bf453ec7-7f56-4520-80ab-52dc24d01d80 None None] MFA Rules not processed for user `979d4af26ce14a2b952908e5ac3062f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:21.802309 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-bf453ec7-7f56-4520-80ab-52dc24d01d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:21.805587 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-bcfa45bb-97d9-4d0a-9e28-c2db462428be None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:21.809227 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-bcfa45bb-97d9-4d0a-9e28-c2db462428be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:21.900470 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:21.954710 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:21.958573 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 847/1678] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:21.969738 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf453ec7-7f56-4520-80ab-52dc24d01d80 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:21.972683 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-bf453ec7-7f56-4520-80ab-52dc24d01d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:21.995263 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 832/1679] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:22.024048 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa45bb-97d9-4d0a-9e28-c2db462428be None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:22.026700 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-bcfa45bb-97d9-4d0a-9e28-c2db462428be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:22.143514 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa45bb-97d9-4d0a-9e28-c2db462428be None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:22.152102 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569fa62e-8406-41f1-9de5-c3d9dbb57659 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:22.154409 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fa62e-8406-41f1-9de5-c3d9dbb57659 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:22.156501 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fa62e-8406-41f1-9de5-c3d9dbb57659 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:22.157048 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fa62e-8406-41f1-9de5-c3d9dbb57659 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:22.176941 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf453ec7-7f56-4520-80ab-52dc24d01d80 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:22.180112 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569fa62e-8406-41f1-9de5-c3d9dbb57659 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:22.181676 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569fa62e-8406-41f1-9de5-c3d9dbb57659 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:22.202197 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0afe0-ca60-4fe1-8f23-6d0ee3fe53c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:22.203334 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0afe0-ca60-4fe1-8f23-6d0ee3fe53c7 service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:22.203770 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0afe0-ca60-4fe1-8f23-6d0ee3fe53c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:22.204266 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0afe0-ca60-4fe1-8f23-6d0ee3fe53c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:22.223884 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b0afe0-ca60-4fe1-8f23-6d0ee3fe53c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:22.225829 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b0afe0-ca60-4fe1-8f23-6d0ee3fe53c7 service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:22.232366 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 833/1680] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:06:22.234229 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9682f-7972-441a-8ddb-4b748d999c64 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:22.236673 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9682f-7972-441a-8ddb-4b748d999c64 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:22.237073 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9682f-7972-441a-8ddb-4b748d999c64 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:22.241336 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 848/1681] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 21:06:22.246597 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 834/1682] 10.222.0.40 () {54 vars in 921 bytes} [Mon Jul 11 21:06:22 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 21:06:22.272379 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511836f0-9271-4cca-b018-c196941d0604 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:22.272884 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511836f0-9271-4cca-b018-c196941d0604 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:22.273330 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511836f0-9271-4cca-b018-c196941d0604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:22.322268 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-511836f0-9271-4cca-b018-c196941d0604 None None] MFA Rules not processed for user `177a912380ad43b6a5e31b787a07ce7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:22.323563 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-511836f0-9271-4cca-b018-c196941d0604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:22.442554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 849/1683] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Jul 11 21:06:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:22.458926 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa89f9-b4c2-4e48-b6c8-319986e3bb9e None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:22.460509 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa89f9-b4c2-4e48-b6c8-319986e3bb9e None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:22.460988 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa89f9-b4c2-4e48-b6c8-319986e3bb9e None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:22.462772 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 835/1684] 10.222.0.40 () {54 vars in 960 bytes} [Mon Jul 11 21:06:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 21:06:22.469051 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fbb3f-d9b6-4ff6-808e-d39dc0c3f921 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:22.469384 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fbb3f-d9b6-4ff6-808e-d39dc0c3f921 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:22.469638 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fbb3f-d9b6-4ff6-808e-d39dc0c3f921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:22.504626 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-420fbb3f-d9b6-4ff6-808e-d39dc0c3f921 None None] MFA Rules not processed for user `177a912380ad43b6a5e31b787a07ce7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:22.505127 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-420fbb3f-d9b6-4ff6-808e-d39dc0c3f921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:22.531232 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 850/1685] 10.222.0.40 () {58 vars in 1057 bytes} [Mon Jul 11 21:06:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:22.540890 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa89f9-b4c2-4e48-b6c8-319986e3bb9e None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:22.582496 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa89f9-b4c2-4e48-b6c8-319986e3bb9e None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:22.593478 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966c3a2-1d8a-44d0-be18-1e1189c5a219 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '177a912380ad43b6a5e31b787a07ce7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:22.594430 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966c3a2-1d8a-44d0-be18-1e1189c5a219 service placement] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:22.594888 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966c3a2-1d8a-44d0-be18-1e1189c5a219 service placement] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:22.595404 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966c3a2-1d8a-44d0-be18-1e1189c5a219 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:22.614723 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966c3a2-1d8a-44d0-be18-1e1189c5a219 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:22.618437 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966c3a2-1d8a-44d0-be18-1e1189c5a219 service placement] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:22.646003 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 836/1686] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:06:23.000688 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420fbb3f-d9b6-4ff6-808e-d39dc0c3f921 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:23.002605 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-420fbb3f-d9b6-4ff6-808e-d39dc0c3f921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:23.244803 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420fbb3f-d9b6-4ff6-808e-d39dc0c3f921 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:23.264017 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c44f2-f0c5-447b-9481-313ab137e1dc tempest-VolumeQuotaClassesTest-896164637 tempest-VolumeQuotaClassesTest-896164637-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18a5017ff94143c2b441a0d7b0b82a5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7286fd19a4e04c108e0c3c085476ae29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:23.264295 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c44f2-f0c5-447b-9481-313ab137e1dc tempest-VolumeQuotaClassesTest-896164637 tempest-VolumeQuotaClassesTest-896164637-project-admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:23.264559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c44f2-f0c5-447b-9481-313ab137e1dc tempest-VolumeQuotaClassesTest-896164637 tempest-VolumeQuotaClassesTest-896164637-project-admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:23.265120 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c44f2-f0c5-447b-9481-313ab137e1dc tempest-VolumeQuotaClassesTest-896164637 tempest-VolumeQuotaClassesTest-896164637-project-admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:23.265838 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c44f2-f0c5-447b-9481-313ab137e1dc tempest-VolumeQuotaClassesTest-896164637 tempest-VolumeQuotaClassesTest-896164637-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:06:23.266177 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c44f2-f0c5-447b-9481-313ab137e1dc tempest-VolumeQuotaClassesTest-896164637 tempest-VolumeQuotaClassesTest-896164637-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:23.267835 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c44f2-f0c5-447b-9481-313ab137e1dc tempest-VolumeQuotaClassesTest-896164637 tempest-VolumeQuotaClassesTest-896164637-project-admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:23.295959 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 851/1687] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:06:23.300180 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966c3a2-1d8a-44d0-be18-1e1189c5a219 service placement] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:23.321489 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966c3a2-1d8a-44d0-be18-1e1189c5a219 service placement] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:23.352786 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b2fa23-3e0a-488b-a788-dc34f17f59b1 tempest-VolumeQuotaClassesTest-896164637 tempest-VolumeQuotaClassesTest-896164637-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18a5017ff94143c2b441a0d7b0b82a5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7286fd19a4e04c108e0c3c085476ae29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:23.352786 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2fa23-3e0a-488b-a788-dc34f17f59b1 tempest-VolumeQuotaClassesTest-896164637 tempest-VolumeQuotaClassesTest-896164637-project-admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:23.352786 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2fa23-3e0a-488b-a788-dc34f17f59b1 tempest-VolumeQuotaClassesTest-896164637 tempest-VolumeQuotaClassesTest-896164637-project-admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:23.353036 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2fa23-3e0a-488b-a788-dc34f17f59b1 tempest-VolumeQuotaClassesTest-896164637 tempest-VolumeQuotaClassesTest-896164637-project-admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:23.353036 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b2fa23-3e0a-488b-a788-dc34f17f59b1 tempest-VolumeQuotaClassesTest-896164637 tempest-VolumeQuotaClassesTest-896164637-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:23.367152 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b2fa23-3e0a-488b-a788-dc34f17f59b1 tempest-VolumeQuotaClassesTest-896164637 tempest-VolumeQuotaClassesTest-896164637-project-admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:23.515340 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 837/1688] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:06:23 2022] POST /identity/v3/projects => generated 354 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 21:06:23.519351 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c44f2-f0c5-447b-9481-313ab137e1dc tempest-VolumeQuotaClassesTest-896164637 tempest-VolumeQuotaClassesTest-896164637-project-admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:23.533547 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c44f2-f0c5-447b-9481-313ab137e1dc tempest-VolumeQuotaClassesTest-896164637 tempest-VolumeQuotaClassesTest-896164637-project-admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:23.575955 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41162a26-16e9-4c2c-a6f6-b388cd071c19 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:23.576492 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41162a26-16e9-4c2c-a6f6-b388cd071c19 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:23.586157 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41162a26-16e9-4c2c-a6f6-b388cd071c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:23.634153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-41162a26-16e9-4c2c-a6f6-b388cd071c19 None None] MFA Rules not processed for user `1c19d61152474a0bb1e373a9ce0310bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:23.636175 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-41162a26-16e9-4c2c-a6f6-b388cd071c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:23.685157 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a598167-86d6-4aeb-b092-9eeccc2bf792 tempest-VolumeQuotaClassesTest-896164637 tempest-VolumeQuotaClassesTest-896164637-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18a5017ff94143c2b441a0d7b0b82a5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7286fd19a4e04c108e0c3c085476ae29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:23.685904 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a598167-86d6-4aeb-b092-9eeccc2bf792 tempest-VolumeQuotaClassesTest-896164637 tempest-VolumeQuotaClassesTest-896164637-project-admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:23.686474 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a598167-86d6-4aeb-b092-9eeccc2bf792 tempest-VolumeQuotaClassesTest-896164637 tempest-VolumeQuotaClassesTest-896164637-project-admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:23.686474 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a598167-86d6-4aeb-b092-9eeccc2bf792 tempest-VolumeQuotaClassesTest-896164637 tempest-VolumeQuotaClassesTest-896164637-project-admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:23.691921 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a598167-86d6-4aeb-b092-9eeccc2bf792 tempest-VolumeQuotaClassesTest-896164637 tempest-VolumeQuotaClassesTest-896164637-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:06:23.692296 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a598167-86d6-4aeb-b092-9eeccc2bf792 tempest-VolumeQuotaClassesTest-896164637 tempest-VolumeQuotaClassesTest-896164637-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:23.699984 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a598167-86d6-4aeb-b092-9eeccc2bf792 tempest-VolumeQuotaClassesTest-896164637 tempest-VolumeQuotaClassesTest-896164637-project-admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:23.714208 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:23.765482 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 852/1689] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:06:23.814511 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a598167-86d6-4aeb-b092-9eeccc2bf792 tempest-VolumeQuotaClassesTest-896164637 tempest-VolumeQuotaClassesTest-896164637-project-admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:23.819732 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 838/1690] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:23.825824 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41162a26-16e9-4c2c-a6f6-b388cd071c19 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:23.830151 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-41162a26-16e9-4c2c-a6f6-b388cd071c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:23.832795 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a598167-86d6-4aeb-b092-9eeccc2bf792 tempest-VolumeQuotaClassesTest-896164637 tempest-VolumeQuotaClassesTest-896164637-project-admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:23.843997 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778531d1-a26c-49a1-91ef-75d6a88cd297 tempest-VolumeQuotaClassesTest-896164637 tempest-VolumeQuotaClassesTest-896164637-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18a5017ff94143c2b441a0d7b0b82a5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7286fd19a4e04c108e0c3c085476ae29', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:23.849339 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778531d1-a26c-49a1-91ef-75d6a88cd297 tempest-VolumeQuotaClassesTest-896164637 tempest-VolumeQuotaClassesTest-896164637-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:23.849339 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778531d1-a26c-49a1-91ef-75d6a88cd297 tempest-VolumeQuotaClassesTest-896164637 tempest-VolumeQuotaClassesTest-896164637-project-admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:23.849339 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778531d1-a26c-49a1-91ef-75d6a88cd297 tempest-VolumeQuotaClassesTest-896164637 tempest-VolumeQuotaClassesTest-896164637-project-admin] PATH_INFO: `/v3/projects/dafc533274cb45ca9ae0538a15819ebc` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:23.849339 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778531d1-a26c-49a1-91ef-75d6a88cd297 tempest-VolumeQuotaClassesTest-896164637 tempest-VolumeQuotaClassesTest-896164637-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dafc533274cb45ca9ae0538a15819ebc)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:23.850191 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778531d1-a26c-49a1-91ef-75d6a88cd297 tempest-VolumeQuotaClassesTest-896164637 tempest-VolumeQuotaClassesTest-896164637-project-admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:24.003253 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41162a26-16e9-4c2c-a6f6-b388cd071c19 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:24.014306 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-778531d1-a26c-49a1-91ef-75d6a88cd297 tempest-VolumeQuotaClassesTest-896164637 tempest-VolumeQuotaClassesTest-896164637-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dafc533274cb45ca9ae0538a15819ebc', 'request_id': 'req-778531d1-a26c-49a1-91ef-75d6a88cd297'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:24.052261 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-778531d1-a26c-49a1-91ef-75d6a88cd297 tempest-VolumeQuotaClassesTest-896164637 tempest-VolumeQuotaClassesTest-896164637-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dafc533274cb45ca9ae0538a15819ebc', 'request_id': 'req-778531d1-a26c-49a1-91ef-75d6a88cd297'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:24.064717 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-778531d1-a26c-49a1-91ef-75d6a88cd297 tempest-VolumeQuotaClassesTest-896164637 tempest-VolumeQuotaClassesTest-896164637-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dafc533274cb45ca9ae0538a15819ebc', 'request_id': 'req-778531d1-a26c-49a1-91ef-75d6a88cd297'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:24.153897 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-778531d1-a26c-49a1-91ef-75d6a88cd297 tempest-VolumeQuotaClassesTest-896164637 tempest-VolumeQuotaClassesTest-896164637-project-admin] The token cache is being invalidate because project dafc533274cb45ca9ae0538a15819ebc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:06:24.154248 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-778531d1-a26c-49a1-91ef-75d6a88cd297 tempest-VolumeQuotaClassesTest-896164637 tempest-VolumeQuotaClassesTest-896164637-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:24.154901 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-778531d1-a26c-49a1-91ef-75d6a88cd297 tempest-VolumeQuotaClassesTest-896164637 tempest-VolumeQuotaClassesTest-896164637-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:24.160338 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 853/1691] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:06:23 2022] DELETE /identity/v3/projects/dafc533274cb45ca9ae0538a15819ebc => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:24.161223 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778531d1-a26c-49a1-91ef-75d6a88cd297 tempest-VolumeQuotaClassesTest-896164637 tempest-VolumeQuotaClassesTest-896164637-project-admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:24.162726 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-778531d1-a26c-49a1-91ef-75d6a88cd297 tempest-VolumeQuotaClassesTest-896164637 tempest-VolumeQuotaClassesTest-896164637-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:24.236442 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07450be-83cf-44c2-9289-fa06fcc83d5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:24.239163 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07450be-83cf-44c2-9289-fa06fcc83d5c service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:24.239478 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07450be-83cf-44c2-9289-fa06fcc83d5c service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:24.239818 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07450be-83cf-44c2-9289-fa06fcc83d5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:24.245376 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c07450be-83cf-44c2-9289-fa06fcc83d5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:24.260665 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:24.299826 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778531d1-a26c-49a1-91ef-75d6a88cd297 tempest-VolumeQuotaClassesTest-896164637 tempest-VolumeQuotaClassesTest-896164637-project-admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:24.310300 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76465053-6880-45b7-b4f7-92a029502d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:24.312785 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76465053-6880-45b7-b4f7-92a029502d9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:24.313130 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76465053-6880-45b7-b4f7-92a029502d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:24.313430 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76465053-6880-45b7-b4f7-92a029502d9e admin admin] PATH_INFO: `/v3/users/5e6e3be3b9a34602979a701110c53fa1` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:24.316460 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76465053-6880-45b7-b4f7-92a029502d9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e6e3be3b9a34602979a701110c53fa1)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:24.322772 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76465053-6880-45b7-b4f7-92a029502d9e admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:24.406788 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:24.426701 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07450be-83cf-44c2-9289-fa06fcc83d5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:24.428725 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07450be-83cf-44c2-9289-fa06fcc83d5c service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:24.446108 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 839/1692] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:06:24.640395 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-76465053-6880-45b7-b4f7-92a029502d9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e6e3be3b9a34602979a701110c53fa1'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:24.692074 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-76465053-6880-45b7-b4f7-92a029502d9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e6e3be3b9a34602979a701110c53fa1'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:24.696180 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-76465053-6880-45b7-b4f7-92a029502d9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e6e3be3b9a34602979a701110c53fa1'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:24.696180 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-76465053-6880-45b7-b4f7-92a029502d9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e6e3be3b9a34602979a701110c53fa1'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:24.785453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38264b2f-ffa5-4c8c-9cdb-f34e8b1633c7 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:24.785662 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38264b2f-ffa5-4c8c-9cdb-f34e8b1633c7 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:24.785830 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38264b2f-ffa5-4c8c-9cdb-f34e8b1633c7 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:24.792554 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 840/1693] 10.222.0.40 () {54 vars in 912 bytes} [Mon Jul 11 21:06:24 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 21:06:24.820617 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae107ac7-61fc-43a6-892b-915fc559de1f None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:24.821076 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae107ac7-61fc-43a6-892b-915fc559de1f None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:24.821364 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae107ac7-61fc-43a6-892b-915fc559de1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:24.823154 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-76465053-6880-45b7-b4f7-92a029502d9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e6e3be3b9a34602979a701110c53fa1'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:24.869704 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 854/1694] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:06:24 2022] DELETE /identity/v3/users/5e6e3be3b9a34602979a701110c53fa1 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:24.874148 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c0fcb-0974-40b7-837f-07d70ba7d671 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:24.874718 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c0fcb-0974-40b7-837f-07d70ba7d671 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:24.875299 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c0fcb-0974-40b7-837f-07d70ba7d671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:24.900224 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-948c0fcb-0974-40b7-837f-07d70ba7d671 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:24.901868 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-948c0fcb-0974-40b7-837f-07d70ba7d671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:24.935199 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-ae107ac7-61fc-43a6-892b-915fc559de1f None None] MFA Rules not processed for user `29046b079f1a4f4ea2244e69cbbaa805`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:24.937056 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-ae107ac7-61fc-43a6-892b-915fc559de1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:25.062012 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 841/1695] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Jul 11 21:06:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:06:25.072726 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 855/1696] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:25.089093 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae107ac7-61fc-43a6-892b-915fc559de1f None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:25.089093 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-ae107ac7-61fc-43a6-892b-915fc559de1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:25.095106 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c0fcb-0974-40b7-837f-07d70ba7d671 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:25.096568 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-948c0fcb-0974-40b7-837f-07d70ba7d671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:25.104066 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae107ac7-61fc-43a6-892b-915fc559de1f None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:25.112825 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee151ce-29f7-43aa-ac5e-83b3115f2bc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:25.114853 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee151ce-29f7-43aa-ac5e-83b3115f2bc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:25.115937 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c0fcb-0974-40b7-837f-07d70ba7d671 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:25.116363 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee151ce-29f7-43aa-ac5e-83b3115f2bc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:25.116796 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee151ce-29f7-43aa-ac5e-83b3115f2bc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:25.130231 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284f9b5-ab01-4081-bb7e-b071a1e438be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:25.131134 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284f9b5-ab01-4081-bb7e-b071a1e438be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:25.131581 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284f9b5-ab01-4081-bb7e-b071a1e438be admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:25.131876 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284f9b5-ab01-4081-bb7e-b071a1e438be admin admin] PATH_INFO: `/v3/projects/f14a2a00a1f741c28eb294f2631b9a6f` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:25.134669 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:25.137234 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8284f9b5-ab01-4081-bb7e-b071a1e438be admin admin] RBAC: Authorizing `identity:delete_project(project_id=f14a2a00a1f741c28eb294f2631b9a6f)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:25.138824 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8284f9b5-ab01-4081-bb7e-b071a1e438be admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:25.142648 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee151ce-29f7-43aa-ac5e-83b3115f2bc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:25.146858 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee151ce-29f7-43aa-ac5e-83b3115f2bc7 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:25.199440 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 842/1697] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:06:25.206728 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee151ce-29f7-43aa-ac5e-83b3115f2bc7 service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:25.209306 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-0ee151ce-29f7-43aa-ac5e-83b3115f2bc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:25.253300 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee151ce-29f7-43aa-ac5e-83b3115f2bc7 service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:25.263798 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed33fb9-4f48-493c-a9c9-4e616cf09966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:25.266137 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed33fb9-4f48-493c-a9c9-4e616cf09966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:25.267176 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed33fb9-4f48-493c-a9c9-4e616cf09966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:25.268601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed33fb9-4f48-493c-a9c9-4e616cf09966 admin admin] PATH_INFO: `/v3/users/589cf6faf1fe4d8fa76ffd7f6e93f580` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:25.271122 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed33fb9-4f48-493c-a9c9-4e616cf09966 admin admin] RBAC: Authorizing `identity:delete_user(user_id=589cf6faf1fe4d8fa76ffd7f6e93f580)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:25.275987 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed33fb9-4f48-493c-a9c9-4e616cf09966 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:25.345063 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-8284f9b5-ab01-4081-bb7e-b071a1e438be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f14a2a00a1f741c28eb294f2631b9a6f', 'request_id': 'req-8284f9b5-ab01-4081-bb7e-b071a1e438be'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:25.362264 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-8284f9b5-ab01-4081-bb7e-b071a1e438be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f14a2a00a1f741c28eb294f2631b9a6f', 'request_id': 'req-8284f9b5-ab01-4081-bb7e-b071a1e438be'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:25.376075 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-8284f9b5-ab01-4081-bb7e-b071a1e438be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f14a2a00a1f741c28eb294f2631b9a6f', 'request_id': 'req-8284f9b5-ab01-4081-bb7e-b071a1e438be'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:25.484744 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-8284f9b5-ab01-4081-bb7e-b071a1e438be admin admin] The token cache is being invalidate because project f14a2a00a1f741c28eb294f2631b9a6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:06:25.493714 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-8284f9b5-ab01-4081-bb7e-b071a1e438be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:25.493714 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-8284f9b5-ab01-4081-bb7e-b071a1e438be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:25.493714 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 856/1698] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:06:25 2022] DELETE /identity/v3/projects/f14a2a00a1f741c28eb294f2631b9a6f => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:25.494715 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b41f8e-d891-4713-bdac-a6a0fd31c6b9 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:25.495031 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b41f8e-d891-4713-bdac-a6a0fd31c6b9 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:25.495301 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b41f8e-d891-4713-bdac-a6a0fd31c6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:25.529791 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-50b41f8e-d891-4713-bdac-a6a0fd31c6b9 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:25.531231 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-50b41f8e-d891-4713-bdac-a6a0fd31c6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:25.612902 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 857/1699] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:06:25.613998 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b41f8e-d891-4713-bdac-a6a0fd31c6b9 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:25.614947 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-1ed33fb9-4f48-493c-a9c9-4e616cf09966 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '589cf6faf1fe4d8fa76ffd7f6e93f580'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:25.615373 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-50b41f8e-d891-4713-bdac-a6a0fd31c6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:25.651877 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-1ed33fb9-4f48-493c-a9c9-4e616cf09966 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '589cf6faf1fe4d8fa76ffd7f6e93f580'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:25.656342 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-1ed33fb9-4f48-493c-a9c9-4e616cf09966 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '589cf6faf1fe4d8fa76ffd7f6e93f580'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:25.657308 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-1ed33fb9-4f48-493c-a9c9-4e616cf09966 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '589cf6faf1fe4d8fa76ffd7f6e93f580'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:25.809131 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b41f8e-d891-4713-bdac-a6a0fd31c6b9 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:25.826409 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a5d5a-078d-439d-b64d-66e34fd42c83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:25.827115 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a5d5a-078d-439d-b64d-66e34fd42c83 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:25.827408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a5d5a-078d-439d-b64d-66e34fd42c83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:25.827685 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a5d5a-078d-439d-b64d-66e34fd42c83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:25.831777 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-0d7a5d5a-078d-439d-b64d-66e34fd42c83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:25.863912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a5d5a-078d-439d-b64d-66e34fd42c83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:25.866995 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a5d5a-078d-439d-b64d-66e34fd42c83 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:25.878197 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 858/1700] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:06:25.879768 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895e185-7c0d-453e-b5af-b8e837714428 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:25.880093 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895e185-7c0d-453e-b5af-b8e837714428 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:25.880381 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895e185-7c0d-453e-b5af-b8e837714428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:25.897970 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-1ed33fb9-4f48-493c-a9c9-4e616cf09966 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '589cf6faf1fe4d8fa76ffd7f6e93f580'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:25.918710 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-c895e185-7c0d-453e-b5af-b8e837714428 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:25.919995 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-c895e185-7c0d-453e-b5af-b8e837714428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:25.935233 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 859/1701] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:25.940191 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4774a-38f8-40e6-b25f-e53259f53235 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:25.940191 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4774a-38f8-40e6-b25f-e53259f53235 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:25.940191 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4774a-38f8-40e6-b25f-e53259f53235 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:25.941227 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 843/1702] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:06:25 2022] DELETE /identity/v3/users/589cf6faf1fe4d8fa76ffd7f6e93f580 => generated 0 bytes in 741 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:25.944142 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 860/1703] 10.222.0.40 () {54 vars in 921 bytes} [Mon Jul 11 21:06:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 21:06:25.946125 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d845b-a26a-4b49-8215-cd35a49c0a1c None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:25.946419 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d845b-a26a-4b49-8215-cd35a49c0a1c None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:25.946699 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d845b-a26a-4b49-8215-cd35a49c0a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:25.949865 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed33fb9-4f48-493c-a9c9-4e616cf09966 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:25.975215 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-616d845b-a26a-4b49-8215-cd35a49c0a1c None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:25.977233 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-616d845b-a26a-4b49-8215-cd35a49c0a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:26.066449 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed33fb9-4f48-493c-a9c9-4e616cf09966 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:26.074526 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a6af0-3555-4a6d-86d2-66f5363b57fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:26.075336 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a6af0-3555-4a6d-86d2-66f5363b57fb admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:26.075725 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a6af0-3555-4a6d-86d2-66f5363b57fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:26.076237 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a6af0-3555-4a6d-86d2-66f5363b57fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:26.077086 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a6af0-3555-4a6d-86d2-66f5363b57fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:06:26.079818 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a6af0-3555-4a6d-86d2-66f5363b57fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:26.082186 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a6af0-3555-4a6d-86d2-66f5363b57fb admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:26.103355 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 861/1704] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:26.103754 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 844/1705] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:06:26.104833 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a6af0-3555-4a6d-86d2-66f5363b57fb admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:26.104959 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eace41c-1a4e-40ff-b482-36f885a29d1e None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:26.105310 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eace41c-1a4e-40ff-b482-36f885a29d1e None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:26.105757 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eace41c-1a4e-40ff-b482-36f885a29d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:26.109416 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-982a6af0-3555-4a6d-86d2-66f5363b57fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:26.130260 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:26.149090 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-3eace41c-1a4e-40ff-b482-36f885a29d1e None None] MFA Rules not processed for user `177a912380ad43b6a5e31b787a07ce7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:26.150582 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a6af0-3555-4a6d-86d2-66f5363b57fb admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:26.154833 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-3eace41c-1a4e-40ff-b482-36f885a29d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:26.165969 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9dffea-77b7-4d8f-9242-48b7996576c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:26.167014 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9dffea-77b7-4d8f-9242-48b7996576c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:26.167401 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9dffea-77b7-4d8f-9242-48b7996576c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:26.167848 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9dffea-77b7-4d8f-9242-48b7996576c1 admin admin] PATH_INFO: `/v3/projects/c0c24689b9624724a37196b7dd3ced5f` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:26.169441 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9dffea-77b7-4d8f-9242-48b7996576c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0c24689b9624724a37196b7dd3ced5f)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:26.170679 dv-cinder-849022-2-smb devstack@keystone.service[80374]: WARNING py.warnings [None req-fb9dffea-77b7-4d8f-9242-48b7996576c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 21:06:26.170679 dv-cinder-849022-2-smb devstack@keystone.service[80374]: warnings.warn(msg) Jul 11 21:06:26.170679 dv-cinder-849022-2-smb devstack@keystone.service[80374]: Jul 11 21:06:26.172163 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9dffea-77b7-4d8f-9242-48b7996576c1 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:26.312355 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 862/1706] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Jul 11 21:06:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:26.315274 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eace41c-1a4e-40ff-b482-36f885a29d1e None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:26.322001 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-3eace41c-1a4e-40ff-b482-36f885a29d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:26.402322 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-fb9dffea-77b7-4d8f-9242-48b7996576c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0c24689b9624724a37196b7dd3ced5f', 'request_id': 'req-fb9dffea-77b7-4d8f-9242-48b7996576c1'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:26.465090 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-fb9dffea-77b7-4d8f-9242-48b7996576c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0c24689b9624724a37196b7dd3ced5f', 'request_id': 'req-fb9dffea-77b7-4d8f-9242-48b7996576c1'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:26.497149 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eace41c-1a4e-40ff-b482-36f885a29d1e None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:26.510512 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-fb9dffea-77b7-4d8f-9242-48b7996576c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0c24689b9624724a37196b7dd3ced5f', 'request_id': 'req-fb9dffea-77b7-4d8f-9242-48b7996576c1'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:26.670879 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-fb9dffea-77b7-4d8f-9242-48b7996576c1 admin admin] The token cache is being invalidate because project c0c24689b9624724a37196b7dd3ced5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:06:26.671432 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-fb9dffea-77b7-4d8f-9242-48b7996576c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:26.673440 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-fb9dffea-77b7-4d8f-9242-48b7996576c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:26.676786 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 845/1707] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:06:26 2022] DELETE /identity/v3/projects/c0c24689b9624724a37196b7dd3ced5f => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:26.677744 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9dffea-77b7-4d8f-9242-48b7996576c1 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:26.678493 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88260ff4-375c-47af-8e3b-ec09bc002220 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:26.679785 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88260ff4-375c-47af-8e3b-ec09bc002220 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:26.680112 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88260ff4-375c-47af-8e3b-ec09bc002220 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:26.680395 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88260ff4-375c-47af-8e3b-ec09bc002220 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:26.681352 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-fb9dffea-77b7-4d8f-9242-48b7996576c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:26.688843 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-88260ff4-375c-47af-8e3b-ec09bc002220 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:26.750863 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:26.861452 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9dffea-77b7-4d8f-9242-48b7996576c1 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:26.876191 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f60a4-e77a-4d60-a300-192a5524c515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:26.876191 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f60a4-e77a-4d60-a300-192a5524c515 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:26.876191 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f60a4-e77a-4d60-a300-192a5524c515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:26.876191 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f60a4-e77a-4d60-a300-192a5524c515 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:26.876665 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f60a4-e77a-4d60-a300-192a5524c515 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:26.879651 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f60a4-e77a-4d60-a300-192a5524c515 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:26.904853 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88260ff4-375c-47af-8e3b-ec09bc002220 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:26.906159 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88260ff4-375c-47af-8e3b-ec09bc002220 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:26.918792 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 863/1708] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:06:26.919648 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88260ff4-375c-47af-8e3b-ec09bc002220 service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:26.923034 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-88260ff4-375c-47af-8e3b-ec09bc002220 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:26.955016 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88260ff4-375c-47af-8e3b-ec09bc002220 service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:26.969197 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c170a-d35d-4937-91e3-1fc99a4b476a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:26.971295 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c170a-d35d-4937-91e3-1fc99a4b476a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:26.972542 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c170a-d35d-4937-91e3-1fc99a4b476a admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:26.973574 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c170a-d35d-4937-91e3-1fc99a4b476a admin admin] PATH_INFO: `/v3/users/d90c507f58f4468ca8f7b021977eddb3` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:26.976177 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c170a-d35d-4937-91e3-1fc99a4b476a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d90c507f58f4468ca8f7b021977eddb3)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:26.986257 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c170a-d35d-4937-91e3-1fc99a4b476a admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:27.054764 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 846/1709] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:06:26 2022] POST /identity/v3/projects => generated 373 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:27.060617 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:27.065185 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f60a4-e77a-4d60-a300-192a5524c515 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:27.069330 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-a80f60a4-e77a-4d60-a300-192a5524c515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:27.196079 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f60a4-e77a-4d60-a300-192a5524c515 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:27.203138 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-c91c170a-d35d-4937-91e3-1fc99a4b476a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd90c507f58f4468ca8f7b021977eddb3'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:27.213556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5510a6-662f-4aee-86e2-6eaf696b8c79 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '177a912380ad43b6a5e31b787a07ce7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:27.214252 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5510a6-662f-4aee-86e2-6eaf696b8c79 service placement] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:27.218304 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5510a6-662f-4aee-86e2-6eaf696b8c79 service placement] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:27.223363 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-c91c170a-d35d-4937-91e3-1fc99a4b476a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd90c507f58f4468ca8f7b021977eddb3'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:27.225208 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-c91c170a-d35d-4937-91e3-1fc99a4b476a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd90c507f58f4468ca8f7b021977eddb3'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:27.225666 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5510a6-662f-4aee-86e2-6eaf696b8c79 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:27.228846 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-c91c170a-d35d-4937-91e3-1fc99a4b476a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd90c507f58f4468ca8f7b021977eddb3'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:27.229179 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-3c5510a6-662f-4aee-86e2-6eaf696b8c79 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:27.256996 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5510a6-662f-4aee-86e2-6eaf696b8c79 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:27.264589 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5510a6-662f-4aee-86e2-6eaf696b8c79 service placement] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:27.281588 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 847/1710] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:06:27.290680 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5510a6-662f-4aee-86e2-6eaf696b8c79 service placement] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:27.297331 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-3c5510a6-662f-4aee-86e2-6eaf696b8c79 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:27.329006 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-c91c170a-d35d-4937-91e3-1fc99a4b476a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd90c507f58f4468ca8f7b021977eddb3'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:27.383365 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 864/1711] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:06:26 2022] DELETE /identity/v3/users/d90c507f58f4468ca8f7b021977eddb3 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:27.384514 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c170a-d35d-4937-91e3-1fc99a4b476a admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:27.385932 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-c91c170a-d35d-4937-91e3-1fc99a4b476a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:27.431633 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5510a6-662f-4aee-86e2-6eaf696b8c79 service placement] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:27.574974 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c170a-d35d-4937-91e3-1fc99a4b476a admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:27.594142 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52284ac5-4f4b-4927-b72d-f760c0a3ce79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:27.603495 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52284ac5-4f4b-4927-b72d-f760c0a3ce79 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:27.603495 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52284ac5-4f4b-4927-b72d-f760c0a3ce79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:27.603495 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52284ac5-4f4b-4927-b72d-f760c0a3ce79 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:27.603495 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52284ac5-4f4b-4927-b72d-f760c0a3ce79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:27.606433 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52284ac5-4f4b-4927-b72d-f760c0a3ce79 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:27.621962 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15de0d-18c1-46f6-8ab2-617ccf45e5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:27.623194 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15de0d-18c1-46f6-8ab2-617ccf45e5a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:27.623629 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15de0d-18c1-46f6-8ab2-617ccf45e5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:27.623914 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15de0d-18c1-46f6-8ab2-617ccf45e5a7 admin admin] PATH_INFO: `/v3/users/1f3d1464703644b1af00ecfe2e68c973` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:27.626163 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f15de0d-18c1-46f6-8ab2-617ccf45e5a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f3d1464703644b1af00ecfe2e68c973)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:27.628180 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f15de0d-18c1-46f6-8ab2-617ccf45e5a7 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:27.727060 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 865/1712] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:06:27 2022] POST /identity/v3/users => generated 287 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:27.731312 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52284ac5-4f4b-4927-b72d-f760c0a3ce79 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:27.750014 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52284ac5-4f4b-4927-b72d-f760c0a3ce79 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:27.764725 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7acb96a-b7c2-472b-86a0-f241820944b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:27.765691 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7acb96a-b7c2-472b-86a0-f241820944b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:27.765986 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7acb96a-b7c2-472b-86a0-f241820944b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:27.766273 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7acb96a-b7c2-472b-86a0-f241820944b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:27.771243 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7acb96a-b7c2-472b-86a0-f241820944b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:27.773326 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7acb96a-b7c2-472b-86a0-f241820944b6 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:27.803933 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 866/1713] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 21:06:27.804941 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7acb96a-b7c2-472b-86a0-f241820944b6 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:27.836285 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7acb96a-b7c2-472b-86a0-f241820944b6 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:27.865744 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f3f07-5e63-4b81-89d2-4d015b2ccc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:27.868252 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f3f07-5e63-4b81-89d2-4d015b2ccc5e admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:27.868781 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f3f07-5e63-4b81-89d2-4d015b2ccc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:27.869262 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f3f07-5e63-4b81-89d2-4d015b2ccc5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:27.871321 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f3f07-5e63-4b81-89d2-4d015b2ccc5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:27.877343 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f3f07-5e63-4b81-89d2-4d015b2ccc5e admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:27.903927 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 867/1714] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:27.911387 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f3f07-5e63-4b81-89d2-4d015b2ccc5e admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:27.915619 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-5f15de0d-18c1-46f6-8ab2-617ccf45e5a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f3d1464703644b1af00ecfe2e68c973'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:27.933971 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-5f15de0d-18c1-46f6-8ab2-617ccf45e5a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f3d1464703644b1af00ecfe2e68c973'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:27.936281 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f3f07-5e63-4b81-89d2-4d015b2ccc5e admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:27.939291 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-5f15de0d-18c1-46f6-8ab2-617ccf45e5a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f3d1464703644b1af00ecfe2e68c973'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:27.940186 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-5f15de0d-18c1-46f6-8ab2-617ccf45e5a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f3d1464703644b1af00ecfe2e68c973'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:27.946016 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e20bdd-298b-4e49-b13a-28b1c3fe1989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:27.947208 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e20bdd-298b-4e49-b13a-28b1c3fe1989 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:27.947693 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e20bdd-298b-4e49-b13a-28b1c3fe1989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:27.948333 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e20bdd-298b-4e49-b13a-28b1c3fe1989 admin admin] PATH_INFO: `/v3/projects/01ef55cd6e1b4ed68f99a1b162301ef2/users/a452a15476c840e2949fc87bd45985a8/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:27.975323 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e20bdd-298b-4e49-b13a-28b1c3fe1989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01ef55cd6e1b4ed68f99a1b162301ef2, user_id=a452a15476c840e2949fc87bd45985a8, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:27.983436 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e20bdd-298b-4e49-b13a-28b1c3fe1989 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:28.062044 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-5f15de0d-18c1-46f6-8ab2-617ccf45e5a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f3d1464703644b1af00ecfe2e68c973'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:28.096622 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 848/1715] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:06:27 2022] DELETE /identity/v3/users/1f3d1464703644b1af00ecfe2e68c973 => generated 0 bytes in 813 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:28.103711 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15de0d-18c1-46f6-8ab2-617ccf45e5a7 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:28.103846 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 868/1716] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:06:27 2022] PUT /identity/v3/projects/01ef55cd6e1b4ed68f99a1b162301ef2/users/a452a15476c840e2949fc87bd45985a8/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:28.113447 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444acc8-4be9-4346-922a-5e4b1e833c7e None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:28.113825 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444acc8-4be9-4346-922a-5e4b1e833c7e None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:28.114176 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444acc8-4be9-4346-922a-5e4b1e833c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:28.117619 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-5f15de0d-18c1-46f6-8ab2-617ccf45e5a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:28.167617 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-e444acc8-4be9-4346-922a-5e4b1e833c7e None None] MFA Rules not processed for user `a452a15476c840e2949fc87bd45985a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:28.169228 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-e444acc8-4be9-4346-922a-5e4b1e833c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:28.169670 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:28.270269 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 869/1717] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:28.283372 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444acc8-4be9-4346-922a-5e4b1e833c7e None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:28.285351 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-e444acc8-4be9-4346-922a-5e4b1e833c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:28.297088 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15de0d-18c1-46f6-8ab2-617ccf45e5a7 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:28.420782 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb9a5e2-4cac-4a4a-ab2b-5e425c8aea3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:28.421850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9a5e2-4cac-4a4a-ab2b-5e425c8aea3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:28.422233 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9a5e2-4cac-4a4a-ab2b-5e425c8aea3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:28.422617 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9a5e2-4cac-4a4a-ab2b-5e425c8aea3c admin admin] PATH_INFO: `/v3/projects/10106cf84dd34d8c8f514193601e18b4` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:28.424246 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb9a5e2-4cac-4a4a-ab2b-5e425c8aea3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=10106cf84dd34d8c8f514193601e18b4)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:28.426606 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb9a5e2-4cac-4a4a-ab2b-5e425c8aea3c admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:28.446593 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444acc8-4be9-4346-922a-5e4b1e833c7e None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:28.468362 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380c142-9ee1-4776-a104-25c399c142bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:28.471121 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380c142-9ee1-4776-a104-25c399c142bc service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:28.476410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380c142-9ee1-4776-a104-25c399c142bc service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:28.477220 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380c142-9ee1-4776-a104-25c399c142bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:28.508375 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380c142-9ee1-4776-a104-25c399c142bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:28.510925 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380c142-9ee1-4776-a104-25c399c142bc service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:28.531468 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 870/1718] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:06:28.565899 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380c142-9ee1-4776-a104-25c399c142bc service nova] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:28.566920 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-0380c142-9ee1-4776-a104-25c399c142bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:28.670709 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:28.679734 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-5bb9a5e2-4cac-4a4a-ab2b-5e425c8aea3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10106cf84dd34d8c8f514193601e18b4', 'request_id': 'req-5bb9a5e2-4cac-4a4a-ab2b-5e425c8aea3c'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:28.694667 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-5bb9a5e2-4cac-4a4a-ab2b-5e425c8aea3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10106cf84dd34d8c8f514193601e18b4', 'request_id': 'req-5bb9a5e2-4cac-4a4a-ab2b-5e425c8aea3c'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:28.711875 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-5bb9a5e2-4cac-4a4a-ab2b-5e425c8aea3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10106cf84dd34d8c8f514193601e18b4', 'request_id': 'req-5bb9a5e2-4cac-4a4a-ab2b-5e425c8aea3c'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:28.739439 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380c142-9ee1-4776-a104-25c399c142bc service nova] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:28.846064 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d55da8-04d1-4519-8389-184d86b7c1d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '177a912380ad43b6a5e31b787a07ce7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:28.846808 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d55da8-04d1-4519-8389-184d86b7c1d6 service placement] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:28.847103 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d55da8-04d1-4519-8389-184d86b7c1d6 service placement] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:28.847387 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d55da8-04d1-4519-8389-184d86b7c1d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:28.849361 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-e8d55da8-04d1-4519-8389-184d86b7c1d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:28.851302 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-5bb9a5e2-4cac-4a4a-ab2b-5e425c8aea3c admin admin] The token cache is being invalidate because project 10106cf84dd34d8c8f514193601e18b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:06:28.851557 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-5bb9a5e2-4cac-4a4a-ab2b-5e425c8aea3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:28.852634 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-5bb9a5e2-4cac-4a4a-ab2b-5e425c8aea3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:28.855838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 849/1719] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:06:28 2022] DELETE /identity/v3/projects/10106cf84dd34d8c8f514193601e18b4 => generated 0 bytes in 759 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:28.874258 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d55da8-04d1-4519-8389-184d86b7c1d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:28.874840 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb9a5e2-4cac-4a4a-ab2b-5e425c8aea3c admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:28.875916 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d55da8-04d1-4519-8389-184d86b7c1d6 service placement] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:28.880119 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-5bb9a5e2-4cac-4a4a-ab2b-5e425c8aea3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:28.893691 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 871/1720] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:06:28.894926 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d55da8-04d1-4519-8389-184d86b7c1d6 service placement] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:28.897034 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-e8d55da8-04d1-4519-8389-184d86b7c1d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:29.114026 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d55da8-04d1-4519-8389-184d86b7c1d6 service placement] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:29.115986 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb9a5e2-4cac-4a4a-ab2b-5e425c8aea3c admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:29.126356 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728e351-cae2-49df-af0d-e5a1c69c40fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:29.126356 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728e351-cae2-49df-af0d-e5a1c69c40fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:29.126356 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728e351-cae2-49df-af0d-e5a1c69c40fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:29.126356 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728e351-cae2-49df-af0d-e5a1c69c40fa admin admin] PATH_INFO: `/v3/projects/284749ca251d4543a6bd37c713d86b6f` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:29.128201 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728e351-cae2-49df-af0d-e5a1c69c40fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=284749ca251d4543a6bd37c713d86b6f)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:29.132078 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887b33e-2c30-46ca-8d05-4bdde950f374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:29.132743 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887b33e-2c30-46ca-8d05-4bdde950f374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:29.133230 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887b33e-2c30-46ca-8d05-4bdde950f374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:29.133512 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887b33e-2c30-46ca-8d05-4bdde950f374 admin admin] PATH_INFO: `/v3/users/6fe4ceabd9684405bedc977b7fd64e7b` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:29.134392 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728e351-cae2-49df-af0d-e5a1c69c40fa admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:29.136830 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f887b33e-2c30-46ca-8d05-4bdde950f374 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fe4ceabd9684405bedc977b7fd64e7b)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:29.140493 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f887b33e-2c30-46ca-8d05-4bdde950f374 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:29.369920 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-1728e351-cae2-49df-af0d-e5a1c69c40fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '284749ca251d4543a6bd37c713d86b6f', 'request_id': 'req-1728e351-cae2-49df-af0d-e5a1c69c40fa'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:29.388680 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-1728e351-cae2-49df-af0d-e5a1c69c40fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '284749ca251d4543a6bd37c713d86b6f', 'request_id': 'req-1728e351-cae2-49df-af0d-e5a1c69c40fa'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:29.411601 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:29.415274 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-1728e351-cae2-49df-af0d-e5a1c69c40fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '284749ca251d4543a6bd37c713d86b6f', 'request_id': 'req-1728e351-cae2-49df-af0d-e5a1c69c40fa'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:29.440498 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-f887b33e-2c30-46ca-8d05-4bdde950f374 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fe4ceabd9684405bedc977b7fd64e7b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:29.457307 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-f887b33e-2c30-46ca-8d05-4bdde950f374 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fe4ceabd9684405bedc977b7fd64e7b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:29.459057 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-f887b33e-2c30-46ca-8d05-4bdde950f374 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fe4ceabd9684405bedc977b7fd64e7b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:29.460164 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-f887b33e-2c30-46ca-8d05-4bdde950f374 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fe4ceabd9684405bedc977b7fd64e7b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:29.556246 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-1728e351-cae2-49df-af0d-e5a1c69c40fa admin admin] The token cache is being invalidate because project 284749ca251d4543a6bd37c713d86b6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:06:29.556492 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-1728e351-cae2-49df-af0d-e5a1c69c40fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:29.560802 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-1728e351-cae2-49df-af0d-e5a1c69c40fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:29.569840 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 872/1721] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:06:28 2022] DELETE /identity/v3/projects/284749ca251d4543a6bd37c713d86b6f => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:29.569840 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728e351-cae2-49df-af0d-e5a1c69c40fa admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:29.577535 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-1728e351-cae2-49df-af0d-e5a1c69c40fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:29.634161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-f887b33e-2c30-46ca-8d05-4bdde950f374 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fe4ceabd9684405bedc977b7fd64e7b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:29.685425 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 850/1722] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:06:28 2022] DELETE /identity/v3/users/6fe4ceabd9684405bedc977b7fd64e7b => generated 0 bytes in 817 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:29.689880 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887b33e-2c30-46ca-8d05-4bdde950f374 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:29.691303 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-f887b33e-2c30-46ca-8d05-4bdde950f374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:29.749987 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728e351-cae2-49df-af0d-e5a1c69c40fa admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:29.784945 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887b33e-2c30-46ca-8d05-4bdde950f374 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:29.792534 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e573b69-12a0-4d5a-b585-95e230f9d92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:29.793680 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e573b69-12a0-4d5a-b585-95e230f9d92c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:29.794850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e573b69-12a0-4d5a-b585-95e230f9d92c admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:29.795080 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e573b69-12a0-4d5a-b585-95e230f9d92c admin admin] PATH_INFO: `/v3/projects/7668c642854f423bbaed838b13e44e98` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:29.798941 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e573b69-12a0-4d5a-b585-95e230f9d92c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7668c642854f423bbaed838b13e44e98)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:29.804753 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e573b69-12a0-4d5a-b585-95e230f9d92c admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:29.878345 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56582800-1050-4d26-8f70-fef2e6878208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:29.879566 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56582800-1050-4d26-8f70-fef2e6878208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:29.879861 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56582800-1050-4d26-8f70-fef2e6878208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:29.880194 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56582800-1050-4d26-8f70-fef2e6878208 admin admin] PATH_INFO: `/v3/users/a452a15476c840e2949fc87bd45985a8` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:29.882571 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56582800-1050-4d26-8f70-fef2e6878208 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a452a15476c840e2949fc87bd45985a8)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:29.885163 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56582800-1050-4d26-8f70-fef2e6878208 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:29.983098 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-0e573b69-12a0-4d5a-b585-95e230f9d92c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7668c642854f423bbaed838b13e44e98', 'request_id': 'req-0e573b69-12a0-4d5a-b585-95e230f9d92c'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:29.994677 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-0e573b69-12a0-4d5a-b585-95e230f9d92c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7668c642854f423bbaed838b13e44e98', 'request_id': 'req-0e573b69-12a0-4d5a-b585-95e230f9d92c'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:30.003922 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-0e573b69-12a0-4d5a-b585-95e230f9d92c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7668c642854f423bbaed838b13e44e98', 'request_id': 'req-0e573b69-12a0-4d5a-b585-95e230f9d92c'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:30.131470 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-0e573b69-12a0-4d5a-b585-95e230f9d92c admin admin] The token cache is being invalidate because project 7668c642854f423bbaed838b13e44e98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:06:30.132236 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-0e573b69-12a0-4d5a-b585-95e230f9d92c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:30.133015 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-0e573b69-12a0-4d5a-b585-95e230f9d92c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:30.134966 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 851/1723] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:06:29 2022] DELETE /identity/v3/projects/7668c642854f423bbaed838b13e44e98 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:30.136952 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c62867-9ead-4919-beeb-cced34c27af0 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:30.137288 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c62867-9ead-4919-beeb-cced34c27af0 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:30.137567 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c62867-9ead-4919-beeb-cced34c27af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:30.156626 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-56582800-1050-4d26-8f70-fef2e6878208 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a452a15476c840e2949fc87bd45985a8'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:30.171641 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:30.184129 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-56582800-1050-4d26-8f70-fef2e6878208 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a452a15476c840e2949fc87bd45985a8'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:30.186664 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-56582800-1050-4d26-8f70-fef2e6878208 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a452a15476c840e2949fc87bd45985a8'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:30.186791 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-56582800-1050-4d26-8f70-fef2e6878208 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a452a15476c840e2949fc87bd45985a8'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:30.194187 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-03c62867-9ead-4919-beeb-cced34c27af0 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:30.195534 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-03c62867-9ead-4919-beeb-cced34c27af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:30.303731 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-56582800-1050-4d26-8f70-fef2e6878208 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a452a15476c840e2949fc87bd45985a8'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:30.341810 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 873/1724] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:06:29 2022] DELETE /identity/v3/users/a452a15476c840e2949fc87bd45985a8 => generated 0 bytes in 770 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:30.345058 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56582800-1050-4d26-8f70-fef2e6878208 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:30.346689 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-56582800-1050-4d26-8f70-fef2e6878208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:30.359192 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 852/1725] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:30.360891 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44480cc-38d6-446c-98c4-0d8404182919 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:30.362084 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44480cc-38d6-446c-98c4-0d8404182919 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:30.368112 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44480cc-38d6-446c-98c4-0d8404182919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:30.404539 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-d44480cc-38d6-446c-98c4-0d8404182919 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:30.406207 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d44480cc-38d6-446c-98c4-0d8404182919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:30.534212 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 853/1726] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:30.536364 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06ddff-cf2e-49d6-b73f-00d33f64e4d4 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:30.540153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06ddff-cf2e-49d6-b73f-00d33f64e4d4 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:30.540153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06ddff-cf2e-49d6-b73f-00d33f64e4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:30.544689 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56582800-1050-4d26-8f70-fef2e6878208 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:30.554279 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082e60c-9640-47c8-a812-e5e582cca96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:30.555861 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082e60c-9640-47c8-a812-e5e582cca96f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:30.556176 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082e60c-9640-47c8-a812-e5e582cca96f admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:30.558022 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082e60c-9640-47c8-a812-e5e582cca96f admin admin] PATH_INFO: `/v3/users/18a5017ff94143c2b441a0d7b0b82a5d` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:30.563298 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a082e60c-9640-47c8-a812-e5e582cca96f admin admin] RBAC: Authorizing `identity:delete_user(user_id=18a5017ff94143c2b441a0d7b0b82a5d)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:30.574416 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a082e60c-9640-47c8-a812-e5e582cca96f admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:30.580496 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-1c06ddff-cf2e-49d6-b73f-00d33f64e4d4 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:30.581761 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-1c06ddff-cf2e-49d6-b73f-00d33f64e4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:30.593844 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 854/1727] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:30.597604 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06ddff-cf2e-49d6-b73f-00d33f64e4d4 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:30.597604 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-1c06ddff-cf2e-49d6-b73f-00d33f64e4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:30.610351 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06ddff-cf2e-49d6-b73f-00d33f64e4d4 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:30.616896 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7e383-0ed6-422e-8a71-59ccc5359919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:30.617880 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7e383-0ed6-422e-8a71-59ccc5359919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:30.618248 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7e383-0ed6-422e-8a71-59ccc5359919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:30.618843 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7e383-0ed6-422e-8a71-59ccc5359919 admin admin] PATH_INFO: `/v3/projects/1ccd12be61034571ba9e720e809809a6` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:30.621181 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e7e383-0ed6-422e-8a71-59ccc5359919 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ccd12be61034571ba9e720e809809a6)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:30.624555 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e7e383-0ed6-422e-8a71-59ccc5359919 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:30.863195 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d5e7e383-0ed6-422e-8a71-59ccc5359919 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ccd12be61034571ba9e720e809809a6', 'request_id': 'req-d5e7e383-0ed6-422e-8a71-59ccc5359919'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:30.874763 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a082e60c-9640-47c8-a812-e5e582cca96f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18a5017ff94143c2b441a0d7b0b82a5d'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:30.878187 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d5e7e383-0ed6-422e-8a71-59ccc5359919 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ccd12be61034571ba9e720e809809a6', 'request_id': 'req-d5e7e383-0ed6-422e-8a71-59ccc5359919'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:30.902499 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d5e7e383-0ed6-422e-8a71-59ccc5359919 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ccd12be61034571ba9e720e809809a6', 'request_id': 'req-d5e7e383-0ed6-422e-8a71-59ccc5359919'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:30.902654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a082e60c-9640-47c8-a812-e5e582cca96f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18a5017ff94143c2b441a0d7b0b82a5d'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:30.905961 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a082e60c-9640-47c8-a812-e5e582cca96f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18a5017ff94143c2b441a0d7b0b82a5d'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:30.908417 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a082e60c-9640-47c8-a812-e5e582cca96f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18a5017ff94143c2b441a0d7b0b82a5d'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:31.003825 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d5e7e383-0ed6-422e-8a71-59ccc5359919 admin admin] The token cache is being invalidate because project 1ccd12be61034571ba9e720e809809a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:06:31.003825 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d5e7e383-0ed6-422e-8a71-59ccc5359919 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:31.005023 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d5e7e383-0ed6-422e-8a71-59ccc5359919 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:31.008829 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 855/1728] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:06:30 2022] DELETE /identity/v3/projects/1ccd12be61034571ba9e720e809809a6 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:31.011025 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7e383-0ed6-422e-8a71-59ccc5359919 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:31.014830 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d5e7e383-0ed6-422e-8a71-59ccc5359919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:31.077804 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a082e60c-9640-47c8-a812-e5e582cca96f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18a5017ff94143c2b441a0d7b0b82a5d'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:31.124392 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 874/1729] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:06:30 2022] DELETE /identity/v3/users/18a5017ff94143c2b441a0d7b0b82a5d => generated 0 bytes in 782 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:31.125305 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082e60c-9640-47c8-a812-e5e582cca96f admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:31.126807 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a082e60c-9640-47c8-a812-e5e582cca96f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:31.178031 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7e383-0ed6-422e-8a71-59ccc5359919 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:31.253617 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082e60c-9640-47c8-a812-e5e582cca96f admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:31.268690 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3615398-25ff-4d13-85d4-38499fff0cff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:31.269612 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3615398-25ff-4d13-85d4-38499fff0cff service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:31.270360 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3615398-25ff-4d13-85d4-38499fff0cff service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:31.270937 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3615398-25ff-4d13-85d4-38499fff0cff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:31.274136 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-d3615398-25ff-4d13-85d4-38499fff0cff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:31.358141 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd05de-eb4d-4d74-84bb-99440ba3eb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:31.359282 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd05de-eb4d-4d74-84bb-99440ba3eb87 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:31.359771 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd05de-eb4d-4d74-84bb-99440ba3eb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:31.360350 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd05de-eb4d-4d74-84bb-99440ba3eb87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:31.361641 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bd05de-eb4d-4d74-84bb-99440ba3eb87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:06:31.362145 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bd05de-eb4d-4d74-84bb-99440ba3eb87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:31.364427 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bd05de-eb4d-4d74-84bb-99440ba3eb87 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:31.381474 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 856/1730] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:06:31.383753 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749e039-62c1-40dc-b6d6-7c88e0b5e801 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:31.384246 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749e039-62c1-40dc-b6d6-7c88e0b5e801 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:31.385079 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749e039-62c1-40dc-b6d6-7c88e0b5e801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:31.418550 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-4749e039-62c1-40dc-b6d6-7c88e0b5e801 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:31.421449 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3615398-25ff-4d13-85d4-38499fff0cff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:31.422362 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-4749e039-62c1-40dc-b6d6-7c88e0b5e801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:31.426931 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3615398-25ff-4d13-85d4-38499fff0cff service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:31.441128 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:31.446797 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 857/1731] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:31.448261 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749e039-62c1-40dc-b6d6-7c88e0b5e801 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:31.458381 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 875/1732] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:06:31.459958 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f142f-4925-4285-b1f0-91e4e7ee4376 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:31.460285 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f142f-4925-4285-b1f0-91e4e7ee4376 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:31.460575 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f142f-4925-4285-b1f0-91e4e7ee4376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:31.484680 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749e039-62c1-40dc-b6d6-7c88e0b5e801 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:31.516261 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-4c2f142f-4925-4285-b1f0-91e4e7ee4376 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:31.522361 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-4c2f142f-4925-4285-b1f0-91e4e7ee4376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:31.543365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de4eec9-2060-4acc-8333-b099fc5e0588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:31.551759 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4eec9-2060-4acc-8333-b099fc5e0588 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:31.552124 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4eec9-2060-4acc-8333-b099fc5e0588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:31.552391 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4eec9-2060-4acc-8333-b099fc5e0588 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:31.553145 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de4eec9-2060-4acc-8333-b099fc5e0588 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:31.562725 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de4eec9-2060-4acc-8333-b099fc5e0588 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:31.579552 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 876/1733] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:31.582639 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d39d2-2511-4dfa-a07d-1ca45c3b6a62 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:31.582991 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d39d2-2511-4dfa-a07d-1ca45c3b6a62 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:31.583282 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d39d2-2511-4dfa-a07d-1ca45c3b6a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:31.672118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-999d39d2-2511-4dfa-a07d-1ca45c3b6a62 None None] MFA Rules not processed for user `6b67d92f0f644bc0861995318d10441c`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:31.673427 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-999d39d2-2511-4dfa-a07d-1ca45c3b6a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:31.725163 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 858/1734] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:06:31 2022] POST /identity/v3/projects => generated 363 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:31.727633 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de4eec9-2060-4acc-8333-b099fc5e0588 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:31.930476 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de4eec9-2060-4acc-8333-b099fc5e0588 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:31.943537 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 877/1735] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:31.944666 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d39d2-2511-4dfa-a07d-1ca45c3b6a62 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:31.951460 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9583f7-bb87-4553-a0de-6d78fb5237f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:31.952303 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9583f7-bb87-4553-a0de-6d78fb5237f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:31.952611 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9583f7-bb87-4553-a0de-6d78fb5237f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:31.952903 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9583f7-bb87-4553-a0de-6d78fb5237f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:31.953675 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9583f7-bb87-4553-a0de-6d78fb5237f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:06:31.953968 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9583f7-bb87-4553-a0de-6d78fb5237f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:31.955778 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9583f7-bb87-4553-a0de-6d78fb5237f6 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:31.973381 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d39d2-2511-4dfa-a07d-1ca45c3b6a62 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:31.973769 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 859/1736] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:06:31.974668 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9583f7-bb87-4553-a0de-6d78fb5237f6 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:31.979567 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-4c9583f7-bb87-4553-a0de-6d78fb5237f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:31.987572 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7d8e0-38ce-4dea-9406-d30c743336bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:31.988309 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7d8e0-38ce-4dea-9406-d30c743336bc admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:31.988601 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7d8e0-38ce-4dea-9406-d30c743336bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:31.988885 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7d8e0-38ce-4dea-9406-d30c743336bc admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:31.990053 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a7d8e0-38ce-4dea-9406-d30c743336bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:31.991633 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a7d8e0-38ce-4dea-9406-d30c743336bc admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:32.116867 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9583f7-bb87-4553-a0de-6d78fb5237f6 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:32.125416 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02139f0-978b-4bef-8cc1-d9d32599e0e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:32.126444 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02139f0-978b-4bef-8cc1-d9d32599e0e9 service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:32.126923 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02139f0-978b-4bef-8cc1-d9d32599e0e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:32.127428 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02139f0-978b-4bef-8cc1-d9d32599e0e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:32.227740 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 878/1737] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:06:31 2022] POST /identity/v3/users => generated 282 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:32.236232 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7d8e0-38ce-4dea-9406-d30c743336bc admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:32.251328 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02139f0-978b-4bef-8cc1-d9d32599e0e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:32.254453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02139f0-978b-4bef-8cc1-d9d32599e0e9 service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:32.258304 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7d8e0-38ce-4dea-9406-d30c743336bc admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:32.268625 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 860/1738] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:06:32.270914 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4c2ee-a864-42e3-8035-e359f9a637cb None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:32.271509 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4c2ee-a864-42e3-8035-e359f9a637cb None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:32.271997 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4c2ee-a864-42e3-8035-e359f9a637cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:32.280886 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e7ea4-21f4-4ecc-9874-a892b4b5870b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:32.294964 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e7ea4-21f4-4ecc-9874-a892b4b5870b admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:32.294964 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e7ea4-21f4-4ecc-9874-a892b4b5870b admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:32.294964 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e7ea4-21f4-4ecc-9874-a892b4b5870b admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:32.294964 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e7ea4-21f4-4ecc-9874-a892b4b5870b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:32.298040 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e7ea4-21f4-4ecc-9874-a892b4b5870b admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:32.321036 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-5bd4c2ee-a864-42e3-8035-e359f9a637cb None None] MFA Rules not processed for user `1c19d61152474a0bb1e373a9ce0310bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:32.330752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-5bd4c2ee-a864-42e3-8035-e359f9a637cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:32.332511 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:32.486320 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 879/1739] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:06:32 2022] POST /identity/v3/projects => generated 379 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:32.489243 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75778a3-ac56-48d9-8c77-956009ebd1bb None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:32.500440 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 861/1740] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:32.501614 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4c2ee-a864-42e3-8035-e359f9a637cb None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:32.508188 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75778a3-ac56-48d9-8c77-956009ebd1bb None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:32.509804 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75778a3-ac56-48d9-8c77-956009ebd1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:32.532330 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4c2ee-a864-42e3-8035-e359f9a637cb None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:32.640201 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-e75778a3-ac56-48d9-8c77-956009ebd1bb None None] MFA Rules not processed for user `01541b7e5e984884bf87ef6d31b9480c`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:32.647674 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-e75778a3-ac56-48d9-8c77-956009ebd1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:32.798086 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b709627-a490-4a38-b351-daaf6687a5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:32.798582 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b709627-a490-4a38-b351-daaf6687a5c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:32.798877 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b709627-a490-4a38-b351-daaf6687a5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:32.802402 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b709627-a490-4a38-b351-daaf6687a5c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:32.803175 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b709627-a490-4a38-b351-daaf6687a5c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:32.813603 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b709627-a490-4a38-b351-daaf6687a5c2 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:32.853056 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 862/1741] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:32.860945 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b709627-a490-4a38-b351-daaf6687a5c2 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:32.873903 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 880/1742] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:32.878722 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75778a3-ac56-48d9-8c77-956009ebd1bb None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:32.884930 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-e75778a3-ac56-48d9-8c77-956009ebd1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:32.902534 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:32.916145 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b709627-a490-4a38-b351-daaf6687a5c2 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:32.925705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75778a3-ac56-48d9-8c77-956009ebd1bb None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:32.937889 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac28bc-301f-4761-9d6a-965cd33d6cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:32.937889 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac28bc-301f-4761-9d6a-965cd33d6cff admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:32.939033 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac28bc-301f-4761-9d6a-965cd33d6cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:32.939033 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac28bc-301f-4761-9d6a-965cd33d6cff admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:32.940312 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac28bc-301f-4761-9d6a-965cd33d6cff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:32.941133 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21d444-2f6a-414b-b3f2-800657b5fe0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:32.942090 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21d444-2f6a-414b-b3f2-800657b5fe0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:32.942624 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21d444-2f6a-414b-b3f2-800657b5fe0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:32.943053 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21d444-2f6a-414b-b3f2-800657b5fe0c admin admin] PATH_INFO: `/v3/projects/7286fd19a4e04c108e0c3c085476ae29` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:32.949723 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc21d444-2f6a-414b-b3f2-800657b5fe0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7286fd19a4e04c108e0c3c085476ae29)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:32.953283 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc21d444-2f6a-414b-b3f2-800657b5fe0c admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:32.958217 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac28bc-301f-4761-9d6a-965cd33d6cff admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:33.108226 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 863/1743] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:06:32 2022] POST /identity/v3/users => generated 290 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:33.109418 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac28bc-301f-4761-9d6a-965cd33d6cff admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:33.120855 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac28bc-301f-4761-9d6a-965cd33d6cff admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:33.126736 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad25774a-db97-4cba-bf96-a97c5998dcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:33.128483 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25774a-db97-4cba-bf96-a97c5998dcc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:33.128483 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25774a-db97-4cba-bf96-a97c5998dcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:33.128483 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25774a-db97-4cba-bf96-a97c5998dcc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:33.128992 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad25774a-db97-4cba-bf96-a97c5998dcc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:33.130676 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad25774a-db97-4cba-bf96-a97c5998dcc6 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:33.148693 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 864/1744] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:33.151401 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99724297-43ae-4a60-becb-335d2ce5e089 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:33.152660 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99724297-43ae-4a60-becb-335d2ce5e089 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:33.154154 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99724297-43ae-4a60-becb-335d2ce5e089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:33.161409 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-bc21d444-2f6a-414b-b3f2-800657b5fe0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7286fd19a4e04c108e0c3c085476ae29', 'request_id': 'req-bc21d444-2f6a-414b-b3f2-800657b5fe0c'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:33.178237 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-bc21d444-2f6a-414b-b3f2-800657b5fe0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7286fd19a4e04c108e0c3c085476ae29', 'request_id': 'req-bc21d444-2f6a-414b-b3f2-800657b5fe0c'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:33.189759 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-bc21d444-2f6a-414b-b3f2-800657b5fe0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7286fd19a4e04c108e0c3c085476ae29', 'request_id': 'req-bc21d444-2f6a-414b-b3f2-800657b5fe0c'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:33.192784 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-99724297-43ae-4a60-becb-335d2ce5e089 None None] MFA Rules not processed for user `01541b7e5e984884bf87ef6d31b9480c`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:33.213818 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-99724297-43ae-4a60-becb-335d2ce5e089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:33.316640 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-bc21d444-2f6a-414b-b3f2-800657b5fe0c admin admin] The token cache is being invalidate because project 7286fd19a4e04c108e0c3c085476ae29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:06:33.319494 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-bc21d444-2f6a-414b-b3f2-800657b5fe0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:33.319494 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-bc21d444-2f6a-414b-b3f2-800657b5fe0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:33.320927 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 881/1745] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:06:32 2022] DELETE /identity/v3/projects/7286fd19a4e04c108e0c3c085476ae29 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:33.321786 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21d444-2f6a-414b-b3f2-800657b5fe0c admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:33.326447 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-bc21d444-2f6a-414b-b3f2-800657b5fe0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:33.366231 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 865/1746] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:33.368804 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99724297-43ae-4a60-becb-335d2ce5e089 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:33.379491 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-99724297-43ae-4a60-becb-335d2ce5e089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:33.486184 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21d444-2f6a-414b-b3f2-800657b5fe0c admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:33.491552 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ba5c2-3934-4bd6-a41b-63257539bb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:33.498741 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ba5c2-3934-4bd6-a41b-63257539bb39 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:33.498741 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ba5c2-3934-4bd6-a41b-63257539bb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:33.498741 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ba5c2-3934-4bd6-a41b-63257539bb39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:33.498741 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04ba5c2-3934-4bd6-a41b-63257539bb39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:33.498741 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04ba5c2-3934-4bd6-a41b-63257539bb39 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:33.508160 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 882/1747] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:33.509323 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ba5c2-3934-4bd6-a41b-63257539bb39 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:33.512788 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a04ba5c2-3934-4bd6-a41b-63257539bb39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:33.539205 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ba5c2-3934-4bd6-a41b-63257539bb39 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:33.555929 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f68e3-df7e-4fee-9353-3a9ad5668542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:33.557084 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f68e3-df7e-4fee-9353-3a9ad5668542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:33.557518 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f68e3-df7e-4fee-9353-3a9ad5668542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:33.558038 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f68e3-df7e-4fee-9353-3a9ad5668542 admin admin] PATH_INFO: `/v3/projects/01ef55cd6e1b4ed68f99a1b162301ef2` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:33.563552 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f68e3-df7e-4fee-9353-3a9ad5668542 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01ef55cd6e1b4ed68f99a1b162301ef2)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:33.567633 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f68e3-df7e-4fee-9353-3a9ad5668542 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:33.592487 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:33.643801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99724297-43ae-4a60-becb-335d2ce5e089 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:33.657798 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72f7ad-7637-425e-a4c9-1a91192a0aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:33.659248 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72f7ad-7637-425e-a4c9-1a91192a0aff admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:33.659789 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72f7ad-7637-425e-a4c9-1a91192a0aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:33.660329 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72f7ad-7637-425e-a4c9-1a91192a0aff admin admin] PATH_INFO: `/v3/projects/b558f8ea9a944029b1e3645001f6abd5/users/028918d07fe8481da7285c4b66f76203/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:33.721648 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72f7ad-7637-425e-a4c9-1a91192a0aff admin admin] RBAC: Authorizing `identity:create_grant(project_id=b558f8ea9a944029b1e3645001f6abd5, user_id=028918d07fe8481da7285c4b66f76203, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:33.724488 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72f7ad-7637-425e-a4c9-1a91192a0aff admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:33.848328 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 866/1748] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:06:33 2022] PUT /identity/v3/projects/b558f8ea9a944029b1e3645001f6abd5/users/028918d07fe8481da7285c4b66f76203/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:33.851146 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cca2a6-efd1-41ce-b058-cb5332d7be79 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:33.851396 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cca2a6-efd1-41ce-b058-cb5332d7be79 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:33.857395 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cca2a6-efd1-41ce-b058-cb5332d7be79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:33.862912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ca7f68e3-df7e-4fee-9353-3a9ad5668542 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01ef55cd6e1b4ed68f99a1b162301ef2', 'request_id': 'req-ca7f68e3-df7e-4fee-9353-3a9ad5668542'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:33.879077 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ca7f68e3-df7e-4fee-9353-3a9ad5668542 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01ef55cd6e1b4ed68f99a1b162301ef2', 'request_id': 'req-ca7f68e3-df7e-4fee-9353-3a9ad5668542'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:33.888782 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ca7f68e3-df7e-4fee-9353-3a9ad5668542 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01ef55cd6e1b4ed68f99a1b162301ef2', 'request_id': 'req-ca7f68e3-df7e-4fee-9353-3a9ad5668542'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:33.925659 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-57cca2a6-efd1-41ce-b058-cb5332d7be79 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:33.927086 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-57cca2a6-efd1-41ce-b058-cb5332d7be79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:34.002828 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ca7f68e3-df7e-4fee-9353-3a9ad5668542 admin admin] The token cache is being invalidate because project 01ef55cd6e1b4ed68f99a1b162301ef2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:06:34.003739 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ca7f68e3-df7e-4fee-9353-3a9ad5668542 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:34.004770 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ca7f68e3-df7e-4fee-9353-3a9ad5668542 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:34.006754 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 883/1749] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:06:33 2022] DELETE /identity/v3/projects/01ef55cd6e1b4ed68f99a1b162301ef2 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:34.007789 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f68e3-df7e-4fee-9353-3a9ad5668542 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:34.013312 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-ca7f68e3-df7e-4fee-9353-3a9ad5668542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:34.031847 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 867/1750] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:34.043763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cca2a6-efd1-41ce-b058-cb5332d7be79 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:34.046051 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-57cca2a6-efd1-41ce-b058-cb5332d7be79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:34.062783 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cca2a6-efd1-41ce-b058-cb5332d7be79 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:34.075272 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a00503-7dd7-4214-9dc8-83dac037312e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:34.076157 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a00503-7dd7-4214-9dc8-83dac037312e admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:34.076525 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a00503-7dd7-4214-9dc8-83dac037312e admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:34.076881 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a00503-7dd7-4214-9dc8-83dac037312e admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:34.077763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a00503-7dd7-4214-9dc8-83dac037312e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:34.080610 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a00503-7dd7-4214-9dc8-83dac037312e admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:34.109384 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 868/1751] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:34.111939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d176619-a755-48da-b364-f06dc5cb27cc None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:34.112612 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d176619-a755-48da-b364-f06dc5cb27cc None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:34.113058 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d176619-a755-48da-b364-f06dc5cb27cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:34.166342 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-9d176619-a755-48da-b364-f06dc5cb27cc None None] MFA Rules not processed for user `028918d07fe8481da7285c4b66f76203`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:34.169097 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-9d176619-a755-48da-b364-f06dc5cb27cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:34.207253 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f68e3-df7e-4fee-9353-3a9ad5668542 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:34.326314 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 869/1752] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:34 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:34.328183 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7988e-2ee1-4fdf-965c-540f4474a907 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:34.328718 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7988e-2ee1-4fdf-965c-540f4474a907 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:34.329149 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e98ef2-ce42-471b-aecb-9ae1f00be7ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:34.329442 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7988e-2ee1-4fdf-965c-540f4474a907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:34.331437 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e98ef2-ce42-471b-aecb-9ae1f00be7ab service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:34.331739 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e98ef2-ce42-471b-aecb-9ae1f00be7ab service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:34.336820 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e98ef2-ce42-471b-aecb-9ae1f00be7ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:34.355674 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-c4e98ef2-ce42-471b-aecb-9ae1f00be7ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:34.384264 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-27f7988e-2ee1-4fdf-965c-540f4474a907 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:34.387891 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-27f7988e-2ee1-4fdf-965c-540f4474a907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:34.418083 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 870/1753] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:34.418083 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022a1c6-22a4-46c8-a6d3-22ebf8eaeebc None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:34.419316 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022a1c6-22a4-46c8-a6d3-22ebf8eaeebc None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:34.420226 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022a1c6-22a4-46c8-a6d3-22ebf8eaeebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:34.472825 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-0022a1c6-22a4-46c8-a6d3-22ebf8eaeebc None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:34.475180 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-0022a1c6-22a4-46c8-a6d3-22ebf8eaeebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:34.498657 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 871/1754] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:34.499604 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022a1c6-22a4-46c8-a6d3-22ebf8eaeebc None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:34.528813 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022a1c6-22a4-46c8-a6d3-22ebf8eaeebc None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:34.547994 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf71b79-2b82-444d-9ede-938c773a194f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:34.549785 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf71b79-2b82-444d-9ede-938c773a194f admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:34.550175 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf71b79-2b82-444d-9ede-938c773a194f admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:34.550551 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf71b79-2b82-444d-9ede-938c773a194f admin admin] PATH_INFO: `/v3/projects/9c40f1f7b2684fbd994ab320dfb37250/users/e6076f10e3374a98a234ac8f65f1a91e/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:34.577896 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e98ef2-ce42-471b-aecb-9ae1f00be7ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:34.579537 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e98ef2-ce42-471b-aecb-9ae1f00be7ab service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:34.591262 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf71b79-2b82-444d-9ede-938c773a194f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c40f1f7b2684fbd994ab320dfb37250, user_id=e6076f10e3374a98a234ac8f65f1a91e, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:34.592555 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 884/1755] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:34 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:06:34.593868 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e98ef2-ce42-471b-aecb-9ae1f00be7ab service nova] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:34.596339 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-c4e98ef2-ce42-471b-aecb-9ae1f00be7ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:34.606223 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf71b79-2b82-444d-9ede-938c773a194f admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:34.617249 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e98ef2-ce42-471b-aecb-9ae1f00be7ab service nova] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:34.630323 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e78de1-c9cf-484b-882c-bd6f78c8046f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:34.631595 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e78de1-c9cf-484b-882c-bd6f78c8046f admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:34.632115 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e78de1-c9cf-484b-882c-bd6f78c8046f admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:34.653002 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e78de1-c9cf-484b-882c-bd6f78c8046f admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:34.653002 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e78de1-c9cf-484b-882c-bd6f78c8046f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:34.653002 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e78de1-c9cf-484b-882c-bd6f78c8046f admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:34.719384 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 872/1756] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:06:34 2022] PUT /identity/v3/projects/9c40f1f7b2684fbd994ab320dfb37250/users/e6076f10e3374a98a234ac8f65f1a91e/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:34.723028 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9972fc-8e68-4df0-bfbc-0146e915f437 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:34.723028 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9972fc-8e68-4df0-bfbc-0146e915f437 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:34.723028 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9972fc-8e68-4df0-bfbc-0146e915f437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:34.756532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 885/1757] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:06:34 2022] POST /identity/v3/projects => generated 365 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:34.758551 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e78de1-c9cf-484b-882c-bd6f78c8046f admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:34.777268 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:34.802865 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-fa9972fc-8e68-4df0-bfbc-0146e915f437 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:34.804365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-fa9972fc-8e68-4df0-bfbc-0146e915f437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:34.986775 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 873/1758] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:34.992577 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b571166-6644-4010-b293-5752e9a18939 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:34.995486 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b571166-6644-4010-b293-5752e9a18939 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:34.995486 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b571166-6644-4010-b293-5752e9a18939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:35.003045 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e78de1-c9cf-484b-882c-bd6f78c8046f admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:35.013341 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0783d2-e613-4252-a485-64fd2dfcdfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:35.015559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0783d2-e613-4252-a485-64fd2dfcdfc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:35.021680 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0783d2-e613-4252-a485-64fd2dfcdfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:35.024101 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0783d2-e613-4252-a485-64fd2dfcdfc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:35.024101 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0783d2-e613-4252-a485-64fd2dfcdfc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:06:35.024101 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0783d2-e613-4252-a485-64fd2dfcdfc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:35.029088 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0783d2-e613-4252-a485-64fd2dfcdfc2 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:35.076340 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 886/1759] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:06:35.082862 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc327a-b394-407e-9a71-795cfad2514a None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:35.083165 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc327a-b394-407e-9a71-795cfad2514a None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:35.083459 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc327a-b394-407e-9a71-795cfad2514a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:35.136361 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-6b571166-6644-4010-b293-5752e9a18939 None None] MFA Rules not processed for user `90ea5d52fd6d4068b7837d363eebb94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:35.138735 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-6b571166-6644-4010-b293-5752e9a18939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:35.189667 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-c3cc327a-b394-407e-9a71-795cfad2514a None None] MFA Rules not processed for user `e6076f10e3374a98a234ac8f65f1a91e`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:35.196684 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-c3cc327a-b394-407e-9a71-795cfad2514a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:35.328742 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 874/1760] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Jul 11 21:06:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:35.328742 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b571166-6644-4010-b293-5752e9a18939 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:35.335939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b571166-6644-4010-b293-5752e9a18939 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:35.348991 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03b3ae-9c55-4668-b9fb-ddd49993aef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:35.349888 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03b3ae-9c55-4668-b9fb-ddd49993aef5 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:35.350284 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03b3ae-9c55-4668-b9fb-ddd49993aef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:35.350671 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03b3ae-9c55-4668-b9fb-ddd49993aef5 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:35.351526 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da03b3ae-9c55-4668-b9fb-ddd49993aef5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:35.359851 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da03b3ae-9c55-4668-b9fb-ddd49993aef5 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:35.361269 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 887/1761] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:35.362549 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc327a-b394-407e-9a71-795cfad2514a None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:35.376301 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc327a-b394-407e-9a71-795cfad2514a None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:35.385237 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d901e-05a8-4e6c-a3fa-cbf9226dbcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:35.385237 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d901e-05a8-4e6c-a3fa-cbf9226dbcaf admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:35.385237 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d901e-05a8-4e6c-a3fa-cbf9226dbcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:35.385237 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d901e-05a8-4e6c-a3fa-cbf9226dbcaf admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:35.385605 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d901e-05a8-4e6c-a3fa-cbf9226dbcaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:06:35.385964 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d901e-05a8-4e6c-a3fa-cbf9226dbcaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:35.391935 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d901e-05a8-4e6c-a3fa-cbf9226dbcaf admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:35.405914 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 888/1762] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:06:35.406950 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d901e-05a8-4e6c-a3fa-cbf9226dbcaf admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:35.418665 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d901e-05a8-4e6c-a3fa-cbf9226dbcaf admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:35.425908 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e44c8-bef0-4537-96d3-741d1063e2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:35.426786 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e44c8-bef0-4537-96d3-741d1063e2cc admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:35.427128 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e44c8-bef0-4537-96d3-741d1063e2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:35.427415 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e44c8-bef0-4537-96d3-741d1063e2cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:35.429354 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3e44c8-bef0-4537-96d3-741d1063e2cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:35.433383 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3e44c8-bef0-4537-96d3-741d1063e2cc admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:35.486056 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 875/1763] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:06:35 2022] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:35.487184 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03b3ae-9c55-4668-b9fb-ddd49993aef5 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:35.510141 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03b3ae-9c55-4668-b9fb-ddd49993aef5 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:35.521380 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3eb5da-0833-4d72-aec4-066520c19a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:35.522348 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3eb5da-0833-4d72-aec4-066520c19a1d admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:35.522827 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3eb5da-0833-4d72-aec4-066520c19a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:35.523306 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3eb5da-0833-4d72-aec4-066520c19a1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:35.525193 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3eb5da-0833-4d72-aec4-066520c19a1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:35.530348 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3eb5da-0833-4d72-aec4-066520c19a1d admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:35.536405 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 889/1764] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:06:35 2022] POST /identity/v3/projects => generated 407 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:35.536405 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e44c8-bef0-4537-96d3-741d1063e2cc admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:35.670461 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e44c8-bef0-4537-96d3-741d1063e2cc admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:35.676393 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d2d82-5906-4576-a364-0fd5e9136e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:35.678204 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d2d82-5906-4576-a364-0fd5e9136e25 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:35.678505 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d2d82-5906-4576-a364-0fd5e9136e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:35.678793 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d2d82-5906-4576-a364-0fd5e9136e25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:35.679592 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d2d82-5906-4576-a364-0fd5e9136e25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:35.681936 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d2d82-5906-4576-a364-0fd5e9136e25 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:35.727721 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 876/1765] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:06:35 2022] POST /identity/v3/projects => generated 377 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:35.728920 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3eb5da-0833-4d72-aec4-066520c19a1d admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:35.810552 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 890/1766] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:06:35 2022] POST /identity/v3/projects => generated 405 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:35.811515 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d2d82-5906-4576-a364-0fd5e9136e25 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:35.892326 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3eb5da-0833-4d72-aec4-066520c19a1d admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:35.961133 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d2d82-5906-4576-a364-0fd5e9136e25 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:35.969372 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:35.979438 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee90c8-f238-4dc7-8b72-bd57d858d7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:35.980247 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee90c8-f238-4dc7-8b72-bd57d858d7b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:35.980537 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee90c8-f238-4dc7-8b72-bd57d858d7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:35.980820 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee90c8-f238-4dc7-8b72-bd57d858d7b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:35.981516 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee90c8-f238-4dc7-8b72-bd57d858d7b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:35.983469 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee90c8-f238-4dc7-8b72-bd57d858d7b4 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:36.052759 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11a8d8-6bd6-4d42-95c7-6bd9c233deea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:36.053542 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11a8d8-6bd6-4d42-95c7-6bd9c233deea admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:36.053830 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11a8d8-6bd6-4d42-95c7-6bd9c233deea admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:36.054107 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11a8d8-6bd6-4d42-95c7-6bd9c233deea admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:36.054849 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e11a8d8-6bd6-4d42-95c7-6bd9c233deea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:36.056689 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e11a8d8-6bd6-4d42-95c7-6bd9c233deea admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:36.094533 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 877/1767] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:36.095728 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11a8d8-6bd6-4d42-95c7-6bd9c233deea admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:36.104106 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 891/1768] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:06:35 2022] POST /identity/v3/users => generated 304 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:36.104106 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee90c8-f238-4dc7-8b72-bd57d858d7b4 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:36.112721 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-e0ee90c8-f238-4dc7-8b72-bd57d858d7b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:36.118409 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11a8d8-6bd6-4d42-95c7-6bd9c233deea admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:36.127695 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c22e26-10d0-4ad1-8660-c6e7430f1e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:36.129811 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c22e26-10d0-4ad1-8660-c6e7430f1e18 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:36.129811 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c22e26-10d0-4ad1-8660-c6e7430f1e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:36.130081 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c22e26-10d0-4ad1-8660-c6e7430f1e18 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:36.131627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c22e26-10d0-4ad1-8660-c6e7430f1e18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:36.134244 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c22e26-10d0-4ad1-8660-c6e7430f1e18 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:36.283762 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee90c8-f238-4dc7-8b72-bd57d858d7b4 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:36.290097 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e34220-9b10-41d4-b7f4-efd3742e28c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc950dfb1d3b4308a33f3d430fe34c1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:36.291214 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e34220-9b10-41d4-b7f4-efd3742e28c3 service swift] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:36.291768 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e34220-9b10-41d4-b7f4-efd3742e28c3 service swift] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:36.296660 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e34220-9b10-41d4-b7f4-efd3742e28c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:36.303563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 878/1769] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:06:36 2022] POST /identity/v3/users => generated 295 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:36.303952 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c22e26-10d0-4ad1-8660-c6e7430f1e18 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:36.334638 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c22e26-10d0-4ad1-8660-c6e7430f1e18 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:36.348666 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50e066-f222-42d7-91a8-074cb34c24b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:36.349384 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50e066-f222-42d7-91a8-074cb34c24b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:36.349694 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50e066-f222-42d7-91a8-074cb34c24b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:36.350016 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50e066-f222-42d7-91a8-074cb34c24b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:36.350781 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d50e066-f222-42d7-91a8-074cb34c24b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:36.352750 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d50e066-f222-42d7-91a8-074cb34c24b1 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:36.422273 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e34220-9b10-41d4-b7f4-efd3742e28c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:36.426359 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e34220-9b10-41d4-b7f4-efd3742e28c3 service swift] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:36.448237 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 892/1770] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jul 11 21:06:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 21:06:36.465989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5cd9b-ff1f-4246-a7b0-0bb958350302 None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:36.466396 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5cd9b-ff1f-4246-a7b0-0bb958350302 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:36.466805 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5cd9b-ff1f-4246-a7b0-0bb958350302 None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:36.469140 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 893/1771] 10.222.0.40 () {54 vars in 912 bytes} [Mon Jul 11 21:06:36 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 21:06:36.469777 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5cd9b-ff1f-4246-a7b0-0bb958350302 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:36.504781 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 879/1772] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:06:36 2022] POST /identity/v3/users => generated 303 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:36.508162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5cd9b-ff1f-4246-a7b0-0bb958350302 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:36.509639 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50e066-f222-42d7-91a8-074cb34c24b1 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:36.523350 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a6150b-ae24-4273-857e-7032cf9a3957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:36.530390 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6150b-ae24-4273-857e-7032cf9a3957 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:36.530390 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6150b-ae24-4273-857e-7032cf9a3957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:36.530390 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6150b-ae24-4273-857e-7032cf9a3957 admin admin] PATH_INFO: `/v3/projects/948dcdb4e2234539b61baeaf6e4fe261/users/cd3cd27ed6fe4ec9b93907b397c21abc/roles/86273ff072f3438d822e870272491768` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:36.568416 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50e066-f222-42d7-91a8-074cb34c24b1 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:36.582763 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a6150b-ae24-4273-857e-7032cf9a3957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=948dcdb4e2234539b61baeaf6e4fe261, user_id=cd3cd27ed6fe4ec9b93907b397c21abc, role_id=86273ff072f3438d822e870272491768)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:36.586994 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac88ed3-8adc-420f-af2b-6962beaa4d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:36.588979 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac88ed3-8adc-420f-af2b-6962beaa4d45 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:36.589410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a6150b-ae24-4273-857e-7032cf9a3957 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:36.593499 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac88ed3-8adc-420f-af2b-6962beaa4d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:36.594142 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac88ed3-8adc-420f-af2b-6962beaa4d45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:36.602566 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac88ed3-8adc-420f-af2b-6962beaa4d45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:36.609174 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac88ed3-8adc-420f-af2b-6962beaa4d45 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:36.668542 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 880/1773] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:36.669468 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac88ed3-8adc-420f-af2b-6962beaa4d45 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:36.701806 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac88ed3-8adc-420f-af2b-6962beaa4d45 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:36.718860 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 894/1774] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:06:36 2022] PUT /identity/v3/projects/948dcdb4e2234539b61baeaf6e4fe261/users/cd3cd27ed6fe4ec9b93907b397c21abc/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:36.725737 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57770dae-c81c-4a41-8054-e9d0565c3a1c None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:36.727954 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57770dae-c81c-4a41-8054-e9d0565c3a1c None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:36.733197 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57770dae-c81c-4a41-8054-e9d0565c3a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:36.824147 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-57770dae-c81c-4a41-8054-e9d0565c3a1c None None] MFA Rules not processed for user `29046b079f1a4f4ea2244e69cbbaa805`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:36.827610 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-57770dae-c81c-4a41-8054-e9d0565c3a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:36.839753 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67eb55-ea13-44fb-9165-0c2339967b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:36.841199 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67eb55-ea13-44fb-9165-0c2339967b1c admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:36.841655 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67eb55-ea13-44fb-9165-0c2339967b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:36.842102 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67eb55-ea13-44fb-9165-0c2339967b1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:36.844903 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a67eb55-ea13-44fb-9165-0c2339967b1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:36.847429 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a67eb55-ea13-44fb-9165-0c2339967b1c admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:36.877393 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:36.884343 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 881/1775] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:36.884343 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67eb55-ea13-44fb-9165-0c2339967b1c admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:36.893545 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67eb55-ea13-44fb-9165-0c2339967b1c admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:36.913110 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c91f66-4585-40a6-beb5-4a6068be1e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:36.913110 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c91f66-4585-40a6-beb5-4a6068be1e5c admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:36.913110 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c91f66-4585-40a6-beb5-4a6068be1e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:36.913110 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c91f66-4585-40a6-beb5-4a6068be1e5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:36.913997 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c91f66-4585-40a6-beb5-4a6068be1e5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:36.926544 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c91f66-4585-40a6-beb5-4a6068be1e5c admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:36.981600 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 882/1776] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:36.981600 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c91f66-4585-40a6-beb5-4a6068be1e5c admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:37.025694 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c91f66-4585-40a6-beb5-4a6068be1e5c admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:37.027952 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 895/1777] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Jul 11 21:06:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:37.032650 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57770dae-c81c-4a41-8054-e9d0565c3a1c None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:37.047552 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb96c9c-a77d-4395-86a3-2c875f6c52a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:37.048690 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb96c9c-a77d-4395-86a3-2c875f6c52a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:37.050541 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb96c9c-a77d-4395-86a3-2c875f6c52a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:37.051181 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb96c9c-a77d-4395-86a3-2c875f6c52a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:37.053930 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb96c9c-a77d-4395-86a3-2c875f6c52a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:37.056450 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb96c9c-a77d-4395-86a3-2c875f6c52a6 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:37.074302 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57770dae-c81c-4a41-8054-e9d0565c3a1c None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:37.095787 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 883/1778] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:37.095787 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3055b9-f114-49c5-9a81-bd30942bee89 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:37.095787 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3055b9-f114-49c5-9a81-bd30942bee89 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:37.095787 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3055b9-f114-49c5-9a81-bd30942bee89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:37.097085 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30836a51-7c60-499b-a408-0dc851e47433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:37.097807 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30836a51-7c60-499b-a408-0dc851e47433 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:37.098153 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30836a51-7c60-499b-a408-0dc851e47433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:37.098478 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30836a51-7c60-499b-a408-0dc851e47433 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:37.102644 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30836a51-7c60-499b-a408-0dc851e47433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:37.108450 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30836a51-7c60-499b-a408-0dc851e47433 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:37.129717 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 896/1779] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:37.134311 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30836a51-7c60-499b-a408-0dc851e47433 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:37.145284 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-3f3055b9-f114-49c5-9a81-bd30942bee89 None None] MFA Rules not processed for user `29046b079f1a4f4ea2244e69cbbaa805`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:37.145284 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-3f3055b9-f114-49c5-9a81-bd30942bee89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:37.146854 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 884/1780] 10.222.0.27 () {58 vars in 1015 bytes} [Mon Jul 11 21:06:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:37.147722 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3055b9-f114-49c5-9a81-bd30942bee89 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:37.149550 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30836a51-7c60-499b-a408-0dc851e47433 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:37.158546 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e52616-3672-4021-82b7-61ecd7480fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:37.159996 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e52616-3672-4021-82b7-61ecd7480fbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:37.160656 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e52616-3672-4021-82b7-61ecd7480fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:37.161023 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e52616-3672-4021-82b7-61ecd7480fbf admin admin] PATH_INFO: `/v3/projects/95125ca954f040e2ab1bca2d13b9955d/users/9b50028d00af4eb7ac129cd1fca386e5/roles/86273ff072f3438d822e870272491768` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:37.164564 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3055b9-f114-49c5-9a81-bd30942bee89 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:37.171296 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c157caa-5204-46fa-a68c-a848981c66cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:37.174066 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c157caa-5204-46fa-a68c-a848981c66cc admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:37.174066 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c157caa-5204-46fa-a68c-a848981c66cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:37.174066 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c157caa-5204-46fa-a68c-a848981c66cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:37.174626 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c157caa-5204-46fa-a68c-a848981c66cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:37.176588 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c157caa-5204-46fa-a68c-a848981c66cc admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:37.193812 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 885/1781] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:37.193812 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c157caa-5204-46fa-a68c-a848981c66cc admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:37.194069 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-3c157caa-5204-46fa-a68c-a848981c66cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:37.216282 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c157caa-5204-46fa-a68c-a848981c66cc admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:37.222312 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e52616-3672-4021-82b7-61ecd7480fbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=95125ca954f040e2ab1bca2d13b9955d, user_id=9b50028d00af4eb7ac129cd1fca386e5, role_id=86273ff072f3438d822e870272491768)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:37.222490 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f55c6-188c-499c-bbf1-0acc077ef3ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:37.223272 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f55c6-188c-499c-bbf1-0acc077ef3ff service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:37.224551 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f55c6-188c-499c-bbf1-0acc077ef3ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:37.224746 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f55c6-188c-499c-bbf1-0acc077ef3ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:37.236242 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e52616-3672-4021-82b7-61ecd7480fbf admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:37.248613 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f55c6-188c-499c-bbf1-0acc077ef3ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:37.252022 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f55c6-188c-499c-bbf1-0acc077ef3ff service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:37.265612 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 886/1782] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:06:37.266711 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f55c6-188c-499c-bbf1-0acc077ef3ff service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:37.287771 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f55c6-188c-499c-bbf1-0acc077ef3ff service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:37.293854 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd1dc8-cee8-4dfa-aa47-1036ea9fa78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:37.295862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd1dc8-cee8-4dfa-aa47-1036ea9fa78b admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:37.296382 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd1dc8-cee8-4dfa-aa47-1036ea9fa78b admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:37.296938 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd1dc8-cee8-4dfa-aa47-1036ea9fa78b admin admin] PATH_INFO: `/v3/projects/9d53abc0a92a43b3a32839070f4779d4/users/b485af1cf29f4df3b11b3a1c1c4dfe28/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:37.319420 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd1dc8-cee8-4dfa-aa47-1036ea9fa78b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d53abc0a92a43b3a32839070f4779d4, user_id=b485af1cf29f4df3b11b3a1c1c4dfe28, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:37.322667 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd1dc8-cee8-4dfa-aa47-1036ea9fa78b admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:37.347857 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 897/1783] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:06:37 2022] PUT /identity/v3/projects/95125ca954f040e2ab1bca2d13b9955d/users/9b50028d00af4eb7ac129cd1fca386e5/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:37.349211 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e52616-3672-4021-82b7-61ecd7480fbf admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:37.395818 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 887/1784] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:06:37 2022] PUT /identity/v3/projects/9d53abc0a92a43b3a32839070f4779d4/users/b485af1cf29f4df3b11b3a1c1c4dfe28/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:37.396755 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd1dc8-cee8-4dfa-aa47-1036ea9fa78b admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:37.478610 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd1dc8-cee8-4dfa-aa47-1036ea9fa78b admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:37.485890 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d072b1e-09dd-47cc-92df-243ee6eb3ba9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:37.485890 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d072b1e-09dd-47cc-92df-243ee6eb3ba9 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:37.485890 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d072b1e-09dd-47cc-92df-243ee6eb3ba9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:37.485890 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d072b1e-09dd-47cc-92df-243ee6eb3ba9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:37.498175 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d072b1e-09dd-47cc-92df-243ee6eb3ba9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:37.500783 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d072b1e-09dd-47cc-92df-243ee6eb3ba9 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:37.510050 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 888/1785] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:06:37.514222 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d072b1e-09dd-47cc-92df-243ee6eb3ba9 service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:37.544413 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e52616-3672-4021-82b7-61ecd7480fbf admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:37.565996 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:37.626059 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d072b1e-09dd-47cc-92df-243ee6eb3ba9 service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:37.671456 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc23b79-bc1b-4f95-9bb3-000db8fd6a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:37.674141 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc23b79-bc1b-4f95-9bb3-000db8fd6a7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:37.674524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc23b79-bc1b-4f95-9bb3-000db8fd6a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:37.674881 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc23b79-bc1b-4f95-9bb3-000db8fd6a7a admin admin] PATH_INFO: `/v3/projects/948dcdb4e2234539b61baeaf6e4fe261/users/cd3cd27ed6fe4ec9b93907b397c21abc/roles/86273ff072f3438d822e870272491768` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:37.677391 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc23b79-bc1b-4f95-9bb3-000db8fd6a7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=948dcdb4e2234539b61baeaf6e4fe261, user_id=cd3cd27ed6fe4ec9b93907b397c21abc, role_id=86273ff072f3438d822e870272491768)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:37.680863 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc23b79-bc1b-4f95-9bb3-000db8fd6a7a admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:37.684185 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d1ac7-bb99-43d6-9dc7-38459f43ea08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:37.686347 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d1ac7-bb99-43d6-9dc7-38459f43ea08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:37.686644 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d1ac7-bb99-43d6-9dc7-38459f43ea08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:37.687063 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d1ac7-bb99-43d6-9dc7-38459f43ea08 admin admin] PATH_INFO: `/v3/projects/4593295eecad4fc6bd2905302804d698/users/111f80eb60cd49359552bf7af56e8358/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:37.707094 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 898/1786] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:06:37 2022] PUT /identity/v3/projects/948dcdb4e2234539b61baeaf6e4fe261/users/cd3cd27ed6fe4ec9b93907b397c21abc/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:37.722354 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614557b-d59c-4ec0-bf6c-3156ff907f8b None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:37.722354 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614557b-d59c-4ec0-bf6c-3156ff907f8b None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:37.722354 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614557b-d59c-4ec0-bf6c-3156ff907f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:37.731559 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d1ac7-bb99-43d6-9dc7-38459f43ea08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4593295eecad4fc6bd2905302804d698, user_id=111f80eb60cd49359552bf7af56e8358, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:37.739119 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d1ac7-bb99-43d6-9dc7-38459f43ea08 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:37.763930 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-1614557b-d59c-4ec0-bf6c-3156ff907f8b None None] MFA Rules not processed for user `6b67d92f0f644bc0861995318d10441c`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:37.766096 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-1614557b-d59c-4ec0-bf6c-3156ff907f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:37.837779 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 889/1787] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:06:37 2022] PUT /identity/v3/projects/4593295eecad4fc6bd2905302804d698/users/111f80eb60cd49359552bf7af56e8358/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:37.838742 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d1ac7-bb99-43d6-9dc7-38459f43ea08 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:37.942106 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 899/1788] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:37.942106 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40b58d-f5d0-47e5-ac90-c9e2dfbd5795 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:37.942106 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40b58d-f5d0-47e5-ac90-c9e2dfbd5795 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:37.942106 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40b58d-f5d0-47e5-ac90-c9e2dfbd5795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:38.060688 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-3c40b58d-f5d0-47e5-ac90-c9e2dfbd5795 None None] MFA Rules not processed for user `b485af1cf29f4df3b11b3a1c1c4dfe28`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:38.065082 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d1ac7-bb99-43d6-9dc7-38459f43ea08 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:38.066819 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-3c40b58d-f5d0-47e5-ac90-c9e2dfbd5795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:38.085384 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0bfab6-d475-44b4-bffc-29efc4df8a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:38.086123 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0bfab6-d475-44b4-bffc-29efc4df8a5c admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:38.087178 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0bfab6-d475-44b4-bffc-29efc4df8a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:38.087178 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0bfab6-d475-44b4-bffc-29efc4df8a5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:38.087427 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0bfab6-d475-44b4-bffc-29efc4df8a5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:38.089762 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0bfab6-d475-44b4-bffc-29efc4df8a5c admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:38.123414 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 890/1789] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:38.126434 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22723c-40ea-4be7-aa72-dba30408be4e None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:38.126434 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22723c-40ea-4be7-aa72-dba30408be4e None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:38.133686 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22723c-40ea-4be7-aa72-dba30408be4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:38.204116 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-0c22723c-40ea-4be7-aa72-dba30408be4e None None] MFA Rules not processed for user `cd3cd27ed6fe4ec9b93907b397c21abc`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:38.205413 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-0c22723c-40ea-4be7-aa72-dba30408be4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:38.213487 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:38.291057 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 900/1790] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:37 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:38.294086 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a6632-5f0c-4000-91f1-f42a9b552636 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:38.294404 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a6632-5f0c-4000-91f1-f42a9b552636 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:38.294694 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a6632-5f0c-4000-91f1-f42a9b552636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:38.372814 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-809a6632-5f0c-4000-91f1-f42a9b552636 None None] MFA Rules not processed for user `111f80eb60cd49359552bf7af56e8358`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:38.374796 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-809a6632-5f0c-4000-91f1-f42a9b552636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:38.379317 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 891/1791] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:38 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:38.379317 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c22723c-40ea-4be7-aa72-dba30408be4e None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:38.419079 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c22723c-40ea-4be7-aa72-dba30408be4e None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:38.434429 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3604ad0-853b-44ef-b2d0-4f9c8404aa3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:38.435295 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3604ad0-853b-44ef-b2d0-4f9c8404aa3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:38.435593 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3604ad0-853b-44ef-b2d0-4f9c8404aa3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:38.435878 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3604ad0-853b-44ef-b2d0-4f9c8404aa3a admin admin] PATH_INFO: `/v3/projects/95125ca954f040e2ab1bca2d13b9955d/users/9b50028d00af4eb7ac129cd1fca386e5/roles/86273ff072f3438d822e870272491768` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:38.440937 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3604ad0-853b-44ef-b2d0-4f9c8404aa3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=95125ca954f040e2ab1bca2d13b9955d, user_id=9b50028d00af4eb7ac129cd1fca386e5, role_id=86273ff072f3438d822e870272491768)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:38.448866 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3604ad0-853b-44ef-b2d0-4f9c8404aa3a admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:38.477498 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 892/1792] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:06:38 2022] PUT /identity/v3/projects/95125ca954f040e2ab1bca2d13b9955d/users/9b50028d00af4eb7ac129cd1fca386e5/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:38.478417 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3604ad0-853b-44ef-b2d0-4f9c8404aa3a admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:38.494569 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:38.559698 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 901/1793] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:38 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:38.564697 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a6632-5f0c-4000-91f1-f42a9b552636 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:38.568753 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-809a6632-5f0c-4000-91f1-f42a9b552636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:38.602547 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3604ad0-853b-44ef-b2d0-4f9c8404aa3a admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:38.616124 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b480662d-8c5f-447b-b3bd-d5b412717e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:38.616978 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480662d-8c5f-447b-b3bd-d5b412717e61 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:38.619802 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480662d-8c5f-447b-b3bd-d5b412717e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:38.619802 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480662d-8c5f-447b-b3bd-d5b412717e61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:38.619802 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b480662d-8c5f-447b-b3bd-d5b412717e61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:38.620982 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b480662d-8c5f-447b-b3bd-d5b412717e61 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:38.694440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a6632-5f0c-4000-91f1-f42a9b552636 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:38.765851 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 893/1794] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:06:38 2022] POST /identity/v3/projects => generated 407 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:38.768180 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453048a-4069-4ff8-a9a8-6ff630a54ae4 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:38.768943 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453048a-4069-4ff8-a9a8-6ff630a54ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:38.769717 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453048a-4069-4ff8-a9a8-6ff630a54ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:38.792984 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0cd64-d749-4dca-a634-052a303e6fc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:38.793918 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0cd64-d749-4dca-a634-052a303e6fc7 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:38.794388 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0cd64-d749-4dca-a634-052a303e6fc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:38.794772 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0cd64-d749-4dca-a634-052a303e6fc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:38.843055 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-1453048a-4069-4ff8-a9a8-6ff630a54ae4 None None] MFA Rules not processed for user `9b50028d00af4eb7ac129cd1fca386e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:38.844483 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-1453048a-4069-4ff8-a9a8-6ff630a54ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:38.936978 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0cd64-d749-4dca-a634-052a303e6fc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:38.938622 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0cd64-d749-4dca-a634-052a303e6fc7 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:38.950838 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 902/1795] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:38 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:06:38.951931 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0cd64-d749-4dca-a634-052a303e6fc7 service cinder] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:38.965649 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0cd64-d749-4dca-a634-052a303e6fc7 service cinder] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:38.996726 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 894/1796] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:38 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:38.998601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453048a-4069-4ff8-a9a8-6ff630a54ae4 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:39.093470 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:39.118460 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee29e0-3390-4de9-b1ac-32e041883709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:39.119197 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee29e0-3390-4de9-b1ac-32e041883709 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:39.119477 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee29e0-3390-4de9-b1ac-32e041883709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:39.119746 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee29e0-3390-4de9-b1ac-32e041883709 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:39.121479 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee29e0-3390-4de9-b1ac-32e041883709 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:39.123439 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee29e0-3390-4de9-b1ac-32e041883709 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:39.137395 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453048a-4069-4ff8-a9a8-6ff630a54ae4 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:39.147506 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10c4cb-2184-413a-b04d-e285bbbde795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:39.153897 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10c4cb-2184-413a-b04d-e285bbbde795 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:39.154638 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10c4cb-2184-413a-b04d-e285bbbde795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:39.155200 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10c4cb-2184-413a-b04d-e285bbbde795 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:39.156104 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10c4cb-2184-413a-b04d-e285bbbde795 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:39.158517 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10c4cb-2184-413a-b04d-e285bbbde795 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:39.303690 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 895/1797] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:06:38 2022] POST /identity/v3/users => generated 310 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:39.306540 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10c4cb-2184-413a-b04d-e285bbbde795 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:39.312692 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-ec10c4cb-2184-413a-b04d-e285bbbde795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:39.343018 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 903/1798] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:06:38 2022] POST /identity/v3/projects => generated 405 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:39.343923 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee29e0-3390-4de9-b1ac-32e041883709 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:39.441500 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10c4cb-2184-413a-b04d-e285bbbde795 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:39.501515 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4507a1-5a05-42a2-a811-539a2a3a7651 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:39.502296 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4507a1-5a05-42a2-a811-539a2a3a7651 service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:39.502534 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4507a1-5a05-42a2-a811-539a2a3a7651 service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:39.502836 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4507a1-5a05-42a2-a811-539a2a3a7651 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:39.583081 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee29e0-3390-4de9-b1ac-32e041883709 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:39.590605 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4507a1-5a05-42a2-a811-539a2a3a7651 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:39.593208 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4507a1-5a05-42a2-a811-539a2a3a7651 service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:39.594141 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eedca8-e640-4a63-8032-c0eb4cb107eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:39.595042 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eedca8-e640-4a63-8032-c0eb4cb107eb service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:39.595650 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eedca8-e640-4a63-8032-c0eb4cb107eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:39.596177 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eedca8-e640-4a63-8032-c0eb4cb107eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:39.614851 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 896/1799] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:06:39.617336 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4507a1-5a05-42a2-a811-539a2a3a7651 service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:39.788407 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4507a1-5a05-42a2-a811-539a2a3a7651 service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:39.840778 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eedca8-e640-4a63-8032-c0eb4cb107eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:39.840778 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eedca8-e640-4a63-8032-c0eb4cb107eb service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:39.842116 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd4fde-cb64-4bf5-83a7-8835663660b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:39.842116 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd4fde-cb64-4bf5-83a7-8835663660b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:39.842116 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd4fde-cb64-4bf5-83a7-8835663660b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:39.842116 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd4fde-cb64-4bf5-83a7-8835663660b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:39.842634 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbd4fde-cb64-4bf5-83a7-8835663660b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:39.842634 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbd4fde-cb64-4bf5-83a7-8835663660b4 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:39.842780 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 904/1800] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:39 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:06:39.842780 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eedca8-e640-4a63-8032-c0eb4cb107eb service cinder] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:39.845124 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eedca8-e640-4a63-8032-c0eb4cb107eb service cinder] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:39.863402 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a11a5f-89e4-47c6-85e1-887ba905ffcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:39.863700 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a11a5f-89e4-47c6-85e1-887ba905ffcd admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:39.864009 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a11a5f-89e4-47c6-85e1-887ba905ffcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:39.864265 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a11a5f-89e4-47c6-85e1-887ba905ffcd admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:39.865377 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a11a5f-89e4-47c6-85e1-887ba905ffcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:39.867388 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a11a5f-89e4-47c6-85e1-887ba905ffcd admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:39.874681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 897/1801] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:39.883644 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0694e8-2369-4263-ad9b-d143ed7ab057 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:39.885601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0694e8-2369-4263-ad9b-d143ed7ab057 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:39.888464 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0694e8-2369-4263-ad9b-d143ed7ab057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:39.960853 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-1e0694e8-2369-4263-ad9b-d143ed7ab057 None None] MFA Rules not processed for user `01541b7e5e984884bf87ef6d31b9480c`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:39.963663 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-1e0694e8-2369-4263-ad9b-d143ed7ab057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:40.097122 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 898/1802] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:40.098716 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0694e8-2369-4263-ad9b-d143ed7ab057 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:40.117270 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0694e8-2369-4263-ad9b-d143ed7ab057 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:40.123915 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cea7de-b47b-470a-b549-e20a9533d40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:40.125047 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cea7de-b47b-470a-b549-e20a9533d40d admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:40.125652 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cea7de-b47b-470a-b549-e20a9533d40d admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:40.126177 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cea7de-b47b-470a-b549-e20a9533d40d admin admin] PATH_INFO: `/v3/projects/aad3040c2c1e45d1a8a8f9fe0d6b14bc/users/7107b99219c048ceb92f72d30477034f/roles/86273ff072f3438d822e870272491768` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:40.163429 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cea7de-b47b-470a-b549-e20a9533d40d admin admin] RBAC: Authorizing `identity:create_grant(project_id=aad3040c2c1e45d1a8a8f9fe0d6b14bc, user_id=7107b99219c048ceb92f72d30477034f, role_id=86273ff072f3438d822e870272491768)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:40.169300 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cea7de-b47b-470a-b549-e20a9533d40d admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:40.232455 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 905/1803] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:06:39 2022] POST /identity/v3/users => generated 309 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:40.235407 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a11a5f-89e4-47c6-85e1-887ba905ffcd admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:40.254374 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a11a5f-89e4-47c6-85e1-887ba905ffcd admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:40.260196 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12089742-e2f8-4290-930c-d3c18777038d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:40.261873 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12089742-e2f8-4290-930c-d3c18777038d admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:40.262200 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12089742-e2f8-4290-930c-d3c18777038d admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:40.262716 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12089742-e2f8-4290-930c-d3c18777038d admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:40.263571 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12089742-e2f8-4290-930c-d3c18777038d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:40.265825 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12089742-e2f8-4290-930c-d3c18777038d admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:40.282374 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 906/1804] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:40.286622 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12089742-e2f8-4290-930c-d3c18777038d admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:40.292325 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 899/1805] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:06:40 2022] PUT /identity/v3/projects/aad3040c2c1e45d1a8a8f9fe0d6b14bc/users/7107b99219c048ceb92f72d30477034f/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:40.294479 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cea7de-b47b-470a-b549-e20a9533d40d admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:40.340501 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12089742-e2f8-4290-930c-d3c18777038d admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:40.547040 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c3be2-cee4-4137-9dc5-806c93692b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:40.554421 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c3be2-cee4-4137-9dc5-806c93692b3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:40.554421 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c3be2-cee4-4137-9dc5-806c93692b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:40.554421 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c3be2-cee4-4137-9dc5-806c93692b3b admin admin] PATH_INFO: `/v3/projects/8b67ee815f7b436f9d44a37bd4ec8b75/users/2502716c2b944b3f88fc4c0f00eeea08/roles/86273ff072f3438d822e870272491768` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:40.574641 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:40.592215 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cea7de-b47b-470a-b549-e20a9533d40d admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:40.606411 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82c3be2-cee4-4137-9dc5-806c93692b3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b67ee815f7b436f9d44a37bd4ec8b75, user_id=2502716c2b944b3f88fc4c0f00eeea08, role_id=86273ff072f3438d822e870272491768)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:40.632622 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82c3be2-cee4-4137-9dc5-806c93692b3b admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:40.652388 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c690a-feb0-4bff-8f1d-66b5db8360f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:40.653191 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c690a-feb0-4bff-8f1d-66b5db8360f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:40.653438 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c690a-feb0-4bff-8f1d-66b5db8360f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:40.668940 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c690a-feb0-4bff-8f1d-66b5db8360f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:40.669588 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c690a-feb0-4bff-8f1d-66b5db8360f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:40.673958 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c690a-feb0-4bff-8f1d-66b5db8360f1 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:40.721973 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 900/1806] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:40.721973 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5b85c-0e1f-4f7c-a8c7-d5d6b25371f4 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:40.721973 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5b85c-0e1f-4f7c-a8c7-d5d6b25371f4 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:40.721973 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5b85c-0e1f-4f7c-a8c7-d5d6b25371f4 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:40.751057 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 901/1807] 10.222.0.40 () {54 vars in 921 bytes} [Mon Jul 11 21:06:40 2022] GET /identity => generated 270 bytes in 28 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 21:06:40.751136 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 907/1808] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:06:40 2022] PUT /identity/v3/projects/8b67ee815f7b436f9d44a37bd4ec8b75/users/2502716c2b944b3f88fc4c0f00eeea08/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:40.751217 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5b85c-0e1f-4f7c-a8c7-d5d6b25371f4 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:40.755350 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c3be2-cee4-4137-9dc5-806c93692b3b admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:40.971546 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:41.011806 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c3be2-cee4-4137-9dc5-806c93692b3b admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:41.029949 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488264f6-bb9c-442c-bfc7-a321b47e8b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:41.032112 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488264f6-bb9c-442c-bfc7-a321b47e8b20 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:41.032430 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488264f6-bb9c-442c-bfc7-a321b47e8b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:41.032744 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488264f6-bb9c-442c-bfc7-a321b47e8b20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:41.035953 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488264f6-bb9c-442c-bfc7-a321b47e8b20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:41.037715 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488264f6-bb9c-442c-bfc7-a321b47e8b20 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:41.064034 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5b85c-0e1f-4f7c-a8c7-d5d6b25371f4 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:41.084807 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e8031-8eda-4bc6-bb4e-cf7267062832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:41.085839 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e8031-8eda-4bc6-bb4e-cf7267062832 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:41.086089 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e8031-8eda-4bc6-bb4e-cf7267062832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:41.086376 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e8031-8eda-4bc6-bb4e-cf7267062832 admin admin] PATH_INFO: `/v3/projects/aad3040c2c1e45d1a8a8f9fe0d6b14bc/users/7107b99219c048ceb92f72d30477034f/roles/86273ff072f3438d822e870272491768` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:41.093296 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 908/1809] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:41.093965 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2e8031-8eda-4bc6-bb4e-cf7267062832 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aad3040c2c1e45d1a8a8f9fe0d6b14bc, user_id=7107b99219c048ceb92f72d30477034f, role_id=86273ff072f3438d822e870272491768)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:41.100005 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2e8031-8eda-4bc6-bb4e-cf7267062832 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:41.110804 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488264f6-bb9c-442c-bfc7-a321b47e8b20 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:41.168110 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 902/1810] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:06:40 2022] PUT /identity/v3/projects/aad3040c2c1e45d1a8a8f9fe0d6b14bc/users/7107b99219c048ceb92f72d30477034f/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:41.168110 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d76511-1ed6-4aba-9cb9-235878c82f11 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:41.168110 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d76511-1ed6-4aba-9cb9-235878c82f11 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:41.168110 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d76511-1ed6-4aba-9cb9-235878c82f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:41.171725 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488264f6-bb9c-442c-bfc7-a321b47e8b20 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:41.267901 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-85d76511-1ed6-4aba-9cb9-235878c82f11 None None] MFA Rules not processed for user `8ac15411c75f4bd4a86f6753c9240a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:41.269247 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-85d76511-1ed6-4aba-9cb9-235878c82f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:41.505443 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7623c56-0a39-46f4-a49e-f589262cd4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:41.510910 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7623c56-0a39-46f4-a49e-f589262cd4c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:41.510910 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7623c56-0a39-46f4-a49e-f589262cd4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:41.510910 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7623c56-0a39-46f4-a49e-f589262cd4c3 admin admin] PATH_INFO: `/v3/projects/8b67ee815f7b436f9d44a37bd4ec8b75/users/2502716c2b944b3f88fc4c0f00eeea08/roles/86273ff072f3438d822e870272491768` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:41.510910 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7623c56-0a39-46f4-a49e-f589262cd4c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b67ee815f7b436f9d44a37bd4ec8b75, user_id=2502716c2b944b3f88fc4c0f00eeea08, role_id=86273ff072f3438d822e870272491768)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:41.514813 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7623c56-0a39-46f4-a49e-f589262cd4c3 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:41.534019 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 909/1811] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:06:41 2022] PUT /identity/v3/projects/8b67ee815f7b436f9d44a37bd4ec8b75/users/2502716c2b944b3f88fc4c0f00eeea08/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:41.535439 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148a513-fa13-42ac-a044-46b73eb43e0d None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:41.535812 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148a513-fa13-42ac-a044-46b73eb43e0d None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:41.536231 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148a513-fa13-42ac-a044-46b73eb43e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:41.552896 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 903/1812] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Jul 11 21:06:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:41.554316 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27280278-721e-46a2-a83f-32abcd95954c None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:41.554722 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27280278-721e-46a2-a83f-32abcd95954c None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:41.554884 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27280278-721e-46a2-a83f-32abcd95954c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:41.609083 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-8148a513-fa13-42ac-a044-46b73eb43e0d None None] MFA Rules not processed for user `7107b99219c048ceb92f72d30477034f`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:41.610622 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-8148a513-fa13-42ac-a044-46b73eb43e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:41.627302 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-27280278-721e-46a2-a83f-32abcd95954c None None] MFA Rules not processed for user `2502716c2b944b3f88fc4c0f00eeea08`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:41.628792 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-27280278-721e-46a2-a83f-32abcd95954c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:41.806375 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:41.856759 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:41.864575 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 910/1813] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:41 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:41.917973 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148a513-fa13-42ac-a044-46b73eb43e0d None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:41.935347 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 904/1814] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:41 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:42.034510 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27280278-721e-46a2-a83f-32abcd95954c None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:42.113756 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148a513-fa13-42ac-a044-46b73eb43e0d None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:42.125193 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539bbed-b2b9-497a-877b-ace1dcde779a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:42.126280 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539bbed-b2b9-497a-877b-ace1dcde779a service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:42.126904 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539bbed-b2b9-497a-877b-ace1dcde779a service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:42.127401 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539bbed-b2b9-497a-877b-ace1dcde779a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:42.152819 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539bbed-b2b9-497a-877b-ace1dcde779a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:42.154671 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539bbed-b2b9-497a-877b-ace1dcde779a service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:42.182176 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 911/1815] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:41 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 21:06:42.184875 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539bbed-b2b9-497a-877b-ace1dcde779a service cinder] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:42.190759 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a539bbed-b2b9-497a-877b-ace1dcde779a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:42.218968 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27280278-721e-46a2-a83f-32abcd95954c None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:42.232359 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325b6d8-50e3-4c2b-bd3a-886cbdc4d20c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:42.233924 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325b6d8-50e3-4c2b-bd3a-886cbdc4d20c service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:42.236978 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325b6d8-50e3-4c2b-bd3a-886cbdc4d20c service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:42.237524 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325b6d8-50e3-4c2b-bd3a-886cbdc4d20c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:42.314979 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2325b6d8-50e3-4c2b-bd3a-886cbdc4d20c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:42.323842 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2325b6d8-50e3-4c2b-bd3a-886cbdc4d20c service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:42.360002 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 905/1816] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:42 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 21:06:42.367079 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539bbed-b2b9-497a-877b-ace1dcde779a service cinder] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:42.379044 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff9cb4-3fa4-4a5c-9475-03b51f857c8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:42.398658 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff9cb4-3fa4-4a5c-9475-03b51f857c8a service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:42.404407 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff9cb4-3fa4-4a5c-9475-03b51f857c8a service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:42.432045 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff9cb4-3fa4-4a5c-9475-03b51f857c8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:42.470281 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ff9cb4-3fa4-4a5c-9475-03b51f857c8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:42.478733 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ff9cb4-3fa4-4a5c-9475-03b51f857c8a service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:42.526209 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:42.534656 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 912/1817] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:06:42.657912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:42.763212 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325b6d8-50e3-4c2b-bd3a-886cbdc4d20c service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:42.775253 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325b6d8-50e3-4c2b-bd3a-886cbdc4d20c service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:42.786475 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3324b8-995d-49ca-b311-33ed042156cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:42.788417 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3324b8-995d-49ca-b311-33ed042156cc service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:42.811855 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3324b8-995d-49ca-b311-33ed042156cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:42.819016 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3324b8-995d-49ca-b311-33ed042156cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:42.934092 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3324b8-995d-49ca-b311-33ed042156cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:42.935826 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3324b8-995d-49ca-b311-33ed042156cc service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:42.978864 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 906/1818] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:42 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:06:43.191783 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:43.202779 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff9cb4-3fa4-4a5c-9475-03b51f857c8a service nova] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:43.221157 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff9cb4-3fa4-4a5c-9475-03b51f857c8a service nova] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:43.226601 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f22375b-6543-4e8f-960b-c955b5754733 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:43.228362 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22375b-6543-4e8f-960b-c955b5754733 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:43.228362 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22375b-6543-4e8f-960b-c955b5754733 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:43.229084 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22375b-6543-4e8f-960b-c955b5754733 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:43.250571 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:43.261926 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3324b8-995d-49ca-b311-33ed042156cc service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:43.396973 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3324b8-995d-49ca-b311-33ed042156cc service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:43.405354 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c5b2f-c026-4c81-9ea0-89d3a884bbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:43.406494 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c5b2f-c026-4c81-9ea0-89d3a884bbbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:43.406792 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c5b2f-c026-4c81-9ea0-89d3a884bbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:43.407084 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c5b2f-c026-4c81-9ea0-89d3a884bbbd admin admin] PATH_INFO: `/v3/users/111f80eb60cd49359552bf7af56e8358` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:43.408484 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c5b2f-c026-4c81-9ea0-89d3a884bbbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=111f80eb60cd49359552bf7af56e8358)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:43.410683 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c5b2f-c026-4c81-9ea0-89d3a884bbbd admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:43.436567 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f22375b-6543-4e8f-960b-c955b5754733 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:43.438654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f22375b-6543-4e8f-960b-c955b5754733 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:43.452256 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 913/1819] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:43 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:06:43.692421 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-777c5b2f-c026-4c81-9ea0-89d3a884bbbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '111f80eb60cd49359552bf7af56e8358'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:43.708244 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-777c5b2f-c026-4c81-9ea0-89d3a884bbbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '111f80eb60cd49359552bf7af56e8358'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:43.709009 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-777c5b2f-c026-4c81-9ea0-89d3a884bbbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '111f80eb60cd49359552bf7af56e8358'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:43.709629 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-777c5b2f-c026-4c81-9ea0-89d3a884bbbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '111f80eb60cd49359552bf7af56e8358'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:43.843275 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-777c5b2f-c026-4c81-9ea0-89d3a884bbbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '111f80eb60cd49359552bf7af56e8358'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:43.881325 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 907/1820] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:06:43 2022] DELETE /identity/v3/users/111f80eb60cd49359552bf7af56e8358 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:06:43.888880 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c071bd7-8f4a-43ff-a601-26caa7f64a32 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:43.889419 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c071bd7-8f4a-43ff-a601-26caa7f64a32 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:43.889743 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c071bd7-8f4a-43ff-a601-26caa7f64a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:43.938407 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-0c071bd7-8f4a-43ff-a601-26caa7f64a32 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:43.943538 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-0c071bd7-8f4a-43ff-a601-26caa7f64a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:44.060861 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 914/1821] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:44.077696 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c5b2f-c026-4c81-9ea0-89d3a884bbbd admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:44.083125 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-777c5b2f-c026-4c81-9ea0-89d3a884bbbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:44.109282 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:44.223243 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c5b2f-c026-4c81-9ea0-89d3a884bbbd admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:44.228356 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5ea51-f105-434c-85eb-256cf0f28e08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:44.229642 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5ea51-f105-434c-85eb-256cf0f28e08 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:44.230512 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5ea51-f105-434c-85eb-256cf0f28e08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:44.230863 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5ea51-f105-434c-85eb-256cf0f28e08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:44.236591 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:44.247305 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5ea51-f105-434c-85eb-256cf0f28e08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:44.249653 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5ea51-f105-434c-85eb-256cf0f28e08 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:44.273412 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 908/1822] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:06:44.380337 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782d31f-e84a-4fc4-8f3f-7bc8fe63761b None None] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:44.380940 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782d31f-e84a-4fc4-8f3f-7bc8fe63761b None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:44.387148 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782d31f-e84a-4fc4-8f3f-7bc8fe63761b None None] PATH_INFO: `/` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:44.387148 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 915/1823] 10.222.0.40 () {54 vars in 921 bytes} [Mon Jul 11 21:06:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 21:06:44.397202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c9ab5-3d31-4aac-af1f-57404518cb81 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:44.397747 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c9ab5-3d31-4aac-af1f-57404518cb81 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:44.398188 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c9ab5-3d31-4aac-af1f-57404518cb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:44.470277 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-d72c9ab5-3d31-4aac-af1f-57404518cb81 None None] MFA Rules not processed for user `8ac15411c75f4bd4a86f6753c9240a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:44.470277 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d72c9ab5-3d31-4aac-af1f-57404518cb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:44.691422 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 909/1824] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Jul 11 21:06:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:44.905418 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:45.187529 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:45.240590 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782d31f-e84a-4fc4-8f3f-7bc8fe63761b None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:45.242308 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-7782d31f-e84a-4fc4-8f3f-7bc8fe63761b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:45.283489 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782d31f-e84a-4fc4-8f3f-7bc8fe63761b None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:45.298207 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ac076-5288-4ffd-acb0-17786b818ec3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:45.298207 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ac076-5288-4ffd-acb0-17786b818ec3 service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:45.298207 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ac076-5288-4ffd-acb0-17786b818ec3 service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:45.298207 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ac076-5288-4ffd-acb0-17786b818ec3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:45.324158 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ac076-5288-4ffd-acb0-17786b818ec3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:45.325870 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ac076-5288-4ffd-acb0-17786b818ec3 service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:45.368410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 916/1825] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:06:45.725957 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:46.052109 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:46.491635 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c9ab5-3d31-4aac-af1f-57404518cb81 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:46.493189 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d72c9ab5-3d31-4aac-af1f-57404518cb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:46.519638 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ac076-5288-4ffd-acb0-17786b818ec3 service nova] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:46.521172 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-967ac076-5288-4ffd-acb0-17786b818ec3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:46.540441 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c9ab5-3d31-4aac-af1f-57404518cb81 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:46.546936 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072e075-3e45-49af-a210-9f6654096461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:46.547957 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072e075-3e45-49af-a210-9f6654096461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:46.548400 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072e075-3e45-49af-a210-9f6654096461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:46.548716 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072e075-3e45-49af-a210-9f6654096461 admin admin] PATH_INFO: `/v3/projects/4593295eecad4fc6bd2905302804d698` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:46.549574 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ac076-5288-4ffd-acb0-17786b818ec3 service nova] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:46.551904 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072e075-3e45-49af-a210-9f6654096461 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4593295eecad4fc6bd2905302804d698)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:46.554094 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072e075-3e45-49af-a210-9f6654096461 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:46.574228 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3245a5ef-d170-457d-b3eb-b9ab5f672e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:46.575769 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245a5ef-d170-457d-b3eb-b9ab5f672e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:46.576091 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245a5ef-d170-457d-b3eb-b9ab5f672e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:46.580235 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245a5ef-d170-457d-b3eb-b9ab5f672e07 admin admin] PATH_INFO: `/v3/users/028918d07fe8481da7285c4b66f76203` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:46.583406 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3245a5ef-d170-457d-b3eb-b9ab5f672e07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=028918d07fe8481da7285c4b66f76203)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:46.588570 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3245a5ef-d170-457d-b3eb-b9ab5f672e07 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:46.770018 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-8072e075-3e45-49af-a210-9f6654096461 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4593295eecad4fc6bd2905302804d698', 'request_id': 'req-8072e075-3e45-49af-a210-9f6654096461'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:46.792700 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-8072e075-3e45-49af-a210-9f6654096461 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4593295eecad4fc6bd2905302804d698', 'request_id': 'req-8072e075-3e45-49af-a210-9f6654096461'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:46.806049 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-8072e075-3e45-49af-a210-9f6654096461 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4593295eecad4fc6bd2905302804d698', 'request_id': 'req-8072e075-3e45-49af-a210-9f6654096461'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:46.901352 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-8072e075-3e45-49af-a210-9f6654096461 admin admin] The token cache is being invalidate because project 4593295eecad4fc6bd2905302804d698 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:06:46.903371 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-8072e075-3e45-49af-a210-9f6654096461 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:46.913515 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-8072e075-3e45-49af-a210-9f6654096461 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:46.915586 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 910/1826] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:06:46 2022] DELETE /identity/v3/projects/4593295eecad4fc6bd2905302804d698 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:46.919913 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072e075-3e45-49af-a210-9f6654096461 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:46.921738 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-8072e075-3e45-49af-a210-9f6654096461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:46.928549 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3245a5ef-d170-457d-b3eb-b9ab5f672e07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '028918d07fe8481da7285c4b66f76203'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:46.967691 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3245a5ef-d170-457d-b3eb-b9ab5f672e07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '028918d07fe8481da7285c4b66f76203'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:46.973662 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3245a5ef-d170-457d-b3eb-b9ab5f672e07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '028918d07fe8481da7285c4b66f76203'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:46.975311 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3245a5ef-d170-457d-b3eb-b9ab5f672e07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '028918d07fe8481da7285c4b66f76203'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:47.048289 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:47.082619 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3245a5ef-d170-457d-b3eb-b9ab5f672e07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '028918d07fe8481da7285c4b66f76203'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:47.130282 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 917/1827] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:06:46 2022] DELETE /identity/v3/users/028918d07fe8481da7285c4b66f76203 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:47.132019 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863bee0-de2b-473f-a39e-d1075f9d6e0e None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:47.132488 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863bee0-de2b-473f-a39e-d1075f9d6e0e None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:47.133007 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863bee0-de2b-473f-a39e-d1075f9d6e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:47.155710 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-c863bee0-de2b-473f-a39e-d1075f9d6e0e None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:47.157857 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-c863bee0-de2b-473f-a39e-d1075f9d6e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:47.163802 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072e075-3e45-49af-a210-9f6654096461 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:47.252835 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 918/1828] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:47.268218 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863bee0-de2b-473f-a39e-d1075f9d6e0e None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:47.270870 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-c863bee0-de2b-473f-a39e-d1075f9d6e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:47.308828 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed51626-f61c-44dd-849d-8dbde7e0e838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:47.311025 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed51626-f61c-44dd-849d-8dbde7e0e838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:47.311735 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed51626-f61c-44dd-849d-8dbde7e0e838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:47.312702 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed51626-f61c-44dd-849d-8dbde7e0e838 admin admin] PATH_INFO: `/v3/users/2502716c2b944b3f88fc4c0f00eeea08` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:47.314517 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed51626-f61c-44dd-849d-8dbde7e0e838 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2502716c2b944b3f88fc4c0f00eeea08)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:47.317548 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed51626-f61c-44dd-849d-8dbde7e0e838 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:47.411900 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863bee0-de2b-473f-a39e-d1075f9d6e0e None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:47.437515 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c05ca9-9ef0-4c6d-aa76-f2f9fa93c018 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:47.438760 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c05ca9-9ef0-4c6d-aa76-f2f9fa93c018 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:47.438760 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c05ca9-9ef0-4c6d-aa76-f2f9fa93c018 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:47.438760 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c05ca9-9ef0-4c6d-aa76-f2f9fa93c018 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:47.454500 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c05ca9-9ef0-4c6d-aa76-f2f9fa93c018 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:47.456052 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c05ca9-9ef0-4c6d-aa76-f2f9fa93c018 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:47.469557 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:47.471156 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 919/1829] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 21:06:47.551782 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-3ed51626-f61c-44dd-849d-8dbde7e0e838 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2502716c2b944b3f88fc4c0f00eeea08'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:47.590798 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-3ed51626-f61c-44dd-849d-8dbde7e0e838 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2502716c2b944b3f88fc4c0f00eeea08'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:47.590798 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-3ed51626-f61c-44dd-849d-8dbde7e0e838 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2502716c2b944b3f88fc4c0f00eeea08'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:47.591509 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-3ed51626-f61c-44dd-849d-8dbde7e0e838 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2502716c2b944b3f88fc4c0f00eeea08'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:47.697472 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-3ed51626-f61c-44dd-849d-8dbde7e0e838 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2502716c2b944b3f88fc4c0f00eeea08'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:47.725699 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 911/1830] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:06:46 2022] DELETE /identity/v3/users/2502716c2b944b3f88fc4c0f00eeea08 => generated 0 bytes in 802 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:48.557041 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:48.760114 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:48.868656 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c05ca9-9ef0-4c6d-aa76-f2f9fa93c018 service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:48.870291 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-f5c05ca9-9ef0-4c6d-aa76-f2f9fa93c018 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:48.897691 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c05ca9-9ef0-4c6d-aa76-f2f9fa93c018 service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:48.926183 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed51626-f61c-44dd-849d-8dbde7e0e838 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:48.932681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-3ed51626-f61c-44dd-849d-8dbde7e0e838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:49.080221 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624b272-3f5f-4f17-be07-3d2e16940a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:49.081440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624b272-3f5f-4f17-be07-3d2e16940a92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:49.081729 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624b272-3f5f-4f17-be07-3d2e16940a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:49.085018 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:49.085848 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624b272-3f5f-4f17-be07-3d2e16940a92 admin admin] PATH_INFO: `/v3/users/e6076f10e3374a98a234ac8f65f1a91e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:49.092766 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624b272-3f5f-4f17-be07-3d2e16940a92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6076f10e3374a98a234ac8f65f1a91e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:49.102555 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624b272-3f5f-4f17-be07-3d2e16940a92 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:49.215289 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed51626-f61c-44dd-849d-8dbde7e0e838 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:49.232031 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a895c-447b-468e-95bf-e939aa5eb185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:49.232940 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a895c-447b-468e-95bf-e939aa5eb185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:49.233226 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a895c-447b-468e-95bf-e939aa5eb185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:49.233501 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a895c-447b-468e-95bf-e939aa5eb185 admin admin] PATH_INFO: `/v3/projects/b558f8ea9a944029b1e3645001f6abd5` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:49.236900 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a895c-447b-468e-95bf-e939aa5eb185 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b558f8ea9a944029b1e3645001f6abd5)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:49.238800 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a895c-447b-468e-95bf-e939aa5eb185 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:49.263292 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:49.450899 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e47a895c-447b-468e-95bf-e939aa5eb185 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b558f8ea9a944029b1e3645001f6abd5', 'request_id': 'req-e47a895c-447b-468e-95bf-e939aa5eb185'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:49.468995 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e47a895c-447b-468e-95bf-e939aa5eb185 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b558f8ea9a944029b1e3645001f6abd5', 'request_id': 'req-e47a895c-447b-468e-95bf-e939aa5eb185'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:49.478145 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e47a895c-447b-468e-95bf-e939aa5eb185 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b558f8ea9a944029b1e3645001f6abd5', 'request_id': 'req-e47a895c-447b-468e-95bf-e939aa5eb185'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:49.568283 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e47a895c-447b-468e-95bf-e939aa5eb185 admin admin] The token cache is being invalidate because project b558f8ea9a944029b1e3645001f6abd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:06:49.569302 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e47a895c-447b-468e-95bf-e939aa5eb185 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:49.570131 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e47a895c-447b-468e-95bf-e939aa5eb185 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:49.575094 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 912/1831] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:06:48 2022] DELETE /identity/v3/projects/b558f8ea9a944029b1e3645001f6abd5 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:49.576396 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a895c-447b-468e-95bf-e939aa5eb185 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:49.577634 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-8624b272-3f5f-4f17-be07-3d2e16940a92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6076f10e3374a98a234ac8f65f1a91e'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:49.578279 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-e47a895c-447b-468e-95bf-e939aa5eb185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:49.602833 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-8624b272-3f5f-4f17-be07-3d2e16940a92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6076f10e3374a98a234ac8f65f1a91e'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:49.605319 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-8624b272-3f5f-4f17-be07-3d2e16940a92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6076f10e3374a98a234ac8f65f1a91e'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:49.607711 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-8624b272-3f5f-4f17-be07-3d2e16940a92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6076f10e3374a98a234ac8f65f1a91e'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:49.671585 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a895c-447b-468e-95bf-e939aa5eb185 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:49.676812 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1d019-7264-457b-a23f-10cbacd4d35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:49.677722 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1d019-7264-457b-a23f-10cbacd4d35f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:49.678003 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1d019-7264-457b-a23f-10cbacd4d35f admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:49.678285 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1d019-7264-457b-a23f-10cbacd4d35f admin admin] PATH_INFO: `/v3/users/cd3cd27ed6fe4ec9b93907b397c21abc` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:49.679823 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b1d019-7264-457b-a23f-10cbacd4d35f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd3cd27ed6fe4ec9b93907b397c21abc)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:49.681792 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b1d019-7264-457b-a23f-10cbacd4d35f admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:49.687542 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-8624b272-3f5f-4f17-be07-3d2e16940a92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6076f10e3374a98a234ac8f65f1a91e'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:49.728415 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 920/1832] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:06:48 2022] DELETE /identity/v3/users/e6076f10e3374a98a234ac8f65f1a91e => generated 0 bytes in 860 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:49.733921 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da7511-1dbd-4499-9852-f3e9545999bc None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:49.734352 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da7511-1dbd-4499-9852-f3e9545999bc None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:49.734833 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da7511-1dbd-4499-9852-f3e9545999bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:49.764509 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-f6da7511-1dbd-4499-9852-f3e9545999bc None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:49.766159 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-f6da7511-1dbd-4499-9852-f3e9545999bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:49.847480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 921/1833] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:49.920674 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d0b1d019-7264-457b-a23f-10cbacd4d35f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd3cd27ed6fe4ec9b93907b397c21abc'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:49.929795 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d0b1d019-7264-457b-a23f-10cbacd4d35f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd3cd27ed6fe4ec9b93907b397c21abc'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:49.930753 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d0b1d019-7264-457b-a23f-10cbacd4d35f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd3cd27ed6fe4ec9b93907b397c21abc'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:49.931954 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d0b1d019-7264-457b-a23f-10cbacd4d35f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd3cd27ed6fe4ec9b93907b397c21abc'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:49.944586 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da7511-1dbd-4499-9852-f3e9545999bc None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:49.946278 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-f6da7511-1dbd-4499-9852-f3e9545999bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:50.046065 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d0b1d019-7264-457b-a23f-10cbacd4d35f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd3cd27ed6fe4ec9b93907b397c21abc'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:50.075245 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da7511-1dbd-4499-9852-f3e9545999bc None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:50.081298 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 913/1834] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:06:49 2022] DELETE /identity/v3/users/cd3cd27ed6fe4ec9b93907b397c21abc => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:50.092109 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cabe7f-2836-4ca0-8132-2c0fdd814522 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:50.092652 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cabe7f-2836-4ca0-8132-2c0fdd814522 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:50.093108 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cabe7f-2836-4ca0-8132-2c0fdd814522 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:50.093534 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cabe7f-2836-4ca0-8132-2c0fdd814522 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:50.096237 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-78cabe7f-2836-4ca0-8132-2c0fdd814522 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:50.119612 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cabe7f-2836-4ca0-8132-2c0fdd814522 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:50.122372 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cabe7f-2836-4ca0-8132-2c0fdd814522 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:50.154471 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 922/1835] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:06:50.583462 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:50.585590 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1d019-7264-457b-a23f-10cbacd4d35f admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:50.587273 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d0b1d019-7264-457b-a23f-10cbacd4d35f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:50.665973 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:50.727483 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1d019-7264-457b-a23f-10cbacd4d35f admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:50.732681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc9de63-f3f9-48ed-af91-93d9d7b4d27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:50.733645 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9de63-f3f9-48ed-af91-93d9d7b4d27e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:50.733951 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9de63-f3f9-48ed-af91-93d9d7b4d27e admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:50.734229 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9de63-f3f9-48ed-af91-93d9d7b4d27e admin admin] PATH_INFO: `/v3/projects/8b67ee815f7b436f9d44a37bd4ec8b75` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:50.735463 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc9de63-f3f9-48ed-af91-93d9d7b4d27e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b67ee815f7b436f9d44a37bd4ec8b75)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:50.737518 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc9de63-f3f9-48ed-af91-93d9d7b4d27e admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:50.906694 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-4dc9de63-f3f9-48ed-af91-93d9d7b4d27e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b67ee815f7b436f9d44a37bd4ec8b75', 'request_id': 'req-4dc9de63-f3f9-48ed-af91-93d9d7b4d27e'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:50.914137 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-4dc9de63-f3f9-48ed-af91-93d9d7b4d27e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b67ee815f7b436f9d44a37bd4ec8b75', 'request_id': 'req-4dc9de63-f3f9-48ed-af91-93d9d7b4d27e'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:50.921370 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-4dc9de63-f3f9-48ed-af91-93d9d7b4d27e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b67ee815f7b436f9d44a37bd4ec8b75', 'request_id': 'req-4dc9de63-f3f9-48ed-af91-93d9d7b4d27e'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:50.980049 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-4dc9de63-f3f9-48ed-af91-93d9d7b4d27e admin admin] The token cache is being invalidate because project 8b67ee815f7b436f9d44a37bd4ec8b75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:06:50.980672 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-4dc9de63-f3f9-48ed-af91-93d9d7b4d27e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:50.981616 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-4dc9de63-f3f9-48ed-af91-93d9d7b4d27e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:50.987370 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 914/1836] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:06:50 2022] DELETE /identity/v3/projects/8b67ee815f7b436f9d44a37bd4ec8b75 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:50.989032 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0168e25-e1b4-4e0e-96a0-e83802de0d31 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:50.990417 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0168e25-e1b4-4e0e-96a0-e83802de0d31 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:50.990779 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0168e25-e1b4-4e0e-96a0-e83802de0d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:51.016782 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-c0168e25-e1b4-4e0e-96a0-e83802de0d31 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:51.018441 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-c0168e25-e1b4-4e0e-96a0-e83802de0d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:51.111264 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc9de63-f3f9-48ed-af91-93d9d7b4d27e admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:51.115785 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-4dc9de63-f3f9-48ed-af91-93d9d7b4d27e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:51.142886 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 923/1837] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:51.150528 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce544aa-29a4-48f0-a232-5e040f922e25 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:51.151406 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce544aa-29a4-48f0-a232-5e040f922e25 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:51.152544 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce544aa-29a4-48f0-a232-5e040f922e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:51.187498 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-fce544aa-29a4-48f0-a232-5e040f922e25 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:51.188884 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-fce544aa-29a4-48f0-a232-5e040f922e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:51.209875 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 924/1838] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:06:51.213796 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce544aa-29a4-48f0-a232-5e040f922e25 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:51.239012 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce544aa-29a4-48f0-a232-5e040f922e25 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:51.247750 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced35bf-f634-4a69-b62f-4035b74f0920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:51.249194 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced35bf-f634-4a69-b62f-4035b74f0920 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:51.249732 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced35bf-f634-4a69-b62f-4035b74f0920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:51.250252 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced35bf-f634-4a69-b62f-4035b74f0920 admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:51.251209 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ced35bf-f634-4a69-b62f-4035b74f0920 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:06:51.252384 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ced35bf-f634-4a69-b62f-4035b74f0920 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:51.254612 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ced35bf-f634-4a69-b62f-4035b74f0920 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:51.291277 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 925/1839] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:06:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:06:51.293983 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced35bf-f634-4a69-b62f-4035b74f0920 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:51.307897 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced35bf-f634-4a69-b62f-4035b74f0920 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:51.309202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc9de63-f3f9-48ed-af91-93d9d7b4d27e admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:51.314286 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b6b99-a551-47e4-9c25-17f8bc856ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:51.316898 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b6b99-a551-47e4-9c25-17f8bc856ce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:51.317213 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b6b99-a551-47e4-9c25-17f8bc856ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:51.317626 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b6b99-a551-47e4-9c25-17f8bc856ce9 admin admin] PATH_INFO: `/v3/projects/948dcdb4e2234539b61baeaf6e4fe261` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:51.318068 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394574b3-b8ce-4084-8734-fab519b43fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:51.319023 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394574b3-b8ce-4084-8734-fab519b43fd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:51.319140 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b6b99-a551-47e4-9c25-17f8bc856ce9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=948dcdb4e2234539b61baeaf6e4fe261)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:51.319629 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394574b3-b8ce-4084-8734-fab519b43fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:51.321152 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b6b99-a551-47e4-9c25-17f8bc856ce9 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:51.321405 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394574b3-b8ce-4084-8734-fab519b43fd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:51.322507 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394574b3-b8ce-4084-8734-fab519b43fd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:51.326088 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394574b3-b8ce-4084-8734-fab519b43fd5 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:51.445505 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 926/1840] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:06:51 2022] POST /identity/v3/projects => generated 381 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:51.449809 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394574b3-b8ce-4084-8734-fab519b43fd5 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:51.498896 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-bf4b6b99-a551-47e4-9c25-17f8bc856ce9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '948dcdb4e2234539b61baeaf6e4fe261', 'request_id': 'req-bf4b6b99-a551-47e4-9c25-17f8bc856ce9'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:51.525169 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-bf4b6b99-a551-47e4-9c25-17f8bc856ce9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '948dcdb4e2234539b61baeaf6e4fe261', 'request_id': 'req-bf4b6b99-a551-47e4-9c25-17f8bc856ce9'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:51.547866 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-bf4b6b99-a551-47e4-9c25-17f8bc856ce9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '948dcdb4e2234539b61baeaf6e4fe261', 'request_id': 'req-bf4b6b99-a551-47e4-9c25-17f8bc856ce9'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:51.564179 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394574b3-b8ce-4084-8734-fab519b43fd5 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:51.633593 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29298aa4-bad8-4a47-8d4e-68226a7c3cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:51.634795 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29298aa4-bad8-4a47-8d4e-68226a7c3cf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:51.635146 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29298aa4-bad8-4a47-8d4e-68226a7c3cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:51.635439 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29298aa4-bad8-4a47-8d4e-68226a7c3cf2 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:51.636733 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29298aa4-bad8-4a47-8d4e-68226a7c3cf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:51.641028 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29298aa4-bad8-4a47-8d4e-68226a7c3cf2 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:51.677585 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-bf4b6b99-a551-47e4-9c25-17f8bc856ce9 admin admin] The token cache is being invalidate because project 948dcdb4e2234539b61baeaf6e4fe261 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:06:51.686390 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-bf4b6b99-a551-47e4-9c25-17f8bc856ce9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:51.686390 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-bf4b6b99-a551-47e4-9c25-17f8bc856ce9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:51.686390 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 915/1841] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:06:51 2022] DELETE /identity/v3/projects/948dcdb4e2234539b61baeaf6e4fe261 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:06:51.686390 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b6b99-a551-47e4-9c25-17f8bc856ce9 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:51.686390 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-bf4b6b99-a551-47e4-9c25-17f8bc856ce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:51.715018 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b6b99-a551-47e4-9c25-17f8bc856ce9 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:51.720248 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d816f6-fdac-46a0-af80-dca4da96887b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:51.720956 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d816f6-fdac-46a0-af80-dca4da96887b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:51.721250 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d816f6-fdac-46a0-af80-dca4da96887b admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:51.721533 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d816f6-fdac-46a0-af80-dca4da96887b admin admin] PATH_INFO: `/v3/projects/9c40f1f7b2684fbd994ab320dfb37250` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:51.722806 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d816f6-fdac-46a0-af80-dca4da96887b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c40f1f7b2684fbd994ab320dfb37250)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:51.724866 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d816f6-fdac-46a0-af80-dca4da96887b admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:51.740246 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 927/1842] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:06:51 2022] POST /identity/v3/users => generated 291 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:51.741844 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc0432-5fb8-4c7c-9e07-776847e73cd9 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:51.743526 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc0432-5fb8-4c7c-9e07-776847e73cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:51.743526 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc0432-5fb8-4c7c-9e07-776847e73cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:51.769397 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-71cc0432-5fb8-4c7c-9e07-776847e73cd9 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:51.770804 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-71cc0432-5fb8-4c7c-9e07-776847e73cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:51.784285 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 928/1843] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:51.785655 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc0432-5fb8-4c7c-9e07-776847e73cd9 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:51.787263 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-71cc0432-5fb8-4c7c-9e07-776847e73cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:51.801378 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc0432-5fb8-4c7c-9e07-776847e73cd9 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:51.807613 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6be41-b2d5-4d6e-9f96-d9570c25d090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:51.811124 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6be41-b2d5-4d6e-9f96-d9570c25d090 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:51.811124 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6be41-b2d5-4d6e-9f96-d9570c25d090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:51.811124 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6be41-b2d5-4d6e-9f96-d9570c25d090 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:51.811124 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece6be41-b2d5-4d6e-9f96-d9570c25d090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:51.811525 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece6be41-b2d5-4d6e-9f96-d9570c25d090 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:51.824520 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 929/1844] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:51.826492 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55026614-7bdd-46d4-a2a5-a51f4b5c2d11 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:51.826856 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55026614-7bdd-46d4-a2a5-a51f4b5c2d11 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:51.827215 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55026614-7bdd-46d4-a2a5-a51f4b5c2d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:51.846698 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-55026614-7bdd-46d4-a2a5-a51f4b5c2d11 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:51.847922 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-55026614-7bdd-46d4-a2a5-a51f4b5c2d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:51.856160 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 930/1845] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:51.857072 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55026614-7bdd-46d4-a2a5-a51f4b5c2d11 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:51.866802 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55026614-7bdd-46d4-a2a5-a51f4b5c2d11 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:51.886639 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-74d816f6-fdac-46a0-af80-dca4da96887b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c40f1f7b2684fbd994ab320dfb37250', 'request_id': 'req-74d816f6-fdac-46a0-af80-dca4da96887b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:51.893517 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-74d816f6-fdac-46a0-af80-dca4da96887b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c40f1f7b2684fbd994ab320dfb37250', 'request_id': 'req-74d816f6-fdac-46a0-af80-dca4da96887b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:51.899344 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-74d816f6-fdac-46a0-af80-dca4da96887b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c40f1f7b2684fbd994ab320dfb37250', 'request_id': 'req-74d816f6-fdac-46a0-af80-dca4da96887b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:51.929821 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2bfdc7-93f9-491a-b08d-e639d7f8cbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:51.930420 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2bfdc7-93f9-491a-b08d-e639d7f8cbcf admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:51.930705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2bfdc7-93f9-491a-b08d-e639d7f8cbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:51.930985 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2bfdc7-93f9-491a-b08d-e639d7f8cbcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:51.931710 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2bfdc7-93f9-491a-b08d-e639d7f8cbcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:51.933680 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2bfdc7-93f9-491a-b08d-e639d7f8cbcf admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:51.947905 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 931/1846] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:51.947905 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2bfdc7-93f9-491a-b08d-e639d7f8cbcf admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:51.955905 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2bfdc7-93f9-491a-b08d-e639d7f8cbcf admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:51.960664 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f37fb5-0409-4e8d-b822-673a4f9c8b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:51.961302 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f37fb5-0409-4e8d-b822-673a4f9c8b7c admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:51.961587 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f37fb5-0409-4e8d-b822-673a4f9c8b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:51.961890 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f37fb5-0409-4e8d-b822-673a4f9c8b7c admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:51.962596 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f37fb5-0409-4e8d-b822-673a4f9c8b7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:06:51.962904 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f37fb5-0409-4e8d-b822-673a4f9c8b7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:51.965273 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f37fb5-0409-4e8d-b822-673a4f9c8b7c admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:51.977174 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 932/1847] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:06:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:06:51.977910 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f37fb5-0409-4e8d-b822-673a4f9c8b7c admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:51.988055 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f37fb5-0409-4e8d-b822-673a4f9c8b7c admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:51.988586 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-74d816f6-fdac-46a0-af80-dca4da96887b admin admin] The token cache is being invalidate because project 9c40f1f7b2684fbd994ab320dfb37250 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:06:51.989084 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-74d816f6-fdac-46a0-af80-dca4da96887b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:51.989732 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-74d816f6-fdac-46a0-af80-dca4da96887b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:51.991284 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 916/1848] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:06:51 2022] DELETE /identity/v3/projects/9c40f1f7b2684fbd994ab320dfb37250 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:51.992076 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d816f6-fdac-46a0-af80-dca4da96887b admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:51.992811 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109dc4a-aa6f-49f2-9d0f-e0a4221ce251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:51.993282 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-74d816f6-fdac-46a0-af80-dca4da96887b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:51.993696 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109dc4a-aa6f-49f2-9d0f-e0a4221ce251 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:51.993980 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109dc4a-aa6f-49f2-9d0f-e0a4221ce251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:51.994254 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109dc4a-aa6f-49f2-9d0f-e0a4221ce251 admin admin] PATH_INFO: `/v3/projects/4da8c78d8c404601a357a27413e0d648/users/0180f6c804fe4098a375723ee66e905b/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:52.006153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d816f6-fdac-46a0-af80-dca4da96887b admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:52.008270 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:52.009493 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109dc4a-aa6f-49f2-9d0f-e0a4221ce251 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4da8c78d8c404601a357a27413e0d648, user_id=0180f6c804fe4098a375723ee66e905b, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:52.013041 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086cbf8f-29cc-4ad9-92ab-6b2cc05eb889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:52.013202 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109dc4a-aa6f-49f2-9d0f-e0a4221ce251 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:52.013709 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cbf8f-29cc-4ad9-92ab-6b2cc05eb889 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:52.013996 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cbf8f-29cc-4ad9-92ab-6b2cc05eb889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:52.014276 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cbf8f-29cc-4ad9-92ab-6b2cc05eb889 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:52.014985 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086cbf8f-29cc-4ad9-92ab-6b2cc05eb889 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:52.017138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086cbf8f-29cc-4ad9-92ab-6b2cc05eb889 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:52.102437 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:52.108112 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 933/1849] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:06:51 2022] PUT /identity/v3/projects/4da8c78d8c404601a357a27413e0d648/users/0180f6c804fe4098a375723ee66e905b/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:52.109080 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109dc4a-aa6f-49f2-9d0f-e0a4221ce251 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:52.114868 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 917/1850] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:06:51 2022] POST /identity/v3/projects => generated 393 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:52.115857 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086cbf8f-29cc-4ad9-92ab-6b2cc05eb889 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:52.117004 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-8109dc4a-aa6f-49f2-9d0f-e0a4221ce251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:52.187253 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086cbf8f-29cc-4ad9-92ab-6b2cc05eb889 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:52.192517 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99012774-75b0-4d75-bbad-a661855a5416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:52.193209 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99012774-75b0-4d75-bbad-a661855a5416 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:52.193508 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99012774-75b0-4d75-bbad-a661855a5416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:52.193790 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99012774-75b0-4d75-bbad-a661855a5416 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:52.194626 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99012774-75b0-4d75-bbad-a661855a5416 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:52.196495 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99012774-75b0-4d75-bbad-a661855a5416 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:52.202220 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109dc4a-aa6f-49f2-9d0f-e0a4221ce251 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:52.207383 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebeb01-8020-48d6-826f-8f07d4813ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:52.208362 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebeb01-8020-48d6-826f-8f07d4813ed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:52.208648 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebeb01-8020-48d6-826f-8f07d4813ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:52.208928 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebeb01-8020-48d6-826f-8f07d4813ed9 admin admin] PATH_INFO: `/v3/users/9b50028d00af4eb7ac129cd1fca386e5` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:52.210141 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ebeb01-8020-48d6-826f-8f07d4813ed9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b50028d00af4eb7ac129cd1fca386e5)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:52.212192 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ebeb01-8020-48d6-826f-8f07d4813ed9 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:52.311514 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 918/1851] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:06:52 2022] POST /identity/v3/users => generated 297 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:52.312842 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7137f-64f5-4b05-a388-33498ba424b7 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:52.313134 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7137f-64f5-4b05-a388-33498ba424b7 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:52.313413 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7137f-64f5-4b05-a388-33498ba424b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:52.340844 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-a5d7137f-64f5-4b05-a388-33498ba424b7 None None] MFA Rules not processed for user `0180f6c804fe4098a375723ee66e905b`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:52.342041 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-a5d7137f-64f5-4b05-a388-33498ba424b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:52.404434 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 919/1852] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:52.405334 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7137f-64f5-4b05-a388-33498ba424b7 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:52.408432 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-a5d7137f-64f5-4b05-a388-33498ba424b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:52.417745 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a7ebeb01-8020-48d6-826f-8f07d4813ed9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b50028d00af4eb7ac129cd1fca386e5'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:52.425003 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a7ebeb01-8020-48d6-826f-8f07d4813ed9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b50028d00af4eb7ac129cd1fca386e5'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:52.425712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a7ebeb01-8020-48d6-826f-8f07d4813ed9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b50028d00af4eb7ac129cd1fca386e5'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:52.426448 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a7ebeb01-8020-48d6-826f-8f07d4813ed9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b50028d00af4eb7ac129cd1fca386e5'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:52.426947 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7137f-64f5-4b05-a388-33498ba424b7 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:52.431889 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a885e-e892-45ff-9ff0-dceed6f32baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:52.433352 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a885e-e892-45ff-9ff0-dceed6f32baa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:52.433761 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a885e-e892-45ff-9ff0-dceed6f32baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:52.434043 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a885e-e892-45ff-9ff0-dceed6f32baa admin admin] PATH_INFO: `/v3/users/b485af1cf29f4df3b11b3a1c1c4dfe28` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:52.435283 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6a885e-e892-45ff-9ff0-dceed6f32baa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b485af1cf29f4df3b11b3a1c1c4dfe28)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:52.437218 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6a885e-e892-45ff-9ff0-dceed6f32baa admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:52.481938 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a7ebeb01-8020-48d6-826f-8f07d4813ed9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b50028d00af4eb7ac129cd1fca386e5'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:52.500941 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 934/1853] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:06:52 2022] DELETE /identity/v3/users/9b50028d00af4eb7ac129cd1fca386e5 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:52.502104 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebeb01-8020-48d6-826f-8f07d4813ed9 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:52.503776 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a7ebeb01-8020-48d6-826f-8f07d4813ed9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:52.582736 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-ee6a885e-e892-45ff-9ff0-dceed6f32baa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b485af1cf29f4df3b11b3a1c1c4dfe28'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:52.595350 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-ee6a885e-e892-45ff-9ff0-dceed6f32baa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b485af1cf29f4df3b11b3a1c1c4dfe28'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:52.596174 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-ee6a885e-e892-45ff-9ff0-dceed6f32baa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b485af1cf29f4df3b11b3a1c1c4dfe28'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:52.596800 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-ee6a885e-e892-45ff-9ff0-dceed6f32baa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b485af1cf29f4df3b11b3a1c1c4dfe28'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:52.598233 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebeb01-8020-48d6-826f-8f07d4813ed9 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:52.605032 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2bff5-5667-4900-af6c-5c71e8fd6bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:52.606311 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2bff5-5667-4900-af6c-5c71e8fd6bdc admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:52.606533 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2bff5-5667-4900-af6c-5c71e8fd6bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:52.607030 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2bff5-5667-4900-af6c-5c71e8fd6bdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:52.610422 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b2bff5-5667-4900-af6c-5c71e8fd6bdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:52.612226 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b2bff5-5667-4900-af6c-5c71e8fd6bdc admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:52.623366 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 935/1854] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:52.624130 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2bff5-5667-4900-af6c-5c71e8fd6bdc admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:52.626336 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a8b2bff5-5667-4900-af6c-5c71e8fd6bdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:52.640753 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2bff5-5667-4900-af6c-5c71e8fd6bdc admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:52.646506 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43024c72-8c0a-4a39-999b-d45c2ecc2675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:52.646950 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43024c72-8c0a-4a39-999b-d45c2ecc2675 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:52.647265 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43024c72-8c0a-4a39-999b-d45c2ecc2675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:52.647554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43024c72-8c0a-4a39-999b-d45c2ecc2675 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:52.648302 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43024c72-8c0a-4a39-999b-d45c2ecc2675 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:52.650222 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43024c72-8c0a-4a39-999b-d45c2ecc2675 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:52.669184 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-ee6a885e-e892-45ff-9ff0-dceed6f32baa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b485af1cf29f4df3b11b3a1c1c4dfe28'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:52.691329 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 920/1855] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:06:52 2022] DELETE /identity/v3/users/b485af1cf29f4df3b11b3a1c1c4dfe28 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:52.692822 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a885e-e892-45ff-9ff0-dceed6f32baa admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:52.694498 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-ee6a885e-e892-45ff-9ff0-dceed6f32baa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:52.781938 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 936/1856] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:06:52 2022] POST /identity/v3/projects => generated 381 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:52.782741 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebaf9db-04fa-48a6-a704-7518caffcce0 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:52.783118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebaf9db-04fa-48a6-a704-7518caffcce0 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:52.783473 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebaf9db-04fa-48a6-a704-7518caffcce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:52.812603 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-bebaf9db-04fa-48a6-a704-7518caffcce0 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:52.814444 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a885e-e892-45ff-9ff0-dceed6f32baa admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:52.816383 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-bebaf9db-04fa-48a6-a704-7518caffcce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:52.893792 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1a16c-e358-4e31-aaea-837569d9a925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:52.894486 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1a16c-e358-4e31-aaea-837569d9a925 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:52.894777 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1a16c-e358-4e31-aaea-837569d9a925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:52.895268 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1a16c-e358-4e31-aaea-837569d9a925 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:52.895375 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 937/1857] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:52.896093 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebaf9db-04fa-48a6-a704-7518caffcce0 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:52.899638 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc1a16c-e358-4e31-aaea-837569d9a925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:52.901376 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc1a16c-e358-4e31-aaea-837569d9a925 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:52.907949 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebaf9db-04fa-48a6-a704-7518caffcce0 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:52.912719 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e4775-c611-4b20-8d04-2325b977bb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:52.919842 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e4775-c611-4b20-8d04-2325b977bb0d admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:52.919842 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e4775-c611-4b20-8d04-2325b977bb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:52.919842 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e4775-c611-4b20-8d04-2325b977bb0d admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:52.919842 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e4775-c611-4b20-8d04-2325b977bb0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:52.920207 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 921/1858] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:52.920207 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1a16c-e358-4e31-aaea-837569d9a925 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:52.920337 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e4775-c611-4b20-8d04-2325b977bb0d admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:52.925850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-5cc1a16c-e358-4e31-aaea-837569d9a925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:52.986719 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1a16c-e358-4e31-aaea-837569d9a925 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:52.990750 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d8876-2268-4b18-83ff-b36d64a0a0b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:52.991546 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d8876-2268-4b18-83ff-b36d64a0a0b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:52.992385 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d8876-2268-4b18-83ff-b36d64a0a0b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:52.992385 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d8876-2268-4b18-83ff-b36d64a0a0b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:53.002553 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d8876-2268-4b18-83ff-b36d64a0a0b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:53.010255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d8876-2268-4b18-83ff-b36d64a0a0b6 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:53.010389 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 938/1859] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:06:52 2022] POST /identity/v3/users => generated 297 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:53.010389 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e4775-c611-4b20-8d04-2325b977bb0d admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:53.018344 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 922/1860] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:06:53.019352 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d8876-2268-4b18-83ff-b36d64a0a0b6 service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:53.020991 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e4775-c611-4b20-8d04-2325b977bb0d admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:53.032421 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d8876-2268-4b18-83ff-b36d64a0a0b6 service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:53.033903 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf5feb4-0730-4a66-b805-a00c3d96dcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:53.034828 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5feb4-0730-4a66-b805-a00c3d96dcf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:53.035125 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5feb4-0730-4a66-b805-a00c3d96dcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:53.035410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5feb4-0730-4a66-b805-a00c3d96dcf7 admin admin] PATH_INFO: `/v3/projects/5eb6b0ba5f624114bb7cd90e30090364/users/5743c10258cf4abcb9894ddf2ad270f6/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:53.042939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8bf10-2e35-4212-bc1b-ddfa6b3f4e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:53.042939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8bf10-2e35-4212-bc1b-ddfa6b3f4e8a admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:53.042939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8bf10-2e35-4212-bc1b-ddfa6b3f4e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:53.042939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8bf10-2e35-4212-bc1b-ddfa6b3f4e8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:53.043284 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d8bf10-2e35-4212-bc1b-ddfa6b3f4e8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:53.043284 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d8bf10-2e35-4212-bc1b-ddfa6b3f4e8a admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:53.052723 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 923/1861] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:53.060512 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf5feb4-0730-4a66-b805-a00c3d96dcf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eb6b0ba5f624114bb7cd90e30090364, user_id=5743c10258cf4abcb9894ddf2ad270f6, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:53.060924 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8bf10-2e35-4212-bc1b-ddfa6b3f4e8a admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:53.065143 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf5feb4-0730-4a66-b805-a00c3d96dcf7 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:53.071690 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8bf10-2e35-4212-bc1b-ddfa6b3f4e8a admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:53.076947 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e528ab05-acd3-479b-a1f6-408a2b252d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:53.077907 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528ab05-acd3-479b-a1f6-408a2b252d53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:53.078199 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528ab05-acd3-479b-a1f6-408a2b252d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:53.078484 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528ab05-acd3-479b-a1f6-408a2b252d53 admin admin] PATH_INFO: `/v3/projects/17b09d4b24934618981cf1608d942ef1/users/bb5b097f092f44a78b02208878478ba3/roles/86273ff072f3438d822e870272491768` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:53.095505 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e528ab05-acd3-479b-a1f6-408a2b252d53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17b09d4b24934618981cf1608d942ef1, user_id=bb5b097f092f44a78b02208878478ba3, role_id=86273ff072f3438d822e870272491768)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:53.098205 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e528ab05-acd3-479b-a1f6-408a2b252d53 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:53.191701 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 939/1862] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:06:53 2022] PUT /identity/v3/projects/5eb6b0ba5f624114bb7cd90e30090364/users/5743c10258cf4abcb9894ddf2ad270f6/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:53.192979 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf5feb4-0730-4a66-b805-a00c3d96dcf7 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:53.202631 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-9bf5feb4-0730-4a66-b805-a00c3d96dcf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:53.220973 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 924/1863] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:06:53 2022] PUT /identity/v3/projects/17b09d4b24934618981cf1608d942ef1/users/bb5b097f092f44a78b02208878478ba3/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:06:53.222320 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891a5c6-7eb3-44ed-a0a9-c124ef7136de None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:53.225624 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891a5c6-7eb3-44ed-a0a9-c124ef7136de None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:53.225624 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891a5c6-7eb3-44ed-a0a9-c124ef7136de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:53.277556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-f891a5c6-7eb3-44ed-a0a9-c124ef7136de None None] MFA Rules not processed for user `5743c10258cf4abcb9894ddf2ad270f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:53.280507 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-f891a5c6-7eb3-44ed-a0a9-c124ef7136de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:53.310637 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:53.325771 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf5feb4-0730-4a66-b805-a00c3d96dcf7 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:53.387746 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 925/1864] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:53.393065 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891a5c6-7eb3-44ed-a0a9-c124ef7136de None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:53.410367 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3afffe-61f2-4fe0-ab4b-697f160799f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:53.411338 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3afffe-61f2-4fe0-ab4b-697f160799f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:53.411559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3afffe-61f2-4fe0-ab4b-697f160799f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:53.411837 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3afffe-61f2-4fe0-ab4b-697f160799f2 admin admin] PATH_INFO: `/v3/projects/95125ca954f040e2ab1bca2d13b9955d` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:53.413352 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3afffe-61f2-4fe0-ab4b-697f160799f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95125ca954f040e2ab1bca2d13b9955d)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:53.415289 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3afffe-61f2-4fe0-ab4b-697f160799f2 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:53.498913 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891a5c6-7eb3-44ed-a0a9-c124ef7136de None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:53.503885 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7d818-b38e-4827-9095-cec95ddc203c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:53.504773 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7d818-b38e-4827-9095-cec95ddc203c admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:53.505073 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7d818-b38e-4827-9095-cec95ddc203c admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:53.509846 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7d818-b38e-4827-9095-cec95ddc203c admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:53.509846 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d7d818-b38e-4827-9095-cec95ddc203c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:53.509846 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d7d818-b38e-4827-9095-cec95ddc203c admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:53.525205 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-6c3afffe-61f2-4fe0-ab4b-697f160799f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95125ca954f040e2ab1bca2d13b9955d', 'request_id': 'req-6c3afffe-61f2-4fe0-ab4b-697f160799f2'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:53.528673 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 926/1865] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:53.529479 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7d818-b38e-4827-9095-cec95ddc203c admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:53.534734 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-6c3afffe-61f2-4fe0-ab4b-697f160799f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95125ca954f040e2ab1bca2d13b9955d', 'request_id': 'req-6c3afffe-61f2-4fe0-ab4b-697f160799f2'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:53.543314 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-6c3afffe-61f2-4fe0-ab4b-697f160799f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95125ca954f040e2ab1bca2d13b9955d', 'request_id': 'req-6c3afffe-61f2-4fe0-ab4b-697f160799f2'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:53.550384 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7d818-b38e-4827-9095-cec95ddc203c admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:53.623260 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4c2ac-3d23-4d3b-a5f3-4af0b89e20f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:53.623940 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4c2ac-3d23-4d3b-a5f3-4af0b89e20f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:53.624268 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4c2ac-3d23-4d3b-a5f3-4af0b89e20f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:53.624552 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4c2ac-3d23-4d3b-a5f3-4af0b89e20f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:53.625253 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4c2ac-3d23-4d3b-a5f3-4af0b89e20f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:53.627151 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4c2ac-3d23-4d3b-a5f3-4af0b89e20f9 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:53.637695 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:53.645900 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-6c3afffe-61f2-4fe0-ab4b-697f160799f2 admin admin] The token cache is being invalidate because project 95125ca954f040e2ab1bca2d13b9955d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:06:53.645900 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-6c3afffe-61f2-4fe0-ab4b-697f160799f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:53.645900 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-6c3afffe-61f2-4fe0-ab4b-697f160799f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:53.645900 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 940/1866] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:06:53 2022] DELETE /identity/v3/projects/95125ca954f040e2ab1bca2d13b9955d => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:53.646220 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3afffe-61f2-4fe0-ab4b-697f160799f2 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:53.647294 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-6c3afffe-61f2-4fe0-ab4b-697f160799f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:53.661509 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3afffe-61f2-4fe0-ab4b-697f160799f2 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:53.680318 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6ac20-83c9-4723-8d51-c3b77ff568e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:53.680890 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6ac20-83c9-4723-8d51-c3b77ff568e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:53.681285 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6ac20-83c9-4723-8d51-c3b77ff568e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:53.681685 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6ac20-83c9-4723-8d51-c3b77ff568e6 admin admin] PATH_INFO: `/v3/projects/17b09d4b24934618981cf1608d942ef1/users/bb5b097f092f44a78b02208878478ba3/roles/86273ff072f3438d822e870272491768` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:53.690793 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb6ac20-83c9-4723-8d51-c3b77ff568e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17b09d4b24934618981cf1608d942ef1, user_id=bb5b097f092f44a78b02208878478ba3, role_id=86273ff072f3438d822e870272491768)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:53.693962 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb6ac20-83c9-4723-8d51-c3b77ff568e6 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:53.709248 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 941/1867] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:06:53 2022] PUT /identity/v3/projects/17b09d4b24934618981cf1608d942ef1/users/bb5b097f092f44a78b02208878478ba3/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:53.713559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0807ef0-8cc1-404b-84b6-60e6c90cea93 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:53.714627 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0807ef0-8cc1-404b-84b6-60e6c90cea93 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:53.716476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0807ef0-8cc1-404b-84b6-60e6c90cea93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:53.740303 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-c0807ef0-8cc1-404b-84b6-60e6c90cea93 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:53.741533 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-c0807ef0-8cc1-404b-84b6-60e6c90cea93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:53.780810 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 927/1868] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:06:53 2022] POST /identity/v3/projects => generated 391 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:53.783429 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4c2ac-3d23-4d3b-a5f3-4af0b89e20f9 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:53.786200 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d4d4c2ac-3d23-4d3b-a5f3-4af0b89e20f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:53.813990 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 942/1869] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:53.813990 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb4ec5-91d2-473a-9f02-3164f7d08dba None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:53.813990 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb4ec5-91d2-473a-9f02-3164f7d08dba None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:53.814304 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb4ec5-91d2-473a-9f02-3164f7d08dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:53.848253 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-13cb4ec5-91d2-473a-9f02-3164f7d08dba None None] MFA Rules not processed for user `bb5b097f092f44a78b02208878478ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:53.849590 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-13cb4ec5-91d2-473a-9f02-3164f7d08dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:53.878526 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4c2ac-3d23-4d3b-a5f3-4af0b89e20f9 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:53.884102 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9b637-0777-46fb-b267-0affe4b69e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:53.885369 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9b637-0777-46fb-b267-0affe4b69e8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:53.885369 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9b637-0777-46fb-b267-0affe4b69e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:53.885578 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9b637-0777-46fb-b267-0affe4b69e8f admin admin] PATH_INFO: `/v3/projects/9d53abc0a92a43b3a32839070f4779d4` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:53.886978 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9b637-0777-46fb-b267-0affe4b69e8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d53abc0a92a43b3a32839070f4779d4)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:53.889105 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9b637-0777-46fb-b267-0affe4b69e8f admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:53.933904 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 943/1870] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:53 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:53.935088 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb4ec5-91d2-473a-9f02-3164f7d08dba None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:53.936660 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-13cb4ec5-91d2-473a-9f02-3164f7d08dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:53.952664 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb4ec5-91d2-473a-9f02-3164f7d08dba None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:53.973421 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff641b7-9670-478a-aa8c-5016beeaf84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:53.974329 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff641b7-9670-478a-aa8c-5016beeaf84f admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:53.974458 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff641b7-9670-478a-aa8c-5016beeaf84f admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:53.974743 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff641b7-9670-478a-aa8c-5016beeaf84f admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:53.975590 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff641b7-9670-478a-aa8c-5016beeaf84f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:53.977729 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff641b7-9670-478a-aa8c-5016beeaf84f admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:54.085931 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-86b9b637-0777-46fb-b267-0affe4b69e8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d53abc0a92a43b3a32839070f4779d4', 'request_id': 'req-86b9b637-0777-46fb-b267-0affe4b69e8f'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:54.096015 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-86b9b637-0777-46fb-b267-0affe4b69e8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d53abc0a92a43b3a32839070f4779d4', 'request_id': 'req-86b9b637-0777-46fb-b267-0affe4b69e8f'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:54.107809 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-86b9b637-0777-46fb-b267-0affe4b69e8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d53abc0a92a43b3a32839070f4779d4', 'request_id': 'req-86b9b637-0777-46fb-b267-0affe4b69e8f'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:54.151011 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 944/1871] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:06:53 2022] POST /identity/v3/users => generated 302 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:54.153165 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5330fd9-cd0a-49e0-89f5-fc1a1b260358 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:54.153614 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5330fd9-cd0a-49e0-89f5-fc1a1b260358 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:54.158535 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5330fd9-cd0a-49e0-89f5-fc1a1b260358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:54.177502 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-c5330fd9-cd0a-49e0-89f5-fc1a1b260358 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:54.178958 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-c5330fd9-cd0a-49e0-89f5-fc1a1b260358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:54.261974 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 945/1872] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:54.263064 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5330fd9-cd0a-49e0-89f5-fc1a1b260358 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:54.265605 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-c5330fd9-cd0a-49e0-89f5-fc1a1b260358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:54.305284 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-86b9b637-0777-46fb-b267-0affe4b69e8f admin admin] The token cache is being invalidate because project 9d53abc0a92a43b3a32839070f4779d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:06:54.305720 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-86b9b637-0777-46fb-b267-0affe4b69e8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:54.306439 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-86b9b637-0777-46fb-b267-0affe4b69e8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:54.310286 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 928/1873] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:06:53 2022] DELETE /identity/v3/projects/9d53abc0a92a43b3a32839070f4779d4 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:54.310286 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9b637-0777-46fb-b267-0affe4b69e8f admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:54.311296 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-86b9b637-0777-46fb-b267-0affe4b69e8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:54.333478 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9b637-0777-46fb-b267-0affe4b69e8f admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:54.338462 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5330fd9-cd0a-49e0-89f5-fc1a1b260358 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:54.339440 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e902fa1-f016-481d-b515-15af4e161fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:54.340255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e902fa1-f016-481d-b515-15af4e161fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:54.340385 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5229e-6a55-40a2-950e-2556e12ccbf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:54.340714 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e902fa1-f016-481d-b515-15af4e161fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:54.340948 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5229e-6a55-40a2-950e-2556e12ccbf7 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:54.341061 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e902fa1-f016-481d-b515-15af4e161fd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:54.341245 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5229e-6a55-40a2-950e-2556e12ccbf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:54.342087 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5229e-6a55-40a2-950e-2556e12ccbf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:54.342617 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e902fa1-f016-481d-b515-15af4e161fd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:54.344409 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-58a5229e-6a55-40a2-950e-2556e12ccbf7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:54.345011 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e902fa1-f016-481d-b515-15af4e161fd4 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:54.358151 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 929/1874] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:54.359137 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e902fa1-f016-481d-b515-15af4e161fd4 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:54.361304 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-6e902fa1-f016-481d-b515-15af4e161fd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:54.375482 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e902fa1-f016-481d-b515-15af4e161fd4 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:54.381761 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771cf123-34db-4636-8cb6-dadf71ea4f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:54.382139 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771cf123-34db-4636-8cb6-dadf71ea4f65 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:54.382671 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771cf123-34db-4636-8cb6-dadf71ea4f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:54.383061 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771cf123-34db-4636-8cb6-dadf71ea4f65 admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:54.384051 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771cf123-34db-4636-8cb6-dadf71ea4f65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:06:54.384442 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771cf123-34db-4636-8cb6-dadf71ea4f65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:54.386992 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771cf123-34db-4636-8cb6-dadf71ea4f65 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:54.404800 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 930/1875] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:06:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:06:54.406945 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771cf123-34db-4636-8cb6-dadf71ea4f65 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:54.409781 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-771cf123-34db-4636-8cb6-dadf71ea4f65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:54.425014 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771cf123-34db-4636-8cb6-dadf71ea4f65 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:54.433557 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402a75d-c378-426b-b4aa-20d807154c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:54.435445 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402a75d-c378-426b-b4aa-20d807154c84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:54.435735 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402a75d-c378-426b-b4aa-20d807154c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:54.436050 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402a75d-c378-426b-b4aa-20d807154c84 admin admin] PATH_INFO: `/v3/users/7107b99219c048ceb92f72d30477034f` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:54.437400 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5229e-6a55-40a2-950e-2556e12ccbf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:54.437514 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8402a75d-c378-426b-b4aa-20d807154c84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7107b99219c048ceb92f72d30477034f)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:54.439403 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5229e-6a55-40a2-950e-2556e12ccbf7 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:54.439717 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8402a75d-c378-426b-b4aa-20d807154c84 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:54.450577 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:54.459342 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 946/1876] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:54 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:06:54.461236 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5229e-6a55-40a2-950e-2556e12ccbf7 service cinder] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:54.474567 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5229e-6a55-40a2-950e-2556e12ccbf7 service cinder] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:54.480325 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb7878-0bb8-4ba5-a1be-7e4fbecdf1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:54.482114 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb7878-0bb8-4ba5-a1be-7e4fbecdf1b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:54.482477 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb7878-0bb8-4ba5-a1be-7e4fbecdf1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:54.482834 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb7878-0bb8-4ba5-a1be-7e4fbecdf1b0 admin admin] PATH_INFO: `/v3/projects/9376eba7cded49319a9c8c337db327b9/users/7f228d81e8944a80a44b0461d78033b7/roles/86273ff072f3438d822e870272491768` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:54.502398 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb7878-0bb8-4ba5-a1be-7e4fbecdf1b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9376eba7cded49319a9c8c337db327b9, user_id=7f228d81e8944a80a44b0461d78033b7, role_id=86273ff072f3438d822e870272491768)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:54.505821 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb7878-0bb8-4ba5-a1be-7e4fbecdf1b0 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:54.585992 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 947/1877] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:06:54 2022] PUT /identity/v3/projects/9376eba7cded49319a9c8c337db327b9/users/7f228d81e8944a80a44b0461d78033b7/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:54.585992 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb7878-0bb8-4ba5-a1be-7e4fbecdf1b0 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:54.643255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-8402a75d-c378-426b-b4aa-20d807154c84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7107b99219c048ceb92f72d30477034f'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:54.651957 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-8402a75d-c378-426b-b4aa-20d807154c84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7107b99219c048ceb92f72d30477034f'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:54.657305 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-8402a75d-c378-426b-b4aa-20d807154c84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7107b99219c048ceb92f72d30477034f'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:54.659238 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-8402a75d-c378-426b-b4aa-20d807154c84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7107b99219c048ceb92f72d30477034f'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:54.679305 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb7878-0bb8-4ba5-a1be-7e4fbecdf1b0 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:54.685507 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa69645-6807-4fa9-a36c-d29873f4e1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:54.686488 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa69645-6807-4fa9-a36c-d29873f4e1ab admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:54.690770 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa69645-6807-4fa9-a36c-d29873f4e1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:54.690770 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa69645-6807-4fa9-a36c-d29873f4e1ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:54.690770 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa69645-6807-4fa9-a36c-d29873f4e1ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:54.690770 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa69645-6807-4fa9-a36c-d29873f4e1ab admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:54.739126 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-8402a75d-c378-426b-b4aa-20d807154c84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7107b99219c048ceb92f72d30477034f'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:54.767646 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 931/1878] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:06:54 2022] DELETE /identity/v3/users/7107b99219c048ceb92f72d30477034f => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:54.768618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402a75d-c378-426b-b4aa-20d807154c84 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:54.769943 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-8402a75d-c378-426b-b4aa-20d807154c84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:54.796938 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 948/1879] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:06:54 2022] POST /identity/v3/projects => generated 387 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:54.798511 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa69645-6807-4fa9-a36c-d29873f4e1ab admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:54.800863 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-eaa69645-6807-4fa9-a36c-d29873f4e1ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:54.873029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402a75d-c378-426b-b4aa-20d807154c84 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:54.947469 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa69645-6807-4fa9-a36c-d29873f4e1ab admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:54.952902 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd3c5f-5c06-4a67-a2ca-9c375102bcef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:54.954039 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd3c5f-5c06-4a67-a2ca-9c375102bcef service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:54.954122 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd3c5f-5c06-4a67-a2ca-9c375102bcef service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:54.954350 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd3c5f-5c06-4a67-a2ca-9c375102bcef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:54.964781 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-7ddd3c5f-5c06-4a67-a2ca-9c375102bcef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:54.982648 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c4558-91db-4e58-b67f-4e06d83f1f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:54.987485 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c4558-91db-4e58-b67f-4e06d83f1f33 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:54.988460 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c4558-91db-4e58-b67f-4e06d83f1f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:55.003839 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c4558-91db-4e58-b67f-4e06d83f1f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:55.006325 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3c4558-91db-4e58-b67f-4e06d83f1f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:55.010098 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3c4558-91db-4e58-b67f-4e06d83f1f33 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:55.045208 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 932/1880] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:55.046298 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c4558-91db-4e58-b67f-4e06d83f1f33 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:55.052905 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-eb3c4558-91db-4e58-b67f-4e06d83f1f33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:55.056175 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd3c5f-5c06-4a67-a2ca-9c375102bcef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:55.058310 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd3c5f-5c06-4a67-a2ca-9c375102bcef service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:55.069987 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 949/1881] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:06:55.071024 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd3c5f-5c06-4a67-a2ca-9c375102bcef service cinder] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:55.083533 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd3c5f-5c06-4a67-a2ca-9c375102bcef service cinder] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:55.092601 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749eb022-d433-4930-ad64-494a626206db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:55.093663 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749eb022-d433-4930-ad64-494a626206db admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:55.094368 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749eb022-d433-4930-ad64-494a626206db admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:55.094947 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749eb022-d433-4930-ad64-494a626206db admin admin] PATH_INFO: `/v3/projects/9376eba7cded49319a9c8c337db327b9/users/7f228d81e8944a80a44b0461d78033b7/roles/86273ff072f3438d822e870272491768` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:55.098077 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749eb022-d433-4930-ad64-494a626206db admin admin] RBAC: Authorizing `identity:create_grant(project_id=9376eba7cded49319a9c8c337db327b9, user_id=7f228d81e8944a80a44b0461d78033b7, role_id=86273ff072f3438d822e870272491768)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:55.103786 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c4558-91db-4e58-b67f-4e06d83f1f33 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:55.107958 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749eb022-d433-4930-ad64-494a626206db admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:55.126430 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2849343e-92d8-4237-8aab-4701c64b99fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:55.133470 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849343e-92d8-4237-8aab-4701c64b99fc admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:55.133799 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849343e-92d8-4237-8aab-4701c64b99fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:55.134119 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849343e-92d8-4237-8aab-4701c64b99fc admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:55.138557 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2849343e-92d8-4237-8aab-4701c64b99fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:55.140817 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2849343e-92d8-4237-8aab-4701c64b99fc admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:55.150838 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 950/1882] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:06:55 2022] PUT /identity/v3/projects/9376eba7cded49319a9c8c337db327b9/users/7f228d81e8944a80a44b0461d78033b7/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:55.165661 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a0b31-11bd-4150-9df0-e925cfe9c16c None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:55.166222 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a0b31-11bd-4150-9df0-e925cfe9c16c None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:55.166402 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a0b31-11bd-4150-9df0-e925cfe9c16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:55.171847 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:55.205851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-586a0b31-11bd-4150-9df0-e925cfe9c16c None None] MFA Rules not processed for user `7f228d81e8944a80a44b0461d78033b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:55.207926 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-586a0b31-11bd-4150-9df0-e925cfe9c16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:55.246335 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 933/1883] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:06:55 2022] POST /identity/v3/users => generated 294 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:55.250696 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2849343e-92d8-4237-8aab-4701c64b99fc admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:55.264563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2849343e-92d8-4237-8aab-4701c64b99fc admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:55.356456 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 951/1884] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:55 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:55.362689 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28293c-5b9e-4649-b9c1-cf5ef2e65803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:55.364517 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28293c-5b9e-4649-b9c1-cf5ef2e65803 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:55.364864 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28293c-5b9e-4649-b9c1-cf5ef2e65803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:55.365152 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28293c-5b9e-4649-b9c1-cf5ef2e65803 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:55.365565 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a0b31-11bd-4150-9df0-e925cfe9c16c None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:55.365971 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28293c-5b9e-4649-b9c1-cf5ef2e65803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:55.367739 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-586a0b31-11bd-4150-9df0-e925cfe9c16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:55.367875 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28293c-5b9e-4649-b9c1-cf5ef2e65803 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:55.384147 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 934/1885] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 21:06:55.387797 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28293c-5b9e-4649-b9c1-cf5ef2e65803 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:55.404196 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28293c-5b9e-4649-b9c1-cf5ef2e65803 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:55.412680 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee047da-60b4-4f37-adef-105e7a7eac67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:55.414261 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee047da-60b4-4f37-adef-105e7a7eac67 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:55.414557 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee047da-60b4-4f37-adef-105e7a7eac67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:55.415044 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee047da-60b4-4f37-adef-105e7a7eac67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:55.415582 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee047da-60b4-4f37-adef-105e7a7eac67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:55.417544 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee047da-60b4-4f37-adef-105e7a7eac67 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:55.431666 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 935/1886] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 21:06:55.433106 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee047da-60b4-4f37-adef-105e7a7eac67 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:55.447147 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee047da-60b4-4f37-adef-105e7a7eac67 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:55.453164 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554a9aa-5aaf-4f1a-94d6-63214c0c10ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:55.454078 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554a9aa-5aaf-4f1a-94d6-63214c0c10ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:55.454367 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554a9aa-5aaf-4f1a-94d6-63214c0c10ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:55.454852 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554a9aa-5aaf-4f1a-94d6-63214c0c10ba admin admin] PATH_INFO: `/v3/projects/bfd0938d6d754f758bd2fc9b9154d556/users/828b9a6efaf847d98b02d155d59bfba1/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:55.473771 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7554a9aa-5aaf-4f1a-94d6-63214c0c10ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfd0938d6d754f758bd2fc9b9154d556, user_id=828b9a6efaf847d98b02d155d59bfba1, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:55.477374 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7554a9aa-5aaf-4f1a-94d6-63214c0c10ba admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:55.485990 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a0b31-11bd-4150-9df0-e925cfe9c16c None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:55.493243 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29b8f5-68e2-45ab-b002-e7f5b777db73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:55.494194 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29b8f5-68e2-45ab-b002-e7f5b777db73 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:55.494536 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29b8f5-68e2-45ab-b002-e7f5b777db73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:55.494885 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29b8f5-68e2-45ab-b002-e7f5b777db73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:55.508695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29b8f5-68e2-45ab-b002-e7f5b777db73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:55.511059 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29b8f5-68e2-45ab-b002-e7f5b777db73 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:55.527637 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 952/1887] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:55 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:06:55.550644 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 936/1888] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:06:55 2022] PUT /identity/v3/projects/bfd0938d6d754f758bd2fc9b9154d556/users/828b9a6efaf847d98b02d155d59bfba1/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:55.561948 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90a273-9b24-4f8d-bf35-c4a9e2d5b4f9 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:55.562366 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90a273-9b24-4f8d-bf35-c4a9e2d5b4f9 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:55.562538 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90a273-9b24-4f8d-bf35-c4a9e2d5b4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:55.650567 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-1a90a273-9b24-4f8d-bf35-c4a9e2d5b4f9 None None] MFA Rules not processed for user `828b9a6efaf847d98b02d155d59bfba1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:55.653487 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-1a90a273-9b24-4f8d-bf35-c4a9e2d5b4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:55.664093 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554a9aa-5aaf-4f1a-94d6-63214c0c10ba admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:55.766115 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554a9aa-5aaf-4f1a-94d6-63214c0c10ba admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:55.772081 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 953/1889] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:55.773523 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0dc634-1c61-4073-87d3-9cb7908afc78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:55.774406 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0dc634-1c61-4073-87d3-9cb7908afc78 service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:55.775042 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0dc634-1c61-4073-87d3-9cb7908afc78 service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:55.775472 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0dc634-1c61-4073-87d3-9cb7908afc78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:55.778076 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90a273-9b24-4f8d-bf35-c4a9e2d5b4f9 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:55.779203 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-ab0dc634-1c61-4073-87d3-9cb7908afc78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:55.779566 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-1a90a273-9b24-4f8d-bf35-c4a9e2d5b4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:55.859137 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0dc634-1c61-4073-87d3-9cb7908afc78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:55.860732 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0dc634-1c61-4073-87d3-9cb7908afc78 service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:55.868115 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90a273-9b24-4f8d-bf35-c4a9e2d5b4f9 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:55.873667 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43037956-cbc1-42a1-8a26-07e77673d54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:55.873831 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 937/1890] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:06:55.874663 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0dc634-1c61-4073-87d3-9cb7908afc78 service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:55.874924 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43037956-cbc1-42a1-8a26-07e77673d54b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:55.875219 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43037956-cbc1-42a1-8a26-07e77673d54b admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:55.875500 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43037956-cbc1-42a1-8a26-07e77673d54b admin admin] PATH_INFO: `/v3/projects/aad3040c2c1e45d1a8a8f9fe0d6b14bc` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:55.876739 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43037956-cbc1-42a1-8a26-07e77673d54b admin admin] RBAC: Authorizing `identity:delete_project(project_id=aad3040c2c1e45d1a8a8f9fe0d6b14bc)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:55.879014 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43037956-cbc1-42a1-8a26-07e77673d54b admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:55.889563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0dc634-1c61-4073-87d3-9cb7908afc78 service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:55.896950 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae604f-01fb-44bf-9413-c1ff86a45d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:55.898852 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae604f-01fb-44bf-9413-c1ff86a45d33 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:55.899298 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae604f-01fb-44bf-9413-c1ff86a45d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:55.899592 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae604f-01fb-44bf-9413-c1ff86a45d33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:55.900766 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae604f-01fb-44bf-9413-c1ff86a45d33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:55.904575 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae604f-01fb-44bf-9413-c1ff86a45d33 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:56.012547 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 938/1891] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:06:55 2022] POST /identity/v3/projects => generated 387 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:56.014097 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae604f-01fb-44bf-9413-c1ff86a45d33 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:56.025262 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-43037956-cbc1-42a1-8a26-07e77673d54b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aad3040c2c1e45d1a8a8f9fe0d6b14bc', 'request_id': 'req-43037956-cbc1-42a1-8a26-07e77673d54b'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:56.035218 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-43037956-cbc1-42a1-8a26-07e77673d54b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aad3040c2c1e45d1a8a8f9fe0d6b14bc', 'request_id': 'req-43037956-cbc1-42a1-8a26-07e77673d54b'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:56.046605 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-43037956-cbc1-42a1-8a26-07e77673d54b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aad3040c2c1e45d1a8a8f9fe0d6b14bc', 'request_id': 'req-43037956-cbc1-42a1-8a26-07e77673d54b'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:56.095233 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae604f-01fb-44bf-9413-c1ff86a45d33 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:56.100340 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57e03e-6aaf-4863-9f4d-984a636657c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:56.101031 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57e03e-6aaf-4863-9f4d-984a636657c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:56.101327 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57e03e-6aaf-4863-9f4d-984a636657c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:56.101601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57e03e-6aaf-4863-9f4d-984a636657c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:56.102297 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b57e03e-6aaf-4863-9f4d-984a636657c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:56.104412 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b57e03e-6aaf-4863-9f4d-984a636657c4 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:56.178503 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-43037956-cbc1-42a1-8a26-07e77673d54b admin admin] The token cache is being invalidate because project aad3040c2c1e45d1a8a8f9fe0d6b14bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:06:56.179035 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-43037956-cbc1-42a1-8a26-07e77673d54b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:56.179456 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-43037956-cbc1-42a1-8a26-07e77673d54b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:06:56.181093 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 954/1892] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:06:55 2022] DELETE /identity/v3/projects/aad3040c2c1e45d1a8a8f9fe0d6b14bc => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:56.182012 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 939/1893] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:06:56 2022] POST /identity/v3/users => generated 294 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:56.186595 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57e03e-6aaf-4863-9f4d-984a636657c4 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:56.186947 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9c1b6-b8de-4850-95db-7e7ac6ad2dab None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:56.187554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9c1b6-b8de-4850-95db-7e7ac6ad2dab None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:56.187796 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9c1b6-b8de-4850-95db-7e7ac6ad2dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:56.188610 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-0b57e03e-6aaf-4863-9f4d-984a636657c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:56.203848 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57e03e-6aaf-4863-9f4d-984a636657c4 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:56.209501 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-55c9c1b6-b8de-4850-95db-7e7ac6ad2dab None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:56.209912 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbbb3f-ab52-419d-9571-b7de43269cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:56.210612 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbbb3f-ab52-419d-9571-b7de43269cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:56.210720 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-55c9c1b6-b8de-4850-95db-7e7ac6ad2dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:56.210894 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbbb3f-ab52-419d-9571-b7de43269cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:56.211177 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbbb3f-ab52-419d-9571-b7de43269cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:56.211919 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bbbb3f-ab52-419d-9571-b7de43269cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:56.213697 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bbbb3f-ab52-419d-9571-b7de43269cb4 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:56.220408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 955/1894] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:56.229479 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 940/1895] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:56.241000 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e6adb-4ace-4e48-a755-03e296cf87d1 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:56.241000 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e6adb-4ace-4e48-a755-03e296cf87d1 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:56.241000 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e6adb-4ace-4e48-a755-03e296cf87d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:56.241316 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbbb3f-ab52-419d-9571-b7de43269cb4 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:56.243945 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbbb3f-ab52-419d-9571-b7de43269cb4 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:56.252592 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf388934-1e2a-45b0-96d0-d015ad1272f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:56.253355 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf388934-1e2a-45b0-96d0-d015ad1272f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:56.253714 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf388934-1e2a-45b0-96d0-d015ad1272f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:56.254115 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf388934-1e2a-45b0-96d0-d015ad1272f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:56.254421 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-344e6adb-4ace-4e48-a755-03e296cf87d1 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:56.254992 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf388934-1e2a-45b0-96d0-d015ad1272f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:56.255660 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-344e6adb-4ace-4e48-a755-03e296cf87d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:56.256752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf388934-1e2a-45b0-96d0-d015ad1272f9 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:56.268419 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 956/1896] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:56.269575 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e6adb-4ace-4e48-a755-03e296cf87d1 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:56.272955 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 941/1897] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:56.276713 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf388934-1e2a-45b0-96d0-d015ad1272f9 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:56.281333 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e6adb-4ace-4e48-a755-03e296cf87d1 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:56.289551 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf388934-1e2a-45b0-96d0-d015ad1272f9 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:56.290670 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4102b3d-6ccc-491a-a836-927ed03b2920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:56.292645 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4102b3d-6ccc-491a-a836-927ed03b2920 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:56.293273 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4102b3d-6ccc-491a-a836-927ed03b2920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:56.293502 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4102b3d-6ccc-491a-a836-927ed03b2920 admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:56.294414 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4102b3d-6ccc-491a-a836-927ed03b2920 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:06:56.294843 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4102b3d-6ccc-491a-a836-927ed03b2920 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:56.295763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09975869-ed5c-40c9-b4ca-16eb8a50574b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:56.296841 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4102b3d-6ccc-491a-a836-927ed03b2920 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:56.296991 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09975869-ed5c-40c9-b4ca-16eb8a50574b admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:56.297368 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09975869-ed5c-40c9-b4ca-16eb8a50574b admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:56.308866 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09975869-ed5c-40c9-b4ca-16eb8a50574b admin admin] PATH_INFO: `/v3/projects/05ea57ebb5d34ac2adc7e8687af4f3fb/users/3c7c401ca4c34122bcf1626be5574f65/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:56.322436 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 957/1898] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:06:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:06:56.323516 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4102b3d-6ccc-491a-a836-927ed03b2920 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:56.338395 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4102b3d-6ccc-491a-a836-927ed03b2920 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:56.345157 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c4bdd-4b26-4c5b-bfc4-dc7415e3cedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:56.345850 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c4bdd-4b26-4c5b-bfc4-dc7415e3cedc admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:56.346139 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c4bdd-4b26-4c5b-bfc4-dc7415e3cedc admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:56.346420 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c4bdd-4b26-4c5b-bfc4-dc7415e3cedc admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:56.347349 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290c4bdd-4b26-4c5b-bfc4-dc7415e3cedc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:56.350399 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290c4bdd-4b26-4c5b-bfc4-dc7415e3cedc admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:56.357800 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09975869-ed5c-40c9-b4ca-16eb8a50574b admin admin] RBAC: Authorizing `identity:create_grant(project_id=05ea57ebb5d34ac2adc7e8687af4f3fb, user_id=3c7c401ca4c34122bcf1626be5574f65, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:56.360502 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09975869-ed5c-40c9-b4ca-16eb8a50574b admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:56.451600 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:56.457188 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 942/1899] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:06:56 2022] PUT /identity/v3/projects/05ea57ebb5d34ac2adc7e8687af4f3fb/users/3c7c401ca4c34122bcf1626be5574f65/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:56.463670 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 958/1900] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:06:56 2022] POST /identity/v3/projects => generated 367 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:56.465313 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09975869-ed5c-40c9-b4ca-16eb8a50574b admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:56.467253 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d9993-d293-4a38-ac90-129eb011e5a4 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:56.467549 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d9993-d293-4a38-ac90-129eb011e5a4 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:56.467830 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d9993-d293-4a38-ac90-129eb011e5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:56.501074 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-333d9993-d293-4a38-ac90-129eb011e5a4 None None] MFA Rules not processed for user `3c7c401ca4c34122bcf1626be5574f65`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:56.502365 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-333d9993-d293-4a38-ac90-129eb011e5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:56.553871 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09975869-ed5c-40c9-b4ca-16eb8a50574b admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:56.611124 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 959/1901] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:06:56.613830 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d9993-d293-4a38-ac90-129eb011e5a4 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:56.714666 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d9993-d293-4a38-ac90-129eb011e5a4 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:56.715163 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b4d44-da83-4a24-ba51-e0289caf312a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:56.716048 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b4d44-da83-4a24-ba51-e0289caf312a admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:56.716338 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b4d44-da83-4a24-ba51-e0289caf312a admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:56.716711 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b4d44-da83-4a24-ba51-e0289caf312a admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:56.717472 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878b4d44-da83-4a24-ba51-e0289caf312a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:56.719772 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878b4d44-da83-4a24-ba51-e0289caf312a admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:56.721693 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac9c26-9849-4290-a614-3f1c92cccf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:56.722431 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac9c26-9849-4290-a614-3f1c92cccf55 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:56.725923 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac9c26-9849-4290-a614-3f1c92cccf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:56.725923 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac9c26-9849-4290-a614-3f1c92cccf55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:56.725923 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac9c26-9849-4290-a614-3f1c92cccf55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:56.727331 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac9c26-9849-4290-a614-3f1c92cccf55 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:56.849807 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 960/1902] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:06:56 2022] POST /identity/v3/projects => generated 387 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:56.850814 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac9c26-9849-4290-a614-3f1c92cccf55 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:56.865535 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 943/1903] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:06:56 2022] POST /identity/v3/users => generated 284 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:56.870749 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b4d44-da83-4a24-ba51-e0289caf312a admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:56.890534 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b4d44-da83-4a24-ba51-e0289caf312a admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:56.949746 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac9c26-9849-4290-a614-3f1c92cccf55 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:56.956145 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a68e2-2e20-4a40-a3e8-d000a0509a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:56.957052 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a68e2-2e20-4a40-a3e8-d000a0509a54 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:56.957232 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a68e2-2e20-4a40-a3e8-d000a0509a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:56.957487 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a68e2-2e20-4a40-a3e8-d000a0509a54 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:56.958220 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a68e2-2e20-4a40-a3e8-d000a0509a54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:56.960248 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a68e2-2e20-4a40-a3e8-d000a0509a54 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:56.972323 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913df242-ccd4-46db-b977-ca60cb0c4cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:56.973197 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913df242-ccd4-46db-b977-ca60cb0c4cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:56.973584 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913df242-ccd4-46db-b977-ca60cb0c4cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:56.973964 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913df242-ccd4-46db-b977-ca60cb0c4cb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:56.974798 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913df242-ccd4-46db-b977-ca60cb0c4cb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:56.976573 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913df242-ccd4-46db-b977-ca60cb0c4cb3 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:56.988597 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 944/1904] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:56.992533 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913df242-ccd4-46db-b977-ca60cb0c4cb3 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:57.003526 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913df242-ccd4-46db-b977-ca60cb0c4cb3 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:57.009221 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa0fc3-ca0f-4405-b5bb-1116a873d3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:57.022181 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa0fc3-ca0f-4405-b5bb-1116a873d3fb admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:57.024139 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa0fc3-ca0f-4405-b5bb-1116a873d3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:57.024509 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa0fc3-ca0f-4405-b5bb-1116a873d3fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:57.025356 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa0fc3-ca0f-4405-b5bb-1116a873d3fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:57.027797 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa0fc3-ca0f-4405-b5bb-1116a873d3fb admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:57.038948 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 945/1905] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:57.043493 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa0fc3-ca0f-4405-b5bb-1116a873d3fb admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:57.053226 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa0fc3-ca0f-4405-b5bb-1116a873d3fb admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:57.058250 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4354d4a-5702-4ec0-9611-4d7db45aeca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:57.059122 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4354d4a-5702-4ec0-9611-4d7db45aeca2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:57.059417 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4354d4a-5702-4ec0-9611-4d7db45aeca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:57.062675 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4354d4a-5702-4ec0-9611-4d7db45aeca2 admin admin] PATH_INFO: `/v3/projects/afd10005c9054d69bb3db78e6cde5e79/users/13cec5a040d846dab4039f43848d3ae3/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:57.075003 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4354d4a-5702-4ec0-9611-4d7db45aeca2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afd10005c9054d69bb3db78e6cde5e79, user_id=13cec5a040d846dab4039f43848d3ae3, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:57.077734 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4354d4a-5702-4ec0-9611-4d7db45aeca2 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:57.110886 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 961/1906] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:06:56 2022] POST /identity/v3/users => generated 300 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:06:57.114632 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a68e2-2e20-4a40-a3e8-d000a0509a54 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:57.124849 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a68e2-2e20-4a40-a3e8-d000a0509a54 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:57.132267 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b1658-8c64-46c6-a273-190967de6bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:57.132950 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b1658-8c64-46c6-a273-190967de6bfa admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:57.133243 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b1658-8c64-46c6-a273-190967de6bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:57.133547 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b1658-8c64-46c6-a273-190967de6bfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:57.134284 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b1658-8c64-46c6-a273-190967de6bfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:57.136571 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b1658-8c64-46c6-a273-190967de6bfa admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:57.147247 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 962/1907] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 21:06:57.152225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b1658-8c64-46c6-a273-190967de6bfa admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:57.157664 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 946/1908] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:06:57 2022] PUT /identity/v3/projects/afd10005c9054d69bb3db78e6cde5e79/users/13cec5a040d846dab4039f43848d3ae3/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:57.166742 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b1658-8c64-46c6-a273-190967de6bfa admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:57.168441 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1de7fa-232f-49b3-b527-fad0f4d47802 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:57.168734 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1de7fa-232f-49b3-b527-fad0f4d47802 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:57.169015 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1de7fa-232f-49b3-b527-fad0f4d47802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:57.196772 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-fb1de7fa-232f-49b3-b527-fad0f4d47802 None None] MFA Rules not processed for user `13cec5a040d846dab4039f43848d3ae3`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:57.197987 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-fb1de7fa-232f-49b3-b527-fad0f4d47802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:57.243860 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2be71b-ad79-4011-9c54-224237c84b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:57.244853 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2be71b-ad79-4011-9c54-224237c84b71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:57.245239 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2be71b-ad79-4011-9c54-224237c84b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:57.245519 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2be71b-ad79-4011-9c54-224237c84b71 admin admin] PATH_INFO: `/v3/projects/849ed5107f404f9aacc8eb440e2eeb5a/users/28fdc2fcf0044cda84c076ef40f0ec42/roles/86273ff072f3438d822e870272491768` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:57.269839 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2be71b-ad79-4011-9c54-224237c84b71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=849ed5107f404f9aacc8eb440e2eeb5a, user_id=28fdc2fcf0044cda84c076ef40f0ec42, role_id=86273ff072f3438d822e870272491768)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:57.274488 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2be71b-ad79-4011-9c54-224237c84b71 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:57.285057 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 947/1909] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:57 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:06:57.289563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1de7fa-232f-49b3-b527-fad0f4d47802 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:57.302566 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1de7fa-232f-49b3-b527-fad0f4d47802 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:57.307394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258bd8d-a180-48e8-852b-6da9b54a2caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:57.308506 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258bd8d-a180-48e8-852b-6da9b54a2caa admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:57.308880 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258bd8d-a180-48e8-852b-6da9b54a2caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:57.309218 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258bd8d-a180-48e8-852b-6da9b54a2caa admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:57.310050 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258bd8d-a180-48e8-852b-6da9b54a2caa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:57.312135 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258bd8d-a180-48e8-852b-6da9b54a2caa admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:57.384860 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 963/1910] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:06:57 2022] PUT /identity/v3/projects/849ed5107f404f9aacc8eb440e2eeb5a/users/28fdc2fcf0044cda84c076ef40f0ec42/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:57.388966 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2be71b-ad79-4011-9c54-224237c84b71 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:57.412445 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 948/1911] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:06:57 2022] POST /identity/v3/projects => generated 365 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 21:06:57.416925 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258bd8d-a180-48e8-852b-6da9b54a2caa admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:57.486967 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2be71b-ad79-4011-9c54-224237c84b71 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:57.515023 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258bd8d-a180-48e8-852b-6da9b54a2caa admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:57.520889 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e7533-5b81-4798-b48d-e8068a377d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:57.521913 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e7533-5b81-4798-b48d-e8068a377d37 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:57.522059 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e7533-5b81-4798-b48d-e8068a377d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:57.522334 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e7533-5b81-4798-b48d-e8068a377d37 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:57.523542 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4e7533-5b81-4798-b48d-e8068a377d37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:57.525870 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4e7533-5b81-4798-b48d-e8068a377d37 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:57.574274 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0d21c-3f32-4aab-9ed4-3c220a3bb76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:57.575283 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0d21c-3f32-4aab-9ed4-3c220a3bb76f admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:57.575616 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0d21c-3f32-4aab-9ed4-3c220a3bb76f admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:57.575860 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0d21c-3f32-4aab-9ed4-3c220a3bb76f admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:57.580438 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0d21c-3f32-4aab-9ed4-3c220a3bb76f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:57.580438 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0d21c-3f32-4aab-9ed4-3c220a3bb76f admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:57.592124 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 964/1912] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:57.593288 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0d21c-3f32-4aab-9ed4-3c220a3bb76f admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:57.604564 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0d21c-3f32-4aab-9ed4-3c220a3bb76f admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:57.609765 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42e709-6875-440e-9d68-57b9978acad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:57.610706 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42e709-6875-440e-9d68-57b9978acad6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:57.610994 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42e709-6875-440e-9d68-57b9978acad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:57.611276 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42e709-6875-440e-9d68-57b9978acad6 admin admin] PATH_INFO: `/v3/projects/849ed5107f404f9aacc8eb440e2eeb5a/users/28fdc2fcf0044cda84c076ef40f0ec42/roles/86273ff072f3438d822e870272491768` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:57.613321 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd42e709-6875-440e-9d68-57b9978acad6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=849ed5107f404f9aacc8eb440e2eeb5a, user_id=28fdc2fcf0044cda84c076ef40f0ec42, role_id=86273ff072f3438d822e870272491768)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:57.615996 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd42e709-6875-440e-9d68-57b9978acad6 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:57.640452 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 965/1913] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:06:57 2022] PUT /identity/v3/projects/849ed5107f404f9aacc8eb440e2eeb5a/users/28fdc2fcf0044cda84c076ef40f0ec42/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:57.642055 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42e709-6875-440e-9d68-57b9978acad6 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:57.646295 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 949/1914] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:06:57 2022] POST /identity/v3/users => generated 289 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 21:06:57.648714 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd6849-a2ac-48d8-b47d-fdb00255adac None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:57.649007 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd6849-a2ac-48d8-b47d-fdb00255adac None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:57.649292 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd6849-a2ac-48d8-b47d-fdb00255adac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:57.709776 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-15bd6849-a2ac-48d8-b47d-fdb00255adac None None] MFA Rules not processed for user `28fdc2fcf0044cda84c076ef40f0ec42`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:57.713344 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-15bd6849-a2ac-48d8-b47d-fdb00255adac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:57.745905 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42e709-6875-440e-9d68-57b9978acad6 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:57.752269 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4610849-1199-4fde-a6ae-7378c0e16af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:57.753213 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4610849-1199-4fde-a6ae-7378c0e16af8 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:57.753570 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4610849-1199-4fde-a6ae-7378c0e16af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:57.753924 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4610849-1199-4fde-a6ae-7378c0e16af8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:57.754896 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4610849-1199-4fde-a6ae-7378c0e16af8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:57.756901 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4610849-1199-4fde-a6ae-7378c0e16af8 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:57.780331 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 966/1915] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:57.781668 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4610849-1199-4fde-a6ae-7378c0e16af8 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:57.804789 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4610849-1199-4fde-a6ae-7378c0e16af8 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:57.806229 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf8cb5-d83d-46a0-8281-4d418d3056d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:57.807217 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf8cb5-d83d-46a0-8281-4d418d3056d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:57.807732 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf8cb5-d83d-46a0-8281-4d418d3056d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:57.808608 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf8cb5-d83d-46a0-8281-4d418d3056d4 admin admin] PATH_INFO: `/v3/projects/0aabd476e2c04913969779add8214fea/users/537f4f908c1d465da68db0c34d79c5f9/roles/86273ff072f3438d822e870272491768` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:57.840860 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf8cb5-d83d-46a0-8281-4d418d3056d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aabd476e2c04913969779add8214fea, user_id=537f4f908c1d465da68db0c34d79c5f9, role_id=86273ff072f3438d822e870272491768)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:57.845016 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf8cb5-d83d-46a0-8281-4d418d3056d4 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:57.883492 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 950/1916] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:57.883492 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69772a64-f53b-4820-88b3-a8846fa21d07 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:57.883492 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69772a64-f53b-4820-88b3-a8846fa21d07 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:57.883492 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69772a64-f53b-4820-88b3-a8846fa21d07 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:57.883924 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 951/1917] 10.222.0.40 () {54 vars in 921 bytes} [Mon Jul 11 21:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 21:06:57.891508 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69772a64-f53b-4820-88b3-a8846fa21d07 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:57.893409 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-69772a64-f53b-4820-88b3-a8846fa21d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:57.934772 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 967/1918] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:06:57 2022] PUT /identity/v3/projects/0aabd476e2c04913969779add8214fea/users/537f4f908c1d465da68db0c34d79c5f9/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:57.936117 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590772d-a40b-4206-8741-3a1298e96898 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:57.936415 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590772d-a40b-4206-8741-3a1298e96898 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:57.936700 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590772d-a40b-4206-8741-3a1298e96898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:57.955708 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-0590772d-a40b-4206-8741-3a1298e96898 None None] MFA Rules not processed for user `8ac15411c75f4bd4a86f6753c9240a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:57.957224 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-0590772d-a40b-4206-8741-3a1298e96898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:57.957752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69772a64-f53b-4820-88b3-a8846fa21d07 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:58.015486 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2265b-3c42-4a5a-b081-b9fb59256cf6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:58.016196 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2265b-3c42-4a5a-b081-b9fb59256cf6 service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:58.016494 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2265b-3c42-4a5a-b081-b9fb59256cf6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:58.016830 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2265b-3c42-4a5a-b081-b9fb59256cf6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:58.054397 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 968/1919] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Jul 11 21:06:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:58.055490 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590772d-a40b-4206-8741-3a1298e96898 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:58.129967 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2265b-3c42-4a5a-b081-b9fb59256cf6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:58.136212 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2265b-3c42-4a5a-b081-b9fb59256cf6 service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:58.148365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 952/1920] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:57 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 21:06:58.210522 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590772d-a40b-4206-8741-3a1298e96898 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:58.219483 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f67655-c7a5-417d-87d2-df823d090695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:58.220783 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f67655-c7a5-417d-87d2-df823d090695 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:58.221987 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f67655-c7a5-417d-87d2-df823d090695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:58.226249 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f67655-c7a5-417d-87d2-df823d090695 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:58.226249 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f67655-c7a5-417d-87d2-df823d090695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:58.226249 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f67655-c7a5-417d-87d2-df823d090695 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:58.244819 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 969/1921] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:06:58 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:06:58.249698 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2265b-3c42-4a5a-b081-b9fb59256cf6 service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:58.261215 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2265b-3c42-4a5a-b081-b9fb59256cf6 service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:58.273363 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24946f07-65b6-4790-b931-7f6fc5bd7884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:58.274539 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24946f07-65b6-4790-b931-7f6fc5bd7884 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:58.275010 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24946f07-65b6-4790-b931-7f6fc5bd7884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:58.275511 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24946f07-65b6-4790-b931-7f6fc5bd7884 admin admin] PATH_INFO: `/v3/projects/0aabd476e2c04913969779add8214fea/users/537f4f908c1d465da68db0c34d79c5f9/roles/86273ff072f3438d822e870272491768` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:58.279100 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24946f07-65b6-4790-b931-7f6fc5bd7884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aabd476e2c04913969779add8214fea, user_id=537f4f908c1d465da68db0c34d79c5f9, role_id=86273ff072f3438d822e870272491768)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:58.283765 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24946f07-65b6-4790-b931-7f6fc5bd7884 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:58.300827 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 953/1922] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:06:58 2022] PUT /identity/v3/projects/0aabd476e2c04913969779add8214fea/users/537f4f908c1d465da68db0c34d79c5f9/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:06:58.312546 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e6e57-5390-4c8f-b922-ddd82898628b None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:58.312850 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e6e57-5390-4c8f-b922-ddd82898628b None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:58.313137 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e6e57-5390-4c8f-b922-ddd82898628b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:58.354201 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-aa4e6e57-5390-4c8f-b922-ddd82898628b None None] MFA Rules not processed for user `537f4f908c1d465da68db0c34d79c5f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:06:58.354400 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-aa4e6e57-5390-4c8f-b922-ddd82898628b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:58.448852 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24946f07-65b6-4790-b931-7f6fc5bd7884 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:58.456038 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-24946f07-65b6-4790-b931-7f6fc5bd7884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:58.466755 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 970/1923] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:06:58 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:06:58.492261 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:58.493616 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e6e57-5390-4c8f-b922-ddd82898628b None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:58.555851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e6e57-5390-4c8f-b922-ddd82898628b None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:58.560124 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2de74-1881-4b5e-800c-b14f18ddc8cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:58.560792 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2de74-1881-4b5e-800c-b14f18ddc8cb service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:58.561082 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2de74-1881-4b5e-800c-b14f18ddc8cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:58.561361 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2de74-1881-4b5e-800c-b14f18ddc8cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:58.568814 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24946f07-65b6-4790-b931-7f6fc5bd7884 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:58.572029 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2de74-1881-4b5e-800c-b14f18ddc8cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:58.574304 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2de74-1881-4b5e-800c-b14f18ddc8cb service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:58.575860 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb35be-ca25-48fa-9212-3dfb2cc74a7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:58.576844 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb35be-ca25-48fa-9212-3dfb2cc74a7a service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:58.577204 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb35be-ca25-48fa-9212-3dfb2cc74a7a service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:58.577555 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb35be-ca25-48fa-9212-3dfb2cc74a7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:58.585674 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 971/1924] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:58 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:06:58.587412 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb35be-ca25-48fa-9212-3dfb2cc74a7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:58.589273 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb35be-ca25-48fa-9212-3dfb2cc74a7a service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:58.600745 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 954/1925] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:06:58.912671 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:06:59.070019 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2de74-1881-4b5e-800c-b14f18ddc8cb service cinder] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:06:59.071601 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-aea2de74-1881-4b5e-800c-b14f18ddc8cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:06:59.082911 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2de74-1881-4b5e-800c-b14f18ddc8cb service cinder] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:06:59.086771 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c40713-52c3-4aa7-a25d-a2893e235b98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:06:59.087431 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c40713-52c3-4aa7-a25d-a2893e235b98 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:06:59.087724 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c40713-52c3-4aa7-a25d-a2893e235b98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:06:59.088037 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c40713-52c3-4aa7-a25d-a2893e235b98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:06:59.146438 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c40713-52c3-4aa7-a25d-a2893e235b98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:06:59.147921 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c40713-52c3-4aa7-a25d-a2893e235b98 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:06:59.157606 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 972/1926] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:06:59 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:07:00.227742 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb35be-ca25-48fa-9212-3dfb2cc74a7a service nova] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:00.238324 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb35be-ca25-48fa-9212-3dfb2cc74a7a service nova] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:00.241908 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045994a-2761-4719-abbe-efe98ee88bbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:00.242558 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045994a-2761-4719-abbe-efe98ee88bbc service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:00.242847 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045994a-2761-4719-abbe-efe98ee88bbc service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:00.243128 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045994a-2761-4719-abbe-efe98ee88bbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:00.246308 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-5045994a-2761-4719-abbe-efe98ee88bbc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:00.307268 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5045994a-2761-4719-abbe-efe98ee88bbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:00.309400 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5045994a-2761-4719-abbe-efe98ee88bbc service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:00.320986 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 955/1927] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:07:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:07:01.231213 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:01.630185 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:02.094947 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c40713-52c3-4aa7-a25d-a2893e235b98 service cinder] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:02.098540 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-29c40713-52c3-4aa7-a25d-a2893e235b98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:02.183313 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c40713-52c3-4aa7-a25d-a2893e235b98 service cinder] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:02.189304 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72061f7b-f0bb-48ab-8669-0e44b106ce81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:02.190093 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72061f7b-f0bb-48ab-8669-0e44b106ce81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:02.190431 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72061f7b-f0bb-48ab-8669-0e44b106ce81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:02.190731 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72061f7b-f0bb-48ab-8669-0e44b106ce81 admin admin] PATH_INFO: `/v3/users/5743c10258cf4abcb9894ddf2ad270f6` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:02.193084 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72061f7b-f0bb-48ab-8669-0e44b106ce81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5743c10258cf4abcb9894ddf2ad270f6)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:02.199446 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72061f7b-f0bb-48ab-8669-0e44b106ce81 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:02.454004 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-72061f7b-f0bb-48ab-8669-0e44b106ce81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5743c10258cf4abcb9894ddf2ad270f6'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:02.461198 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-72061f7b-f0bb-48ab-8669-0e44b106ce81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5743c10258cf4abcb9894ddf2ad270f6'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:02.461931 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-72061f7b-f0bb-48ab-8669-0e44b106ce81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5743c10258cf4abcb9894ddf2ad270f6'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:02.462535 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-72061f7b-f0bb-48ab-8669-0e44b106ce81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5743c10258cf4abcb9894ddf2ad270f6'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:02.567305 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-72061f7b-f0bb-48ab-8669-0e44b106ce81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5743c10258cf4abcb9894ddf2ad270f6'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:02.588575 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 973/1928] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:07:02 2022] DELETE /identity/v3/users/5743c10258cf4abcb9894ddf2ad270f6 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:02.593832 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc0106-5ed9-4445-8708-2ba95171318d None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:02.594651 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc0106-5ed9-4445-8708-2ba95171318d None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:02.595303 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc0106-5ed9-4445-8708-2ba95171318d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:02.628282 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-2adc0106-5ed9-4445-8708-2ba95171318d None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:02.630039 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-2adc0106-5ed9-4445-8708-2ba95171318d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:02.709375 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 956/1929] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:02.719595 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72061f7b-f0bb-48ab-8669-0e44b106ce81 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:02.721185 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-72061f7b-f0bb-48ab-8669-0e44b106ce81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:02.782555 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72061f7b-f0bb-48ab-8669-0e44b106ce81 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:02.786333 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc118b01-caa4-4a61-90bb-2c51ad4d5acb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:02.787029 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc118b01-caa4-4a61-90bb-2c51ad4d5acb service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:02.787320 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc118b01-caa4-4a61-90bb-2c51ad4d5acb service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:02.787607 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc118b01-caa4-4a61-90bb-2c51ad4d5acb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:02.798013 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc118b01-caa4-4a61-90bb-2c51ad4d5acb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:02.799594 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc118b01-caa4-4a61-90bb-2c51ad4d5acb service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:02.809840 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 974/1930] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:07:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:07:02.862902 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:03.262507 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc0106-5ed9-4445-8708-2ba95171318d None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:03.264111 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-2adc0106-5ed9-4445-8708-2ba95171318d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:03.286202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc0106-5ed9-4445-8708-2ba95171318d None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:03.296594 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25f2f6-b3f6-4bf7-87ac-618bb847ad76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:03.308536 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25f2f6-b3f6-4bf7-87ac-618bb847ad76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:03.308536 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25f2f6-b3f6-4bf7-87ac-618bb847ad76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:03.308536 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25f2f6-b3f6-4bf7-87ac-618bb847ad76 admin admin] PATH_INFO: `/v3/projects/5eb6b0ba5f624114bb7cd90e30090364` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:03.308536 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b25f2f6-b3f6-4bf7-87ac-618bb847ad76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eb6b0ba5f624114bb7cd90e30090364)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:03.311457 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b25f2f6-b3f6-4bf7-87ac-618bb847ad76 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:03.381293 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:03.548488 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-3b25f2f6-b3f6-4bf7-87ac-618bb847ad76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eb6b0ba5f624114bb7cd90e30090364', 'request_id': 'req-3b25f2f6-b3f6-4bf7-87ac-618bb847ad76'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:03.566624 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-3b25f2f6-b3f6-4bf7-87ac-618bb847ad76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eb6b0ba5f624114bb7cd90e30090364', 'request_id': 'req-3b25f2f6-b3f6-4bf7-87ac-618bb847ad76'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:03.583804 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-3b25f2f6-b3f6-4bf7-87ac-618bb847ad76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eb6b0ba5f624114bb7cd90e30090364', 'request_id': 'req-3b25f2f6-b3f6-4bf7-87ac-618bb847ad76'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:03.728784 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-3b25f2f6-b3f6-4bf7-87ac-618bb847ad76 admin admin] The token cache is being invalidate because project 5eb6b0ba5f624114bb7cd90e30090364 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:07:03.731318 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-3b25f2f6-b3f6-4bf7-87ac-618bb847ad76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:03.735609 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-3b25f2f6-b3f6-4bf7-87ac-618bb847ad76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:03.741095 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 957/1931] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:07:03 2022] DELETE /identity/v3/projects/5eb6b0ba5f624114bb7cd90e30090364 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:03.745879 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc118b01-caa4-4a61-90bb-2c51ad4d5acb service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:03.761133 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc118b01-caa4-4a61-90bb-2c51ad4d5acb service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:03.858004 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5deed41-de13-410b-9774-775c38987525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:03.858960 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5deed41-de13-410b-9774-775c38987525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:03.859249 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5deed41-de13-410b-9774-775c38987525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:03.859949 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5deed41-de13-410b-9774-775c38987525 admin admin] PATH_INFO: `/v3/users/7f228d81e8944a80a44b0461d78033b7` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:03.860946 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5deed41-de13-410b-9774-775c38987525 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f228d81e8944a80a44b0461d78033b7)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:03.871594 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5deed41-de13-410b-9774-775c38987525 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:04.168591 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-d5deed41-de13-410b-9774-775c38987525 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f228d81e8944a80a44b0461d78033b7'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:04.177544 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-d5deed41-de13-410b-9774-775c38987525 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f228d81e8944a80a44b0461d78033b7'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:04.178742 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-d5deed41-de13-410b-9774-775c38987525 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f228d81e8944a80a44b0461d78033b7'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:04.179174 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-d5deed41-de13-410b-9774-775c38987525 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f228d81e8944a80a44b0461d78033b7'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:04.276542 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-d5deed41-de13-410b-9774-775c38987525 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f228d81e8944a80a44b0461d78033b7'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:04.282202 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:04.316936 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 975/1932] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:07:03 2022] DELETE /identity/v3/users/7f228d81e8944a80a44b0461d78033b7 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:04.665123 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:04.803415 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25f2f6-b3f6-4bf7-87ac-618bb847ad76 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:04.805084 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-3b25f2f6-b3f6-4bf7-87ac-618bb847ad76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:04.827232 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25f2f6-b3f6-4bf7-87ac-618bb847ad76 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:04.923835 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8d2b6-f038-4a39-b981-ebbd15167e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:04.923955 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8d2b6-f038-4a39-b981-ebbd15167e75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:04.924345 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8d2b6-f038-4a39-b981-ebbd15167e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:04.924578 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8d2b6-f038-4a39-b981-ebbd15167e75 admin admin] PATH_INFO: `/v3/projects/9376eba7cded49319a9c8c337db327b9` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:04.926564 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8d2b6-f038-4a39-b981-ebbd15167e75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9376eba7cded49319a9c8c337db327b9)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:04.929951 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8d2b6-f038-4a39-b981-ebbd15167e75 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:05.064591 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:05.095468 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-4fb8d2b6-f038-4a39-b981-ebbd15167e75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9376eba7cded49319a9c8c337db327b9', 'request_id': 'req-4fb8d2b6-f038-4a39-b981-ebbd15167e75'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:05.107882 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-4fb8d2b6-f038-4a39-b981-ebbd15167e75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9376eba7cded49319a9c8c337db327b9', 'request_id': 'req-4fb8d2b6-f038-4a39-b981-ebbd15167e75'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:05.118197 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-4fb8d2b6-f038-4a39-b981-ebbd15167e75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9376eba7cded49319a9c8c337db327b9', 'request_id': 'req-4fb8d2b6-f038-4a39-b981-ebbd15167e75'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:05.253724 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-4fb8d2b6-f038-4a39-b981-ebbd15167e75 admin admin] The token cache is being invalidate because project 9376eba7cded49319a9c8c337db327b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:07:05.256550 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-4fb8d2b6-f038-4a39-b981-ebbd15167e75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:05.256550 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-4fb8d2b6-f038-4a39-b981-ebbd15167e75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:05.266607 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 958/1933] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:07:04 2022] DELETE /identity/v3/projects/9376eba7cded49319a9c8c337db327b9 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:05.267339 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f49e0-1163-45df-b4d2-5c16cbf39586 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:05.267641 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f49e0-1163-45df-b4d2-5c16cbf39586 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:05.267929 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f49e0-1163-45df-b4d2-5c16cbf39586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:05.290257 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-352f49e0-1163-45df-b4d2-5c16cbf39586 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:05.291483 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-352f49e0-1163-45df-b4d2-5c16cbf39586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:05.394251 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 976/1934] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:07:05.403117 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db3fd7-e106-4a70-a693-ab08385ada22 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:05.403419 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db3fd7-e106-4a70-a693-ab08385ada22 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:05.403705 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db3fd7-e106-4a70-a693-ab08385ada22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:05.423734 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-e1db3fd7-e106-4a70-a693-ab08385ada22 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:05.424994 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-e1db3fd7-e106-4a70-a693-ab08385ada22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:05.435239 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 959/1935] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:05.439828 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352f49e0-1163-45df-b4d2-5c16cbf39586 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:05.449805 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352f49e0-1163-45df-b4d2-5c16cbf39586 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:05.456586 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d35f9-3273-4d45-84bd-a9ad32b967af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:05.457274 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d35f9-3273-4d45-84bd-a9ad32b967af admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:05.463291 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d35f9-3273-4d45-84bd-a9ad32b967af admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:05.463291 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d35f9-3273-4d45-84bd-a9ad32b967af admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:05.463291 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d35f9-3273-4d45-84bd-a9ad32b967af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:07:05.463291 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d35f9-3273-4d45-84bd-a9ad32b967af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:05.463291 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d35f9-3273-4d45-84bd-a9ad32b967af admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:05.474086 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 977/1936] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:07:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 21:07:05.478809 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db3fd7-e106-4a70-a693-ab08385ada22 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:05.489834 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db3fd7-e106-4a70-a693-ab08385ada22 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:05.497696 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dd1fce-1da6-4c0f-ae92-08262f0f79a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:05.498374 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd1fce-1da6-4c0f-ae92-08262f0f79a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:05.498855 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd1fce-1da6-4c0f-ae92-08262f0f79a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:05.499318 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd1fce-1da6-4c0f-ae92-08262f0f79a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:05.500057 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dd1fce-1da6-4c0f-ae92-08262f0f79a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:05.501996 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dd1fce-1da6-4c0f-ae92-08262f0f79a4 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:06.101318 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 960/1937] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:07:05 2022] POST /identity/v3/projects => generated 401 bytes in 611 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:07:06.102543 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d35f9-3273-4d45-84bd-a9ad32b967af admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:06.114190 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d35f9-3273-4d45-84bd-a9ad32b967af admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:06.184861 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e5da0f-6d11-4d3d-9ee2-4f67dad7a576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:06.185545 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5da0f-6d11-4d3d-9ee2-4f67dad7a576 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:06.185830 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5da0f-6d11-4d3d-9ee2-4f67dad7a576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:06.186105 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5da0f-6d11-4d3d-9ee2-4f67dad7a576 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:06.186803 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e5da0f-6d11-4d3d-9ee2-4f67dad7a576 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:06.188844 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e5da0f-6d11-4d3d-9ee2-4f67dad7a576 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:06.231486 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dd1fce-1da6-4c0f-ae92-08262f0f79a4 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:06.231821 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-29dd1fce-1da6-4c0f-ae92-08262f0f79a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:06.291123 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dd1fce-1da6-4c0f-ae92-08262f0f79a4 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:06.295837 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d5033-76e9-4970-8600-485b56e1a04f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:06.300313 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d5033-76e9-4970-8600-485b56e1a04f service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:06.300313 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d5033-76e9-4970-8600-485b56e1a04f service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:06.300313 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d5033-76e9-4970-8600-485b56e1a04f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:06.300313 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c31d5033-76e9-4970-8600-485b56e1a04f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:06.321806 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 978/1938] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:07:06 2022] POST /identity/v3/users => generated 301 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:07:06.326133 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e5da0f-6d11-4d3d-9ee2-4f67dad7a576 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:06.335642 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e5da0f-6d11-4d3d-9ee2-4f67dad7a576 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:06.340902 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067158c-b32e-4169-835c-523d11ab80b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:06.343087 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067158c-b32e-4169-835c-523d11ab80b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:06.343087 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067158c-b32e-4169-835c-523d11ab80b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:06.343087 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067158c-b32e-4169-835c-523d11ab80b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:06.343087 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e067158c-b32e-4169-835c-523d11ab80b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:06.344827 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e067158c-b32e-4169-835c-523d11ab80b6 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:06.355873 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 979/1939] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 21:07:06.360223 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067158c-b32e-4169-835c-523d11ab80b6 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:06.365055 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d5033-76e9-4970-8600-485b56e1a04f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:06.366707 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d5033-76e9-4970-8600-485b56e1a04f service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:06.371276 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067158c-b32e-4169-835c-523d11ab80b6 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:06.376282 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2c5dd-458e-402c-b122-d5508f4a668b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:06.377164 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2c5dd-458e-402c-b122-d5508f4a668b admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:06.377460 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2c5dd-458e-402c-b122-d5508f4a668b admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:06.377743 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2c5dd-458e-402c-b122-d5508f4a668b admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:06.378123 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 961/1940] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:07:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 21:07:06.378477 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa2c5dd-458e-402c-b122-d5508f4a668b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:06.380129 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa2c5dd-458e-402c-b122-d5508f4a668b admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:06.393940 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 980/1941] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:07:06.397857 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d5033-76e9-4970-8600-485b56e1a04f service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:06.415621 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d5033-76e9-4970-8600-485b56e1a04f service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:06.431411 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f43023-8490-439a-a0ad-5a53a59833b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:06.433483 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f43023-8490-439a-a0ad-5a53a59833b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:06.433971 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f43023-8490-439a-a0ad-5a53a59833b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:06.434362 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f43023-8490-439a-a0ad-5a53a59833b9 admin admin] PATH_INFO: `/v3/projects/ebcae18725df4340a951e7a0b366c031/users/f53807da5b1b401699df6ec0c2120c8a/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:06.464457 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f43023-8490-439a-a0ad-5a53a59833b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebcae18725df4340a951e7a0b366c031, user_id=f53807da5b1b401699df6ec0c2120c8a, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:06.467204 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f43023-8490-439a-a0ad-5a53a59833b9 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:06.529281 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 962/1942] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:07:06 2022] PUT /identity/v3/projects/ebcae18725df4340a951e7a0b366c031/users/f53807da5b1b401699df6ec0c2120c8a/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:06.539516 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c30eb1-7e95-4bff-a70c-73f8de7d4bff None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:06.539817 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c30eb1-7e95-4bff-a70c-73f8de7d4bff None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:06.540138 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c30eb1-7e95-4bff-a70c-73f8de7d4bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:06.569631 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-73c30eb1-7e95-4bff-a70c-73f8de7d4bff None None] MFA Rules not processed for user `f53807da5b1b401699df6ec0c2120c8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:06.570815 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-73c30eb1-7e95-4bff-a70c-73f8de7d4bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:06.670852 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 981/1943] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:06.675186 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f43023-8490-439a-a0ad-5a53a59833b9 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:06.752711 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f43023-8490-439a-a0ad-5a53a59833b9 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:06.757529 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0eb29-b99b-47a4-9ef1-b94faf051a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:06.758402 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0eb29-b99b-47a4-9ef1-b94faf051a6a admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:06.758651 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0eb29-b99b-47a4-9ef1-b94faf051a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:06.758827 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0eb29-b99b-47a4-9ef1-b94faf051a6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:06.759523 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0eb29-b99b-47a4-9ef1-b94faf051a6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:06.762242 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0eb29-b99b-47a4-9ef1-b94faf051a6a admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:06.920902 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 963/1944] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:07:06 2022] POST /identity/v3/projects => generated 399 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 21:07:06.921992 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c30eb1-7e95-4bff-a70c-73f8de7d4bff None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:06.934782 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c30eb1-7e95-4bff-a70c-73f8de7d4bff None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:06.992862 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a1adf-fdd6-4826-98a9-9490309b8ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:06.993641 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a1adf-fdd6-4826-98a9-9490309b8ab6 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:06.993998 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a1adf-fdd6-4826-98a9-9490309b8ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:06.994350 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a1adf-fdd6-4826-98a9-9490309b8ab6 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:06.995679 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a1adf-fdd6-4826-98a9-9490309b8ab6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:06.997674 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a1adf-fdd6-4826-98a9-9490309b8ab6 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:07.100398 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 982/1945] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:07:06 2022] POST /identity/v3/users => generated 306 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 21:07:07.101687 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0eb29-b99b-47a4-9ef1-b94faf051a6a admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:07.113759 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0eb29-b99b-47a4-9ef1-b94faf051a6a admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:07.119246 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92874201-de1b-4e30-a2ab-55b7345b314c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:07.120670 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92874201-de1b-4e30-a2ab-55b7345b314c admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:07.121091 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92874201-de1b-4e30-a2ab-55b7345b314c admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:07.121467 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92874201-de1b-4e30-a2ab-55b7345b314c admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:07.122304 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92874201-de1b-4e30-a2ab-55b7345b314c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:07.124248 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92874201-de1b-4e30-a2ab-55b7345b314c admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:07.136470 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 964/1946] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:07:07.140092 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a1adf-fdd6-4826-98a9-9490309b8ab6 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:07.150965 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a1adf-fdd6-4826-98a9-9490309b8ab6 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:07.156165 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde31cf-92cf-4a29-a9b4-090023897a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:07.157058 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde31cf-92cf-4a29-a9b4-090023897a23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:07.157346 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde31cf-92cf-4a29-a9b4-090023897a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:07.157654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde31cf-92cf-4a29-a9b4-090023897a23 admin admin] PATH_INFO: `/v3/projects/f2117df65c374bc99b069d519bb0b6e8/users/d916c3a046e1405fb4fb4c17e29208b2/roles/86273ff072f3438d822e870272491768` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:07.173818 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde31cf-92cf-4a29-a9b4-090023897a23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2117df65c374bc99b069d519bb0b6e8, user_id=d916c3a046e1405fb4fb4c17e29208b2, role_id=86273ff072f3438d822e870272491768)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:07.176552 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde31cf-92cf-4a29-a9b4-090023897a23 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:07.260227 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 983/1947] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:07:07 2022] PUT /identity/v3/projects/f2117df65c374bc99b069d519bb0b6e8/users/d916c3a046e1405fb4fb4c17e29208b2/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:07.264430 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92874201-de1b-4e30-a2ab-55b7345b314c admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:07.275364 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92874201-de1b-4e30-a2ab-55b7345b314c admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:07.336326 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811dddda-c488-467b-a43b-a25f0efe48bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:07.337007 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811dddda-c488-467b-a43b-a25f0efe48bc admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:07.337297 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811dddda-c488-467b-a43b-a25f0efe48bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:07.337580 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811dddda-c488-467b-a43b-a25f0efe48bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:07.338309 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811dddda-c488-467b-a43b-a25f0efe48bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:07.340511 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811dddda-c488-467b-a43b-a25f0efe48bc admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:07.353567 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 965/1948] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:07:07.355753 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde31cf-92cf-4a29-a9b4-090023897a23 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:07.366431 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde31cf-92cf-4a29-a9b4-090023897a23 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:07.371486 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a604f7-fbac-43df-bbb6-a956c0e1c16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:07.372446 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a604f7-fbac-43df-bbb6-a956c0e1c16a admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:07.372734 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a604f7-fbac-43df-bbb6-a956c0e1c16a admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:07.373013 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a604f7-fbac-43df-bbb6-a956c0e1c16a admin admin] PATH_INFO: `/v3/projects/f2117df65c374bc99b069d519bb0b6e8/users/d916c3a046e1405fb4fb4c17e29208b2/roles/86273ff072f3438d822e870272491768` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:07.375036 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a604f7-fbac-43df-bbb6-a956c0e1c16a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2117df65c374bc99b069d519bb0b6e8, user_id=d916c3a046e1405fb4fb4c17e29208b2, role_id=86273ff072f3438d822e870272491768)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:07.378518 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a604f7-fbac-43df-bbb6-a956c0e1c16a admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:07.389455 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 984/1949] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:07:07 2022] PUT /identity/v3/projects/f2117df65c374bc99b069d519bb0b6e8/users/d916c3a046e1405fb4fb4c17e29208b2/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:07.401000 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0789d9-a6aa-4fc1-a429-8c64f692c1c7 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:07.401899 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0789d9-a6aa-4fc1-a429-8c64f692c1c7 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:07.402157 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0789d9-a6aa-4fc1-a429-8c64f692c1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:07.433254 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-7d0789d9-a6aa-4fc1-a429-8c64f692c1c7 None None] MFA Rules not processed for user `d916c3a046e1405fb4fb4c17e29208b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:07.434731 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-7d0789d9-a6aa-4fc1-a429-8c64f692c1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:07.526591 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 966/1950] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:07 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:07.621575 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a604f7-fbac-43df-bbb6-a956c0e1c16a admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:07.623400 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-29a604f7-fbac-43df-bbb6-a956c0e1c16a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:07.656108 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:07.707104 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a604f7-fbac-43df-bbb6-a956c0e1c16a admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:07.711783 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d25af-a1ad-40bc-8999-239131b3dab3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:07.712759 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d25af-a1ad-40bc-8999-239131b3dab3 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:07.713292 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d25af-a1ad-40bc-8999-239131b3dab3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:07.713924 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d25af-a1ad-40bc-8999-239131b3dab3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:07.728181 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d25af-a1ad-40bc-8999-239131b3dab3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:07.731122 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d25af-a1ad-40bc-8999-239131b3dab3 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:07.741170 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 985/1951] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:07:07 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:07:07.872917 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0789d9-a6aa-4fc1-a429-8c64f692c1c7 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:07.874547 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-7d0789d9-a6aa-4fc1-a429-8c64f692c1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:07.937483 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:07.963058 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0789d9-a6aa-4fc1-a429-8c64f692c1c7 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:07.982735 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c29c1-2650-4c57-8804-2ca388629238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:07.983691 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c29c1-2650-4c57-8804-2ca388629238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:07.984016 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c29c1-2650-4c57-8804-2ca388629238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:07.984288 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c29c1-2650-4c57-8804-2ca388629238 admin admin] PATH_INFO: `/v3/users/0180f6c804fe4098a375723ee66e905b` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:07.986893 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c29c1-2650-4c57-8804-2ca388629238 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0180f6c804fe4098a375723ee66e905b)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:07.991336 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c29c1-2650-4c57-8804-2ca388629238 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:08.144185 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d25af-a1ad-40bc-8999-239131b3dab3 service cinder] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:08.157119 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d25af-a1ad-40bc-8999-239131b3dab3 service cinder] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:08.161663 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe00ba-f842-4114-90b5-700d3e11d816 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:08.163548 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe00ba-f842-4114-90b5-700d3e11d816 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:08.164133 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe00ba-f842-4114-90b5-700d3e11d816 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:08.164591 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe00ba-f842-4114-90b5-700d3e11d816 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:08.231249 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe00ba-f842-4114-90b5-700d3e11d816 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:08.232760 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe00ba-f842-4114-90b5-700d3e11d816 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:08.241899 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 986/1952] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:07:08 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:07:08.263407 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-478c29c1-2650-4c57-8804-2ca388629238 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0180f6c804fe4098a375723ee66e905b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:08.271669 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-478c29c1-2650-4c57-8804-2ca388629238 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0180f6c804fe4098a375723ee66e905b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:08.272978 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-478c29c1-2650-4c57-8804-2ca388629238 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0180f6c804fe4098a375723ee66e905b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:08.273925 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-478c29c1-2650-4c57-8804-2ca388629238 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0180f6c804fe4098a375723ee66e905b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:08.382539 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-478c29c1-2650-4c57-8804-2ca388629238 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0180f6c804fe4098a375723ee66e905b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:08.407350 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 967/1953] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:07:07 2022] DELETE /identity/v3/users/0180f6c804fe4098a375723ee66e905b => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:07:08.411689 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a48367-107a-4fb5-b013-cdda6db1ba48 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:08.412013 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a48367-107a-4fb5-b013-cdda6db1ba48 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:08.412334 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a48367-107a-4fb5-b013-cdda6db1ba48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:08.435485 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-f8a48367-107a-4fb5-b013-cdda6db1ba48 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:08.436693 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-f8a48367-107a-4fb5-b013-cdda6db1ba48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:08.561814 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 987/1954] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:08.562335 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c29c1-2650-4c57-8804-2ca388629238 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:08.566025 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-478c29c1-2650-4c57-8804-2ca388629238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:08.647622 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c29c1-2650-4c57-8804-2ca388629238 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:08.653354 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d326935-2d9d-426e-9cea-ae04d01ced03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:08.653354 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d326935-2d9d-426e-9cea-ae04d01ced03 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:08.654746 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d326935-2d9d-426e-9cea-ae04d01ced03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:08.655389 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d326935-2d9d-426e-9cea-ae04d01ced03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:08.670386 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d326935-2d9d-426e-9cea-ae04d01ced03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:08.672568 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d326935-2d9d-426e-9cea-ae04d01ced03 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:08.689726 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 968/1955] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:07:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:07:08.809126 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a48367-107a-4fb5-b013-cdda6db1ba48 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:08.811192 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-f8a48367-107a-4fb5-b013-cdda6db1ba48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:08.825698 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a48367-107a-4fb5-b013-cdda6db1ba48 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:08.830607 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff87f996-94db-4824-9f77-c898a73fb51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:08.831604 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87f996-94db-4824-9f77-c898a73fb51a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:08.831986 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87f996-94db-4824-9f77-c898a73fb51a admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:08.832959 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87f996-94db-4824-9f77-c898a73fb51a admin admin] PATH_INFO: `/v3/users/13cec5a040d846dab4039f43848d3ae3` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:08.834926 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff87f996-94db-4824-9f77-c898a73fb51a admin admin] RBAC: Authorizing `identity:delete_user(user_id=13cec5a040d846dab4039f43848d3ae3)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:08.837553 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff87f996-94db-4824-9f77-c898a73fb51a admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:09.087403 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ff87f996-94db-4824-9f77-c898a73fb51a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13cec5a040d846dab4039f43848d3ae3'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:09.103743 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ff87f996-94db-4824-9f77-c898a73fb51a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13cec5a040d846dab4039f43848d3ae3'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:09.106093 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ff87f996-94db-4824-9f77-c898a73fb51a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13cec5a040d846dab4039f43848d3ae3'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:09.108388 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ff87f996-94db-4824-9f77-c898a73fb51a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13cec5a040d846dab4039f43848d3ae3'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:09.195525 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ff87f996-94db-4824-9f77-c898a73fb51a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13cec5a040d846dab4039f43848d3ae3'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:09.215809 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 988/1956] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:07:08 2022] DELETE /identity/v3/users/13cec5a040d846dab4039f43848d3ae3 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:09.220266 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58900b-bab5-4650-8dfd-68baec9db60c None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:09.220565 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58900b-bab5-4650-8dfd-68baec9db60c None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:09.220854 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58900b-bab5-4650-8dfd-68baec9db60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:09.243335 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-af58900b-bab5-4650-8dfd-68baec9db60c None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:09.244683 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-af58900b-bab5-4650-8dfd-68baec9db60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:09.284677 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff87f996-94db-4824-9f77-c898a73fb51a admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:09.286377 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-ff87f996-94db-4824-9f77-c898a73fb51a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:09.346731 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 969/1957] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:09.357055 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58900b-bab5-4650-8dfd-68baec9db60c None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:09.358472 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-af58900b-bab5-4650-8dfd-68baec9db60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:09.384479 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff87f996-94db-4824-9f77-c898a73fb51a admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:09.390239 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b2968-e6c0-4ee4-ac7b-0e9282af2b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:09.391797 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b2968-e6c0-4ee4-ac7b-0e9282af2b6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:09.392174 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b2968-e6c0-4ee4-ac7b-0e9282af2b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:09.392461 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b2968-e6c0-4ee4-ac7b-0e9282af2b6a admin admin] PATH_INFO: `/v3/projects/4da8c78d8c404601a357a27413e0d648` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:09.393693 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307b2968-e6c0-4ee4-ac7b-0e9282af2b6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4da8c78d8c404601a357a27413e0d648)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:09.395895 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307b2968-e6c0-4ee4-ac7b-0e9282af2b6a admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:09.405710 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:09.442281 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58900b-bab5-4650-8dfd-68baec9db60c None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:09.446131 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117252e-c743-4536-bc97-5d738b59c101 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:09.446802 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117252e-c743-4536-bc97-5d738b59c101 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:09.447094 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117252e-c743-4536-bc97-5d738b59c101 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:09.447379 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117252e-c743-4536-bc97-5d738b59c101 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:09.461564 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b117252e-c743-4536-bc97-5d738b59c101 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:09.463253 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b117252e-c743-4536-bc97-5d738b59c101 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:09.473854 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 970/1958] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:07:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 21:07:09.556806 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-307b2968-e6c0-4ee4-ac7b-0e9282af2b6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4da8c78d8c404601a357a27413e0d648', 'request_id': 'req-307b2968-e6c0-4ee4-ac7b-0e9282af2b6a'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:09.563759 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-307b2968-e6c0-4ee4-ac7b-0e9282af2b6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4da8c78d8c404601a357a27413e0d648', 'request_id': 'req-307b2968-e6c0-4ee4-ac7b-0e9282af2b6a'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:09.569541 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-307b2968-e6c0-4ee4-ac7b-0e9282af2b6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4da8c78d8c404601a357a27413e0d648', 'request_id': 'req-307b2968-e6c0-4ee4-ac7b-0e9282af2b6a'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:09.663271 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-307b2968-e6c0-4ee4-ac7b-0e9282af2b6a admin admin] The token cache is being invalidate because project 4da8c78d8c404601a357a27413e0d648 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:07:09.664876 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-307b2968-e6c0-4ee4-ac7b-0e9282af2b6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:09.666623 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-307b2968-e6c0-4ee4-ac7b-0e9282af2b6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:09.669951 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 989/1959] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:07:09 2022] DELETE /identity/v3/projects/4da8c78d8c404601a357a27413e0d648 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:07:09.674027 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117252e-c743-4536-bc97-5d738b59c101 service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:09.687666 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117252e-c743-4536-bc97-5d738b59c101 service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:09.779057 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f06a4-ecc6-434a-8ca0-75ac00d92c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:09.780545 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f06a4-ecc6-434a-8ca0-75ac00d92c5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:09.781329 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f06a4-ecc6-434a-8ca0-75ac00d92c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:09.781329 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f06a4-ecc6-434a-8ca0-75ac00d92c5a admin admin] PATH_INFO: `/v3/users/bb5b097f092f44a78b02208878478ba3` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:09.783040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f06a4-ecc6-434a-8ca0-75ac00d92c5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb5b097f092f44a78b02208878478ba3)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:09.785264 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f06a4-ecc6-434a-8ca0-75ac00d92c5a admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:09.882018 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:09.944102 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b2968-e6c0-4ee4-ac7b-0e9282af2b6a admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:09.945623 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-307b2968-e6c0-4ee4-ac7b-0e9282af2b6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:09.961822 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b2968-e6c0-4ee4-ac7b-0e9282af2b6a admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:09.972636 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2299d1-0bad-4f41-967e-fd16cc80f570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:09.972636 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2299d1-0bad-4f41-967e-fd16cc80f570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:09.972636 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2299d1-0bad-4f41-967e-fd16cc80f570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:09.972636 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2299d1-0bad-4f41-967e-fd16cc80f570 admin admin] PATH_INFO: `/v3/projects/afd10005c9054d69bb3db78e6cde5e79` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:09.973390 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2299d1-0bad-4f41-967e-fd16cc80f570 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afd10005c9054d69bb3db78e6cde5e79)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:09.973631 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2299d1-0bad-4f41-967e-fd16cc80f570 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:10.038786 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-059f06a4-ecc6-434a-8ca0-75ac00d92c5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb5b097f092f44a78b02208878478ba3'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:10.045792 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-059f06a4-ecc6-434a-8ca0-75ac00d92c5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb5b097f092f44a78b02208878478ba3'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:10.046479 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-059f06a4-ecc6-434a-8ca0-75ac00d92c5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb5b097f092f44a78b02208878478ba3'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:10.052325 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-059f06a4-ecc6-434a-8ca0-75ac00d92c5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb5b097f092f44a78b02208878478ba3'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:10.116464 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-6a2299d1-0bad-4f41-967e-fd16cc80f570 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afd10005c9054d69bb3db78e6cde5e79', 'request_id': 'req-6a2299d1-0bad-4f41-967e-fd16cc80f570'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:10.125854 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-6a2299d1-0bad-4f41-967e-fd16cc80f570 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afd10005c9054d69bb3db78e6cde5e79', 'request_id': 'req-6a2299d1-0bad-4f41-967e-fd16cc80f570'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:10.127610 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-059f06a4-ecc6-434a-8ca0-75ac00d92c5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb5b097f092f44a78b02208878478ba3'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:10.133891 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-6a2299d1-0bad-4f41-967e-fd16cc80f570 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afd10005c9054d69bb3db78e6cde5e79', 'request_id': 'req-6a2299d1-0bad-4f41-967e-fd16cc80f570'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:10.148152 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 971/1960] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:07:09 2022] DELETE /identity/v3/users/bb5b097f092f44a78b02208878478ba3 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:10.210565 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-6a2299d1-0bad-4f41-967e-fd16cc80f570 admin admin] The token cache is being invalidate because project afd10005c9054d69bb3db78e6cde5e79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:07:10.211064 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-6a2299d1-0bad-4f41-967e-fd16cc80f570 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:10.211458 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-6a2299d1-0bad-4f41-967e-fd16cc80f570 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:10.213072 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 990/1961] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:07:09 2022] DELETE /identity/v3/projects/afd10005c9054d69bb3db78e6cde5e79 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:07:10.218028 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f06a4-ecc6-434a-8ca0-75ac00d92c5a admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:10.219671 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-059f06a4-ecc6-434a-8ca0-75ac00d92c5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:10.309970 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f06a4-ecc6-434a-8ca0-75ac00d92c5a admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:10.314771 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0223aaa-e81e-4806-b82e-8b15f2e51071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:10.318533 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0223aaa-e81e-4806-b82e-8b15f2e51071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:10.318533 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0223aaa-e81e-4806-b82e-8b15f2e51071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:10.318533 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0223aaa-e81e-4806-b82e-8b15f2e51071 admin admin] PATH_INFO: `/v3/users/537f4f908c1d465da68db0c34d79c5f9` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:10.318533 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0223aaa-e81e-4806-b82e-8b15f2e51071 admin admin] RBAC: Authorizing `identity:delete_user(user_id=537f4f908c1d465da68db0c34d79c5f9)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:10.319513 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0223aaa-e81e-4806-b82e-8b15f2e51071 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:10.531449 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b0223aaa-e81e-4806-b82e-8b15f2e51071 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '537f4f908c1d465da68db0c34d79c5f9'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:10.540360 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b0223aaa-e81e-4806-b82e-8b15f2e51071 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '537f4f908c1d465da68db0c34d79c5f9'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:10.541088 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b0223aaa-e81e-4806-b82e-8b15f2e51071 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '537f4f908c1d465da68db0c34d79c5f9'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:10.542268 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b0223aaa-e81e-4806-b82e-8b15f2e51071 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '537f4f908c1d465da68db0c34d79c5f9'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:10.627952 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b0223aaa-e81e-4806-b82e-8b15f2e51071 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '537f4f908c1d465da68db0c34d79c5f9'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:10.635420 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2299d1-0bad-4f41-967e-fd16cc80f570 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:10.637553 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-6a2299d1-0bad-4f41-967e-fd16cc80f570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:10.673195 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 972/1962] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:07:10 2022] DELETE /identity/v3/users/537f4f908c1d465da68db0c34d79c5f9 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:10.727244 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2299d1-0bad-4f41-967e-fd16cc80f570 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:10.803217 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5cedf-ee01-4c31-b549-3f8cd3afb2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:10.804217 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5cedf-ee01-4c31-b549-3f8cd3afb2f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:10.804510 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5cedf-ee01-4c31-b549-3f8cd3afb2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:10.804797 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5cedf-ee01-4c31-b549-3f8cd3afb2f2 admin admin] PATH_INFO: `/v3/projects/17b09d4b24934618981cf1608d942ef1` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:10.806066 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5cedf-ee01-4c31-b549-3f8cd3afb2f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17b09d4b24934618981cf1608d942ef1)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:10.809324 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5cedf-ee01-4c31-b549-3f8cd3afb2f2 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:11.468791 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-d4a5cedf-ee01-4c31-b549-3f8cd3afb2f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17b09d4b24934618981cf1608d942ef1', 'request_id': 'req-d4a5cedf-ee01-4c31-b549-3f8cd3afb2f2'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:11.475360 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-d4a5cedf-ee01-4c31-b549-3f8cd3afb2f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17b09d4b24934618981cf1608d942ef1', 'request_id': 'req-d4a5cedf-ee01-4c31-b549-3f8cd3afb2f2'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:11.515909 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-d4a5cedf-ee01-4c31-b549-3f8cd3afb2f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17b09d4b24934618981cf1608d942ef1', 'request_id': 'req-d4a5cedf-ee01-4c31-b549-3f8cd3afb2f2'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:11.835551 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:11.876300 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0223aaa-e81e-4806-b82e-8b15f2e51071 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:11.880427 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b0223aaa-e81e-4806-b82e-8b15f2e51071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:11.883828 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-d4a5cedf-ee01-4c31-b549-3f8cd3afb2f2 admin admin] The token cache is being invalidate because project 17b09d4b24934618981cf1608d942ef1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:07:11.886028 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-d4a5cedf-ee01-4c31-b549-3f8cd3afb2f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:11.888167 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-d4a5cedf-ee01-4c31-b549-3f8cd3afb2f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:11.897686 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0223aaa-e81e-4806-b82e-8b15f2e51071 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:11.900639 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 991/1963] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:07:10 2022] DELETE /identity/v3/projects/17b09d4b24934618981cf1608d942ef1 => generated 0 bytes in 1266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:07:11.914001 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c0a4b-978d-4d3c-b59e-0895ddc6e8b6 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:11.914521 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c0a4b-978d-4d3c-b59e-0895ddc6e8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:11.914914 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c0a4b-978d-4d3c-b59e-0895ddc6e8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:11.941037 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-3d9c0a4b-978d-4d3c-b59e-0895ddc6e8b6 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:11.942507 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-3d9c0a4b-978d-4d3c-b59e-0895ddc6e8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:11.995262 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942838a-a494-4160-9b2b-5cb77c160031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:11.996467 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942838a-a494-4160-9b2b-5cb77c160031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:11.996762 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942838a-a494-4160-9b2b-5cb77c160031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:11.997050 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942838a-a494-4160-9b2b-5cb77c160031 admin admin] PATH_INFO: `/v3/projects/0aabd476e2c04913969779add8214fea` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:11.998392 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6942838a-a494-4160-9b2b-5cb77c160031 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0aabd476e2c04913969779add8214fea)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:12.000540 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6942838a-a494-4160-9b2b-5cb77c160031 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:12.013008 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 992/1964] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:12.021002 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607c0f3-03df-4075-842d-76d899c25166 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:12.021300 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607c0f3-03df-4075-842d-76d899c25166 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:12.021587 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607c0f3-03df-4075-842d-76d899c25166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:12.040316 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-a607c0f3-03df-4075-842d-76d899c25166 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:12.041518 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a607c0f3-03df-4075-842d-76d899c25166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:12.050104 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 993/1965] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:07:12.054125 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607c0f3-03df-4075-842d-76d899c25166 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:12.063776 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607c0f3-03df-4075-842d-76d899c25166 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:12.068342 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b71cb-1586-4b8a-8f6b-390500c74071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:12.068985 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b71cb-1586-4b8a-8f6b-390500c74071 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:12.069312 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b71cb-1586-4b8a-8f6b-390500c74071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:12.069590 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b71cb-1586-4b8a-8f6b-390500c74071 admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:12.070312 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b71cb-1586-4b8a-8f6b-390500c74071 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:07:12.070649 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b71cb-1586-4b8a-8f6b-390500c74071 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:12.072257 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b71cb-1586-4b8a-8f6b-390500c74071 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:12.084330 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 994/1966] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:07:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 21:07:12.088905 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b71cb-1586-4b8a-8f6b-390500c74071 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:12.098326 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b71cb-1586-4b8a-8f6b-390500c74071 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:12.102817 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2506dbd-3bfb-42c0-93b1-48c120d36aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:12.103441 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2506dbd-3bfb-42c0-93b1-48c120d36aae admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:12.103728 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2506dbd-3bfb-42c0-93b1-48c120d36aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:12.104041 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2506dbd-3bfb-42c0-93b1-48c120d36aae admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:12.105444 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2506dbd-3bfb-42c0-93b1-48c120d36aae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:12.107305 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2506dbd-3bfb-42c0-93b1-48c120d36aae admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:12.139685 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-6942838a-a494-4160-9b2b-5cb77c160031 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0aabd476e2c04913969779add8214fea', 'request_id': 'req-6942838a-a494-4160-9b2b-5cb77c160031'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:12.146079 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-6942838a-a494-4160-9b2b-5cb77c160031 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0aabd476e2c04913969779add8214fea', 'request_id': 'req-6942838a-a494-4160-9b2b-5cb77c160031'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:12.152406 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-6942838a-a494-4160-9b2b-5cb77c160031 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0aabd476e2c04913969779add8214fea', 'request_id': 'req-6942838a-a494-4160-9b2b-5cb77c160031'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:12.190536 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:12.203107 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 995/1967] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:07:12 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:07:12.207229 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2506dbd-3bfb-42c0-93b1-48c120d36aae admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:12.225049 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-6942838a-a494-4160-9b2b-5cb77c160031 admin admin] The token cache is being invalidate because project 0aabd476e2c04913969779add8214fea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:07:12.225356 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-6942838a-a494-4160-9b2b-5cb77c160031 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:12.226026 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-6942838a-a494-4160-9b2b-5cb77c160031 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:12.227756 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 973/1968] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:07:11 2022] DELETE /identity/v3/projects/0aabd476e2c04913969779add8214fea => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:12.235489 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a28e2f-c622-4afc-ab76-1d4df8ae231c None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:12.235790 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a28e2f-c622-4afc-ab76-1d4df8ae231c None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:12.236103 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a28e2f-c622-4afc-ab76-1d4df8ae231c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:12.279346 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-19a28e2f-c622-4afc-ab76-1d4df8ae231c None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:12.282253 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-19a28e2f-c622-4afc-ab76-1d4df8ae231c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:12.324813 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2506dbd-3bfb-42c0-93b1-48c120d36aae admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:12.333750 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf0d842-e967-4f00-b064-c8f8c31491e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:12.334629 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0d842-e967-4f00-b064-c8f8c31491e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:12.335075 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0d842-e967-4f00-b064-c8f8c31491e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:12.335460 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0d842-e967-4f00-b064-c8f8c31491e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:12.336512 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf0d842-e967-4f00-b064-c8f8c31491e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:12.339994 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf0d842-e967-4f00-b064-c8f8c31491e4 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:12.396964 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 974/1969] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:12.399610 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:12.412037 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628cdac4-640d-4b97-85c4-45de435f72e3 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:12.412256 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628cdac4-640d-4b97-85c4-45de435f72e3 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:12.412548 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628cdac4-640d-4b97-85c4-45de435f72e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:12.433347 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-628cdac4-640d-4b97-85c4-45de435f72e3 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:12.435459 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-628cdac4-640d-4b97-85c4-45de435f72e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:12.444012 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 975/1970] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:07:12.447840 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628cdac4-640d-4b97-85c4-45de435f72e3 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:12.457923 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628cdac4-640d-4b97-85c4-45de435f72e3 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:12.462800 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3418fe-6324-4fac-a44a-de6d760ee399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:12.463581 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3418fe-6324-4fac-a44a-de6d760ee399 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:12.463993 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3418fe-6324-4fac-a44a-de6d760ee399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:12.464385 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3418fe-6324-4fac-a44a-de6d760ee399 admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:12.467514 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 996/1971] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:07:12 2022] POST /identity/v3/users => generated 287 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:07:12.467643 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3418fe-6324-4fac-a44a-de6d760ee399 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:07:12.467643 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3418fe-6324-4fac-a44a-de6d760ee399 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:12.467643 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3418fe-6324-4fac-a44a-de6d760ee399 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:12.469208 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf0d842-e967-4f00-b064-c8f8c31491e4 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:12.474427 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-4bf0d842-e967-4f00-b064-c8f8c31491e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:12.492443 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 976/1972] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:07:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 21:07:12.497792 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3418fe-6324-4fac-a44a-de6d760ee399 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:12.499307 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf0d842-e967-4f00-b064-c8f8c31491e4 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:12.504013 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7eabd2-e4fa-4106-a5ef-c6937c45f4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:12.505042 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7eabd2-e4fa-4106-a5ef-c6937c45f4ad admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:12.505329 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7eabd2-e4fa-4106-a5ef-c6937c45f4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:12.506006 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7eabd2-e4fa-4106-a5ef-c6937c45f4ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:12.506375 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7eabd2-e4fa-4106-a5ef-c6937c45f4ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:12.508291 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7eabd2-e4fa-4106-a5ef-c6937c45f4ad admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:12.509334 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3418fe-6324-4fac-a44a-de6d760ee399 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:12.514912 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a03a88-3cb8-4687-b743-144e7fb74abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:12.515840 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a03a88-3cb8-4687-b743-144e7fb74abc admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:12.521217 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a03a88-3cb8-4687-b743-144e7fb74abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:12.521217 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a03a88-3cb8-4687-b743-144e7fb74abc admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:12.521217 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a03a88-3cb8-4687-b743-144e7fb74abc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:12.521217 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a03a88-3cb8-4687-b743-144e7fb74abc admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:12.521711 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 997/1973] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 21:07:12.523818 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7eabd2-e4fa-4106-a5ef-c6937c45f4ad admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:12.536634 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7eabd2-e4fa-4106-a5ef-c6937c45f4ad admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:12.547064 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06681b7-f5b8-4ded-a3b8-5cadab9ca68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:12.547736 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06681b7-f5b8-4ded-a3b8-5cadab9ca68f admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:12.548053 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06681b7-f5b8-4ded-a3b8-5cadab9ca68f admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:12.548339 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06681b7-f5b8-4ded-a3b8-5cadab9ca68f admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:12.549067 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06681b7-f5b8-4ded-a3b8-5cadab9ca68f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:12.550701 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06681b7-f5b8-4ded-a3b8-5cadab9ca68f admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:12.573819 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 998/1974] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 21:07:12.575674 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06681b7-f5b8-4ded-a3b8-5cadab9ca68f admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:12.585575 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06681b7-f5b8-4ded-a3b8-5cadab9ca68f admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:12.590502 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234a85d-9049-4eef-9422-106cbbcbd258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:12.591430 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234a85d-9049-4eef-9422-106cbbcbd258 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:12.591712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234a85d-9049-4eef-9422-106cbbcbd258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:12.592011 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234a85d-9049-4eef-9422-106cbbcbd258 admin admin] PATH_INFO: `/v3/projects/2a780c27c9a74c77b6376db9adc49391/users/3e1a33fb79a54771996c20bce5d1a7f7/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:12.607115 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234a85d-9049-4eef-9422-106cbbcbd258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a780c27c9a74c77b6376db9adc49391, user_id=3e1a33fb79a54771996c20bce5d1a7f7, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:12.609895 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 977/1975] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:07:12 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:07:12.610008 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234a85d-9049-4eef-9422-106cbbcbd258 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:12.612756 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a03a88-3cb8-4687-b743-144e7fb74abc admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:12.679579 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 999/1976] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:07:12 2022] PUT /identity/v3/projects/2a780c27c9a74c77b6376db9adc49391/users/3e1a33fb79a54771996c20bce5d1a7f7/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:12.680895 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a03a88-3cb8-4687-b743-144e7fb74abc admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:12.690553 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd2cd4-4835-4aca-9252-c7e8946b2a85 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:12.690832 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd2cd4-4835-4aca-9252-c7e8946b2a85 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:12.691111 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd2cd4-4835-4aca-9252-c7e8946b2a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:12.726348 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-9cdd2cd4-4835-4aca-9252-c7e8946b2a85 None None] MFA Rules not processed for user `3e1a33fb79a54771996c20bce5d1a7f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:12.727566 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-9cdd2cd4-4835-4aca-9252-c7e8946b2a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:12.749528 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b2b77-32f2-4f4d-aeb7-78cc3a074be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:12.750217 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b2b77-32f2-4f4d-aeb7-78cc3a074be1 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:12.750505 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b2b77-32f2-4f4d-aeb7-78cc3a074be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:12.750789 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b2b77-32f2-4f4d-aeb7-78cc3a074be1 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:12.751477 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b2b77-32f2-4f4d-aeb7-78cc3a074be1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:12.753440 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b2b77-32f2-4f4d-aeb7-78cc3a074be1 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:12.794629 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1000/1977] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:07:12.805920 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd2cd4-4835-4aca-9252-c7e8946b2a85 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:12.807310 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-9cdd2cd4-4835-4aca-9252-c7e8946b2a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:12.877295 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd2cd4-4835-4aca-9252-c7e8946b2a85 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:12.881340 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26459837-9c25-42fb-b341-e7a1057b6f72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:12.882008 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26459837-9c25-42fb-b341-e7a1057b6f72 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:12.882307 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26459837-9c25-42fb-b341-e7a1057b6f72 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:12.882575 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26459837-9c25-42fb-b341-e7a1057b6f72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:12.884595 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 978/1978] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:07:12 2022] POST /identity/v3/users => generated 293 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 21:07:12.888553 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b2b77-32f2-4f4d-aeb7-78cc3a074be1 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:12.906683 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26459837-9c25-42fb-b341-e7a1057b6f72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:12.908955 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26459837-9c25-42fb-b341-e7a1057b6f72 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:12.914201 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b2b77-32f2-4f4d-aeb7-78cc3a074be1 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:12.922945 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c6f33-b039-4472-946f-10ab7980bda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:12.923843 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c6f33-b039-4472-946f-10ab7980bda1 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:12.924281 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c6f33-b039-4472-946f-10ab7980bda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:12.925192 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c6f33-b039-4472-946f-10ab7980bda1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:12.925736 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9c6f33-b039-4472-946f-10ab7980bda1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:12.927579 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9c6f33-b039-4472-946f-10ab7980bda1 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:12.928836 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1001/1979] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:07:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 21:07:12.929883 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26459837-9c25-42fb-b341-e7a1057b6f72 service cinder] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:12.931825 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-26459837-9c25-42fb-b341-e7a1057b6f72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:12.941789 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 979/1980] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:07:12.946458 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c6f33-b039-4472-946f-10ab7980bda1 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:12.955882 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26459837-9c25-42fb-b341-e7a1057b6f72 service cinder] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:12.959429 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c6f33-b039-4472-946f-10ab7980bda1 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:12.965442 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f255c-e7ed-4084-81d7-a42c4d63cec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:12.971230 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f255c-e7ed-4084-81d7-a42c4d63cec9 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:12.971230 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f255c-e7ed-4084-81d7-a42c4d63cec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:12.971230 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f255c-e7ed-4084-81d7-a42c4d63cec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:12.971230 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f255c-e7ed-4084-81d7-a42c4d63cec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:12.971739 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e93377-5cf1-429b-bd46-cc473b6d7188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:12.971861 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f255c-e7ed-4084-81d7-a42c4d63cec9 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:12.971948 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e93377-5cf1-429b-bd46-cc473b6d7188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:12.971948 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e93377-5cf1-429b-bd46-cc473b6d7188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:12.971948 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e93377-5cf1-429b-bd46-cc473b6d7188 admin admin] PATH_INFO: `/v3/users/828b9a6efaf847d98b02d155d59bfba1` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:12.972684 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e93377-5cf1-429b-bd46-cc473b6d7188 admin admin] RBAC: Authorizing `identity:delete_user(user_id=828b9a6efaf847d98b02d155d59bfba1)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:12.974382 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e93377-5cf1-429b-bd46-cc473b6d7188 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:12.986245 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 980/1981] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:07:12.990232 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f255c-e7ed-4084-81d7-a42c4d63cec9 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:13.001780 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f255c-e7ed-4084-81d7-a42c4d63cec9 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:13.006438 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1cb10c-8739-4bb8-9b71-2f7a7051cea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:13.007316 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cb10c-8739-4bb8-9b71-2f7a7051cea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:13.007636 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cb10c-8739-4bb8-9b71-2f7a7051cea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:13.008003 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cb10c-8739-4bb8-9b71-2f7a7051cea1 admin admin] PATH_INFO: `/v3/users/3e1a33fb79a54771996c20bce5d1a7f7` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:13.009213 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1cb10c-8739-4bb8-9b71-2f7a7051cea1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e1a33fb79a54771996c20bce5d1a7f7)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:13.011266 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1cb10c-8739-4bb8-9b71-2f7a7051cea1 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:13.199455 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-ec1cb10c-8739-4bb8-9b71-2f7a7051cea1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e1a33fb79a54771996c20bce5d1a7f7'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:13.201322 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a9e93377-5cf1-429b-bd46-cc473b6d7188 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '828b9a6efaf847d98b02d155d59bfba1'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:13.208181 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-ec1cb10c-8739-4bb8-9b71-2f7a7051cea1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e1a33fb79a54771996c20bce5d1a7f7'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:13.208856 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a9e93377-5cf1-429b-bd46-cc473b6d7188 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '828b9a6efaf847d98b02d155d59bfba1'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:13.209057 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-ec1cb10c-8739-4bb8-9b71-2f7a7051cea1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e1a33fb79a54771996c20bce5d1a7f7'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:13.209637 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a9e93377-5cf1-429b-bd46-cc473b6d7188 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '828b9a6efaf847d98b02d155d59bfba1'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:13.209812 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-ec1cb10c-8739-4bb8-9b71-2f7a7051cea1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e1a33fb79a54771996c20bce5d1a7f7'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:13.210675 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a9e93377-5cf1-429b-bd46-cc473b6d7188 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '828b9a6efaf847d98b02d155d59bfba1'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:13.303745 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-ec1cb10c-8739-4bb8-9b71-2f7a7051cea1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e1a33fb79a54771996c20bce5d1a7f7'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:13.314184 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:13.325158 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 981/1982] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:07:12 2022] DELETE /identity/v3/users/3e1a33fb79a54771996c20bce5d1a7f7 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:13.326062 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1cb10c-8739-4bb8-9b71-2f7a7051cea1 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:13.327440 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-ec1cb10c-8739-4bb8-9b71-2f7a7051cea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:13.361397 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a9e93377-5cf1-429b-bd46-cc473b6d7188 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '828b9a6efaf847d98b02d155d59bfba1'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:13.384534 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1002/1983] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:07:12 2022] DELETE /identity/v3/users/828b9a6efaf847d98b02d155d59bfba1 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:13.386809 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2faa7a-ff9e-4548-9181-1b608b3b4f51 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:13.387291 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2faa7a-ff9e-4548-9181-1b608b3b4f51 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:13.387726 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2faa7a-ff9e-4548-9181-1b608b3b4f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:13.395871 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1cb10c-8739-4bb8-9b71-2f7a7051cea1 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:13.406854 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-bd2faa7a-ff9e-4548-9181-1b608b3b4f51 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:13.408109 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-bd2faa7a-ff9e-4548-9181-1b608b3b4f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:13.460663 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab037feb-623b-46cf-b2bd-ec8bb216813a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:13.461567 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab037feb-623b-46cf-b2bd-ec8bb216813a admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:13.461904 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab037feb-623b-46cf-b2bd-ec8bb216813a admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:13.462188 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab037feb-623b-46cf-b2bd-ec8bb216813a admin admin] PATH_INFO: `/v3/projects/54d89fac5cd24cf4908d44961b8ca357/users/9c683169e3484e83b7dff7a72f113766/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:13.467794 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1003/1984] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:13.469115 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0043447-ebf3-474c-846d-93fc1c63214c None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:13.469412 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0043447-ebf3-474c-846d-93fc1c63214c None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:13.469969 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0043447-ebf3-474c-846d-93fc1c63214c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:13.477405 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab037feb-623b-46cf-b2bd-ec8bb216813a admin admin] RBAC: Authorizing `identity:create_grant(project_id=54d89fac5cd24cf4908d44961b8ca357, user_id=9c683169e3484e83b7dff7a72f113766, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:13.480177 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab037feb-623b-46cf-b2bd-ec8bb216813a admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:13.488903 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-e0043447-ebf3-474c-846d-93fc1c63214c None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:13.490200 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-e0043447-ebf3-474c-846d-93fc1c63214c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:13.504143 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1004/1985] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:13.505452 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0043447-ebf3-474c-846d-93fc1c63214c None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:13.507363 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-e0043447-ebf3-474c-846d-93fc1c63214c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:13.572736 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0043447-ebf3-474c-846d-93fc1c63214c None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:13.580864 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 982/1986] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:07:13 2022] PUT /identity/v3/projects/54d89fac5cd24cf4908d44961b8ca357/users/9c683169e3484e83b7dff7a72f113766/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:13.582289 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab037feb-623b-46cf-b2bd-ec8bb216813a admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:13.587703 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-ab037feb-623b-46cf-b2bd-ec8bb216813a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:13.632750 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf6cc1-e806-4649-b1b5-526930143173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:13.633611 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf6cc1-e806-4649-b1b5-526930143173 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:13.634007 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf6cc1-e806-4649-b1b5-526930143173 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:13.634400 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf6cc1-e806-4649-b1b5-526930143173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:13.658047 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab037feb-623b-46cf-b2bd-ec8bb216813a admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:13.677100 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08bb1d2-5542-4461-b3aa-4c7cba7b8a16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:13.677100 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08bb1d2-5542-4461-b3aa-4c7cba7b8a16 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:13.677100 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08bb1d2-5542-4461-b3aa-4c7cba7b8a16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:13.677100 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08bb1d2-5542-4461-b3aa-4c7cba7b8a16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:13.723365 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf6cc1-e806-4649-b1b5-526930143173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:13.724840 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf6cc1-e806-4649-b1b5-526930143173 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:13.735805 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1005/1987] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:07:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:07:13.737277 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260e3f6-d9d4-43be-ad68-e790dc56de9e None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:13.737579 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260e3f6-d9d4-43be-ad68-e790dc56de9e None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:13.737866 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260e3f6-d9d4-43be-ad68-e790dc56de9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:13.742122 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08bb1d2-5542-4461-b3aa-4c7cba7b8a16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:13.743735 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08bb1d2-5542-4461-b3aa-4c7cba7b8a16 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:13.755186 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 983/1988] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:07:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:07:13.756057 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08bb1d2-5542-4461-b3aa-4c7cba7b8a16 service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:13.756808 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:13.757483 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-e08bb1d2-5542-4461-b3aa-4c7cba7b8a16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:13.771658 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08bb1d2-5542-4461-b3aa-4c7cba7b8a16 service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:13.776405 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-d260e3f6-d9d4-43be-ad68-e790dc56de9e None None] MFA Rules not processed for user `9c683169e3484e83b7dff7a72f113766`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:13.777410 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a439b59-1036-4c6e-98e4-1ea3ad0f9ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:13.778046 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-d260e3f6-d9d4-43be-ad68-e790dc56de9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:13.778301 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a439b59-1036-4c6e-98e4-1ea3ad0f9ddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:13.778591 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a439b59-1036-4c6e-98e4-1ea3ad0f9ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:13.779014 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a439b59-1036-4c6e-98e4-1ea3ad0f9ddc admin admin] PATH_INFO: `/v3/users/f53807da5b1b401699df6ec0c2120c8a` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:13.780299 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a439b59-1036-4c6e-98e4-1ea3ad0f9ddc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f53807da5b1b401699df6ec0c2120c8a)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:13.784242 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a439b59-1036-4c6e-98e4-1ea3ad0f9ddc admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:13.850673 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1006/1989] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:13.855686 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260e3f6-d9d4-43be-ad68-e790dc56de9e None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:13.857067 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-d260e3f6-d9d4-43be-ad68-e790dc56de9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:13.870858 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260e3f6-d9d4-43be-ad68-e790dc56de9e None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:13.875740 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8f4de-5150-45aa-ae43-d7926b0fe372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:13.876433 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8f4de-5150-45aa-ae43-d7926b0fe372 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:13.876721 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8f4de-5150-45aa-ae43-d7926b0fe372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:13.877000 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8f4de-5150-45aa-ae43-d7926b0fe372 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:13.877693 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e8f4de-5150-45aa-ae43-d7926b0fe372 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:13.880228 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e8f4de-5150-45aa-ae43-d7926b0fe372 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:13.908168 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:13.983527 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-1a439b59-1036-4c6e-98e4-1ea3ad0f9ddc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f53807da5b1b401699df6ec0c2120c8a'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:13.991580 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-1a439b59-1036-4c6e-98e4-1ea3ad0f9ddc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f53807da5b1b401699df6ec0c2120c8a'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:13.992355 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-1a439b59-1036-4c6e-98e4-1ea3ad0f9ddc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f53807da5b1b401699df6ec0c2120c8a'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:13.992974 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-1a439b59-1036-4c6e-98e4-1ea3ad0f9ddc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f53807da5b1b401699df6ec0c2120c8a'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:14.036440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1007/1990] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:07:13 2022] POST /identity/v3/projects => generated 385 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 21:07:14.037591 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8f4de-5150-45aa-ae43-d7926b0fe372 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:14.039295 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-f5e8f4de-5150-45aa-ae43-d7926b0fe372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:14.096399 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-1a439b59-1036-4c6e-98e4-1ea3ad0f9ddc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f53807da5b1b401699df6ec0c2120c8a'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:14.105271 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8f4de-5150-45aa-ae43-d7926b0fe372 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:14.110372 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320cf14-b96e-4246-999b-623461402c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:14.111429 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320cf14-b96e-4246-999b-623461402c3f admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:14.111429 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320cf14-b96e-4246-999b-623461402c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:14.111784 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320cf14-b96e-4246-999b-623461402c3f admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:14.112590 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320cf14-b96e-4246-999b-623461402c3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:14.115184 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320cf14-b96e-4246-999b-623461402c3f admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:14.115781 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 984/1991] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:07:13 2022] DELETE /identity/v3/users/f53807da5b1b401699df6ec0c2120c8a => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:14.120922 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18138d-ba56-4b3b-9df0-ed919b76d862 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:14.121567 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18138d-ba56-4b3b-9df0-ed919b76d862 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:14.122067 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18138d-ba56-4b3b-9df0-ed919b76d862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:14.141028 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-2a18138d-ba56-4b3b-9df0-ed919b76d862 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:14.142228 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-2a18138d-ba56-4b3b-9df0-ed919b76d862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:14.205835 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 985/1992] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:14.216149 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18138d-ba56-4b3b-9df0-ed919b76d862 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:14.217961 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-2a18138d-ba56-4b3b-9df0-ed919b76d862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:14.234432 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1008/1993] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:07:14 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 21:07:14.235831 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320cf14-b96e-4246-999b-623461402c3f admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:14.248393 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320cf14-b96e-4246-999b-623461402c3f admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:14.256781 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91e774-f08a-4d5a-9745-ab0a0da1f783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:14.257483 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91e774-f08a-4d5a-9745-ab0a0da1f783 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:14.257784 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91e774-f08a-4d5a-9745-ab0a0da1f783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:14.258204 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91e774-f08a-4d5a-9745-ab0a0da1f783 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:14.258962 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91e774-f08a-4d5a-9745-ab0a0da1f783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:14.262066 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91e774-f08a-4d5a-9745-ab0a0da1f783 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:14.273455 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1009/1994] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 21:07:14.277805 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91e774-f08a-4d5a-9745-ab0a0da1f783 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:14.285559 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18138d-ba56-4b3b-9df0-ed919b76d862 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:14.287941 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91e774-f08a-4d5a-9745-ab0a0da1f783 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:14.289173 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42092ca9-8e2d-484d-8c19-ac903fd4125a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:14.289825 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42092ca9-8e2d-484d-8c19-ac903fd4125a service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:14.290112 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42092ca9-8e2d-484d-8c19-ac903fd4125a service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:14.290389 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42092ca9-8e2d-484d-8c19-ac903fd4125a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:14.294676 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aabb80-c5a5-4c01-ac58-b3964a5fdba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:14.295337 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aabb80-c5a5-4c01-ac58-b3964a5fdba0 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:14.295631 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aabb80-c5a5-4c01-ac58-b3964a5fdba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:14.295943 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aabb80-c5a5-4c01-ac58-b3964a5fdba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:14.296698 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aabb80-c5a5-4c01-ac58-b3964a5fdba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:14.298338 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aabb80-c5a5-4c01-ac58-b3964a5fdba0 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:14.301439 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42092ca9-8e2d-484d-8c19-ac903fd4125a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:14.303137 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42092ca9-8e2d-484d-8c19-ac903fd4125a service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:14.310107 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1010/1995] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 21:07:14.314246 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aabb80-c5a5-4c01-ac58-b3964a5fdba0 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:14.315613 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 986/1996] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:07:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:07:14.325826 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aabb80-c5a5-4c01-ac58-b3964a5fdba0 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:14.336360 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e399c-d592-4df2-b5d6-13f5ad3f13a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:14.336360 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e399c-d592-4df2-b5d6-13f5ad3f13a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:14.336360 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e399c-d592-4df2-b5d6-13f5ad3f13a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:14.336360 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e399c-d592-4df2-b5d6-13f5ad3f13a3 admin admin] PATH_INFO: `/v3/projects/1c3bfaf786c64a82937be5cedce4957c/users/c9cc30a6796c4f9eab871b7d5ff80ae0/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:14.337878 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42092ca9-8e2d-484d-8c19-ac903fd4125a service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:14.339282 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-42092ca9-8e2d-484d-8c19-ac903fd4125a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:14.352779 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42092ca9-8e2d-484d-8c19-ac903fd4125a service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:14.353676 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0e399c-d592-4df2-b5d6-13f5ad3f13a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c3bfaf786c64a82937be5cedce4957c, user_id=c9cc30a6796c4f9eab871b7d5ff80ae0, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:14.357438 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0e399c-d592-4df2-b5d6-13f5ad3f13a3 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:14.366269 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096169fc-0bed-4f9d-a495-54687db11ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:14.367866 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096169fc-0bed-4f9d-a495-54687db11ff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:14.368189 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096169fc-0bed-4f9d-a495-54687db11ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:14.370806 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096169fc-0bed-4f9d-a495-54687db11ff3 admin admin] PATH_INFO: `/v3/projects/2a780c27c9a74c77b6376db9adc49391` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:14.370806 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096169fc-0bed-4f9d-a495-54687db11ff3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a780c27c9a74c77b6376db9adc49391)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:14.373104 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096169fc-0bed-4f9d-a495-54687db11ff3 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:14.448482 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1011/1997] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:07:14 2022] PUT /identity/v3/projects/1c3bfaf786c64a82937be5cedce4957c/users/c9cc30a6796c4f9eab871b7d5ff80ae0/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:07:14.453519 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e399c-d592-4df2-b5d6-13f5ad3f13a3 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:14.455445 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-6f0e399c-d592-4df2-b5d6-13f5ad3f13a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:14.511804 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-096169fc-0bed-4f9d-a495-54687db11ff3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a780c27c9a74c77b6376db9adc49391', 'request_id': 'req-096169fc-0bed-4f9d-a495-54687db11ff3'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:14.520283 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-096169fc-0bed-4f9d-a495-54687db11ff3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a780c27c9a74c77b6376db9adc49391', 'request_id': 'req-096169fc-0bed-4f9d-a495-54687db11ff3'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:14.522545 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e399c-d592-4df2-b5d6-13f5ad3f13a3 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:14.529000 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-096169fc-0bed-4f9d-a495-54687db11ff3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a780c27c9a74c77b6376db9adc49391', 'request_id': 'req-096169fc-0bed-4f9d-a495-54687db11ff3'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:14.583360 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9cf358-0688-4b42-8380-c9bf91aa0288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:14.584717 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9cf358-0688-4b42-8380-c9bf91aa0288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:14.584717 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9cf358-0688-4b42-8380-c9bf91aa0288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:14.584896 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9cf358-0688-4b42-8380-c9bf91aa0288 admin admin] PATH_INFO: `/v3/projects/bfd0938d6d754f758bd2fc9b9154d556` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:14.585982 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9cf358-0688-4b42-8380-c9bf91aa0288 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfd0938d6d754f758bd2fc9b9154d556)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:14.587893 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9cf358-0688-4b42-8380-c9bf91aa0288 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:14.601854 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-096169fc-0bed-4f9d-a495-54687db11ff3 admin admin] The token cache is being invalidate because project 2a780c27c9a74c77b6376db9adc49391 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:07:14.606464 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-096169fc-0bed-4f9d-a495-54687db11ff3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:14.606464 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-096169fc-0bed-4f9d-a495-54687db11ff3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:14.606464 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 987/1998] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:07:14 2022] DELETE /identity/v3/projects/2a780c27c9a74c77b6376db9adc49391 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:07:14.607843 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d9c48-b3d3-418b-a76d-0207b8f07cab None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:14.608255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d9c48-b3d3-418b-a76d-0207b8f07cab None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:14.608642 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d9c48-b3d3-418b-a76d-0207b8f07cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:14.638433 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-eb2d9c48-b3d3-418b-a76d-0207b8f07cab None None] MFA Rules not processed for user `c9cc30a6796c4f9eab871b7d5ff80ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:14.639926 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-eb2d9c48-b3d3-418b-a76d-0207b8f07cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:14.643694 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:14.690928 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-0f9cf358-0688-4b42-8380-c9bf91aa0288 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfd0938d6d754f758bd2fc9b9154d556', 'request_id': 'req-0f9cf358-0688-4b42-8380-c9bf91aa0288'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:14.697172 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-0f9cf358-0688-4b42-8380-c9bf91aa0288 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfd0938d6d754f758bd2fc9b9154d556', 'request_id': 'req-0f9cf358-0688-4b42-8380-c9bf91aa0288'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:14.703427 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:14.704700 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-0f9cf358-0688-4b42-8380-c9bf91aa0288 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfd0938d6d754f758bd2fc9b9154d556', 'request_id': 'req-0f9cf358-0688-4b42-8380-c9bf91aa0288'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:14.721653 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 988/1999] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:14.722949 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3fdce-d8a6-4cf0-bbed-0bf627282263 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:14.723228 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3fdce-d8a6-4cf0-bbed-0bf627282263 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:14.723712 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3fdce-d8a6-4cf0-bbed-0bf627282263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:14.743204 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-eac3fdce-d8a6-4cf0-bbed-0bf627282263 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:14.744472 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-eac3fdce-d8a6-4cf0-bbed-0bf627282263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:14.778848 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-0f9cf358-0688-4b42-8380-c9bf91aa0288 admin admin] The token cache is being invalidate because project bfd0938d6d754f758bd2fc9b9154d556 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:07:14.778848 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-0f9cf358-0688-4b42-8380-c9bf91aa0288 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:14.779578 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-0f9cf358-0688-4b42-8380-c9bf91aa0288 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:14.781275 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1012/2000] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:07:14 2022] DELETE /identity/v3/projects/bfd0938d6d754f758bd2fc9b9154d556 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:14.782253 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9cf358-0688-4b42-8380-c9bf91aa0288 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:14.783848 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-0f9cf358-0688-4b42-8380-c9bf91aa0288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:14.832143 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 989/2001] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:14.832143 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3fdce-d8a6-4cf0-bbed-0bf627282263 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:14.833344 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-eac3fdce-d8a6-4cf0-bbed-0bf627282263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:14.846729 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3fdce-d8a6-4cf0-bbed-0bf627282263 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:14.851811 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadbd0d1-15ed-403e-bdd2-ac79d870f64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:14.852861 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbd0d1-15ed-403e-bdd2-ac79d870f64b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:14.853156 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbd0d1-15ed-403e-bdd2-ac79d870f64b admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:14.853844 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbd0d1-15ed-403e-bdd2-ac79d870f64b admin admin] PATH_INFO: `/v3/projects/ebcae18725df4340a951e7a0b366c031` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:14.855510 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadbd0d1-15ed-403e-bdd2-ac79d870f64b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebcae18725df4340a951e7a0b366c031)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:14.857469 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadbd0d1-15ed-403e-bdd2-ac79d870f64b admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:14.860836 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9cf358-0688-4b42-8380-c9bf91aa0288 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:14.866577 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a42f76a-d876-4dcd-b4f0-487f81ef0985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:14.870788 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42f76a-d876-4dcd-b4f0-487f81ef0985 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:14.870788 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42f76a-d876-4dcd-b4f0-487f81ef0985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:14.870788 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42f76a-d876-4dcd-b4f0-487f81ef0985 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:14.870788 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a42f76a-d876-4dcd-b4f0-487f81ef0985 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:14.870788 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a42f76a-d876-4dcd-b4f0-487f81ef0985 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:14.980842 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-dadbd0d1-15ed-403e-bdd2-ac79d870f64b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebcae18725df4340a951e7a0b366c031', 'request_id': 'req-dadbd0d1-15ed-403e-bdd2-ac79d870f64b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:14.987041 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-dadbd0d1-15ed-403e-bdd2-ac79d870f64b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebcae18725df4340a951e7a0b366c031', 'request_id': 'req-dadbd0d1-15ed-403e-bdd2-ac79d870f64b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:14.992851 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-dadbd0d1-15ed-403e-bdd2-ac79d870f64b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebcae18725df4340a951e7a0b366c031', 'request_id': 'req-dadbd0d1-15ed-403e-bdd2-ac79d870f64b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:15.003744 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1013/2002] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:07:14 2022] POST /identity/v3/projects => generated 383 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:07:15.004952 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a42f76a-d876-4dcd-b4f0-487f81ef0985 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:15.007877 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-9a42f76a-d876-4dcd-b4f0-487f81ef0985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:15.053546 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-dadbd0d1-15ed-403e-bdd2-ac79d870f64b admin admin] The token cache is being invalidate because project ebcae18725df4340a951e7a0b366c031 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:07:15.054089 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-dadbd0d1-15ed-403e-bdd2-ac79d870f64b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:15.054906 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-dadbd0d1-15ed-403e-bdd2-ac79d870f64b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:15.056678 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 990/2003] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:07:14 2022] DELETE /identity/v3/projects/ebcae18725df4340a951e7a0b366c031 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:15.061227 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe90f4-ea0a-4134-a81e-468e5ebb6cc5 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:15.061518 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe90f4-ea0a-4134-a81e-468e5ebb6cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:15.061811 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe90f4-ea0a-4134-a81e-468e5ebb6cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:15.075804 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a42f76a-d876-4dcd-b4f0-487f81ef0985 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:15.080837 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730d58c-06fb-4730-8ba2-6e6919a457f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:15.081834 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730d58c-06fb-4730-8ba2-6e6919a457f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:15.082220 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730d58c-06fb-4730-8ba2-6e6919a457f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:15.082603 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730d58c-06fb-4730-8ba2-6e6919a457f9 admin admin] PATH_INFO: `/v3/users/3c7c401ca4c34122bcf1626be5574f65` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:15.083178 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-7afe90f4-ea0a-4134-a81e-468e5ebb6cc5 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:15.084385 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730d58c-06fb-4730-8ba2-6e6919a457f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c7c401ca4c34122bcf1626be5574f65)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:15.084535 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-7afe90f4-ea0a-4134-a81e-468e5ebb6cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:15.087145 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730d58c-06fb-4730-8ba2-6e6919a457f9 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:15.094903 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 991/2004] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:15.095767 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe90f4-ea0a-4134-a81e-468e5ebb6cc5 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:15.097619 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-7afe90f4-ea0a-4134-a81e-468e5ebb6cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:15.110647 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe90f4-ea0a-4134-a81e-468e5ebb6cc5 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:15.115610 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe755d-b38b-4f91-b20a-4aece84d1c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:15.116373 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe755d-b38b-4f91-b20a-4aece84d1c72 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:15.116659 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe755d-b38b-4f91-b20a-4aece84d1c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:15.116938 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe755d-b38b-4f91-b20a-4aece84d1c72 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:15.117716 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe755d-b38b-4f91-b20a-4aece84d1c72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:15.119840 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe755d-b38b-4f91-b20a-4aece84d1c72 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:15.207704 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 992/2005] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:07:15 2022] POST /identity/v3/users => generated 298 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:07:15.208593 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe755d-b38b-4f91-b20a-4aece84d1c72 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:15.210296 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-8ffe755d-b38b-4f91-b20a-4aece84d1c72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:15.223248 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe755d-b38b-4f91-b20a-4aece84d1c72 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:15.228329 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eac24d-2b1f-4443-a12c-7d1de6b69a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:15.234427 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eac24d-2b1f-4443-a12c-7d1de6b69a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:15.234427 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eac24d-2b1f-4443-a12c-7d1de6b69a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:15.234427 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eac24d-2b1f-4443-a12c-7d1de6b69a7a admin admin] PATH_INFO: `/v3/users/d916c3a046e1405fb4fb4c17e29208b2` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:15.234427 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eac24d-2b1f-4443-a12c-7d1de6b69a7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d916c3a046e1405fb4fb4c17e29208b2)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:15.234427 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eac24d-2b1f-4443-a12c-7d1de6b69a7a admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:15.300192 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-0730d58c-06fb-4730-8ba2-6e6919a457f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c7c401ca4c34122bcf1626be5574f65'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:15.306250 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:15.309948 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-0730d58c-06fb-4730-8ba2-6e6919a457f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c7c401ca4c34122bcf1626be5574f65'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:15.310687 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-0730d58c-06fb-4730-8ba2-6e6919a457f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c7c401ca4c34122bcf1626be5574f65'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:15.311320 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-0730d58c-06fb-4730-8ba2-6e6919a457f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c7c401ca4c34122bcf1626be5574f65'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:15.385133 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-0730d58c-06fb-4730-8ba2-6e6919a457f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c7c401ca4c34122bcf1626be5574f65'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:15.404679 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1014/2006] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:07:15 2022] DELETE /identity/v3/users/3c7c401ca4c34122bcf1626be5574f65 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:15.405697 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730d58c-06fb-4730-8ba2-6e6919a457f9 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:15.407086 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-0730d58c-06fb-4730-8ba2-6e6919a457f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:15.490822 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-98eac24d-2b1f-4443-a12c-7d1de6b69a7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd916c3a046e1405fb4fb4c17e29208b2'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:15.493884 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730d58c-06fb-4730-8ba2-6e6919a457f9 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:15.499414 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:15.499863 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-98eac24d-2b1f-4443-a12c-7d1de6b69a7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd916c3a046e1405fb4fb4c17e29208b2'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:15.500610 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-98eac24d-2b1f-4443-a12c-7d1de6b69a7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd916c3a046e1405fb4fb4c17e29208b2'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:15.501209 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-98eac24d-2b1f-4443-a12c-7d1de6b69a7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd916c3a046e1405fb4fb4c17e29208b2'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:15.503860 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6645516-65d8-4025-8239-63fa92f39c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:15.505106 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6645516-65d8-4025-8239-63fa92f39c51 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:15.507338 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6645516-65d8-4025-8239-63fa92f39c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:15.507338 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6645516-65d8-4025-8239-63fa92f39c51 admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:15.507338 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6645516-65d8-4025-8239-63fa92f39c51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:07:15.507338 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6645516-65d8-4025-8239-63fa92f39c51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:15.509823 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6645516-65d8-4025-8239-63fa92f39c51 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:15.527872 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1015/2007] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:07:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:07:15.529845 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6645516-65d8-4025-8239-63fa92f39c51 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:15.532659 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-f6645516-65d8-4025-8239-63fa92f39c51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:15.545690 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6645516-65d8-4025-8239-63fa92f39c51 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:15.550421 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05809cb3-f766-4194-b65e-a0dd10fd17dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:15.551090 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05809cb3-f766-4194-b65e-a0dd10fd17dd admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:15.551376 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05809cb3-f766-4194-b65e-a0dd10fd17dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:15.551655 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05809cb3-f766-4194-b65e-a0dd10fd17dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:15.552446 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05809cb3-f766-4194-b65e-a0dd10fd17dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:15.554083 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05809cb3-f766-4194-b65e-a0dd10fd17dd admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:15.565088 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1016/2008] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:07:15.565939 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05809cb3-f766-4194-b65e-a0dd10fd17dd admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:15.567635 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-05809cb3-f766-4194-b65e-a0dd10fd17dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:15.579483 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-98eac24d-2b1f-4443-a12c-7d1de6b69a7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd916c3a046e1405fb4fb4c17e29208b2'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:15.581247 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05809cb3-f766-4194-b65e-a0dd10fd17dd admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:15.586727 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf5f87-43a1-4481-9739-bfc0d56df00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:15.587621 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf5f87-43a1-4481-9739-bfc0d56df00d admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:15.588576 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf5f87-43a1-4481-9739-bfc0d56df00d admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:15.588863 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf5f87-43a1-4481-9739-bfc0d56df00d admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:15.589643 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cf5f87-43a1-4481-9739-bfc0d56df00d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:15.591625 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cf5f87-43a1-4481-9739-bfc0d56df00d admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:15.616072 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 993/2009] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:07:15 2022] DELETE /identity/v3/users/d916c3a046e1405fb4fb4c17e29208b2 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:15.617747 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eac24d-2b1f-4443-a12c-7d1de6b69a7a admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:15.684069 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1017/2010] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:07:15 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:07:15.686921 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf5f87-43a1-4481-9739-bfc0d56df00d admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:15.704303 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eac24d-2b1f-4443-a12c-7d1de6b69a7a admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:15.764968 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf5f87-43a1-4481-9739-bfc0d56df00d admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:15.770962 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3a5f9-7150-49dc-b602-6d17f3223bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:15.772212 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3a5f9-7150-49dc-b602-6d17f3223bd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:15.772580 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3a5f9-7150-49dc-b602-6d17f3223bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:15.772936 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3a5f9-7150-49dc-b602-6d17f3223bd0 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:15.774047 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b3a5f9-7150-49dc-b602-6d17f3223bd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:15.777040 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b3a5f9-7150-49dc-b602-6d17f3223bd0 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:15.790508 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d049f9-31be-43d3-9970-162390b4a1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:15.792036 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d049f9-31be-43d3-9970-162390b4a1a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:15.792437 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d049f9-31be-43d3-9970-162390b4a1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:15.792817 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d049f9-31be-43d3-9970-162390b4a1a9 admin admin] PATH_INFO: `/v3/projects/9e8aef1470ad43f18f656530cdedc8f9/users/a5f26738138a405aae7d201df3c6c952/roles/86273ff072f3438d822e870272491768` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:15.811213 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d049f9-31be-43d3-9970-162390b4a1a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e8aef1470ad43f18f656530cdedc8f9, user_id=a5f26738138a405aae7d201df3c6c952, role_id=86273ff072f3438d822e870272491768)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:15.814364 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d049f9-31be-43d3-9970-162390b4a1a9 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:15.908929 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1018/2011] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:07:15 2022] POST /identity/v3/users => generated 291 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:07:15.913089 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3a5f9-7150-49dc-b602-6d17f3223bd0 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:15.942643 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3a5f9-7150-49dc-b602-6d17f3223bd0 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:15.943754 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 994/2012] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:07:15 2022] PUT /identity/v3/projects/9e8aef1470ad43f18f656530cdedc8f9/users/a5f26738138a405aae7d201df3c6c952/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:15.944669 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d049f9-31be-43d3-9970-162390b4a1a9 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:15.948893 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-18d049f9-31be-43d3-9970-162390b4a1a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:16.083363 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ffcb6-607d-4150-8d0f-de0194232d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:16.084489 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ffcb6-607d-4150-8d0f-de0194232d86 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:16.085116 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ffcb6-607d-4150-8d0f-de0194232d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:16.085616 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ffcb6-607d-4150-8d0f-de0194232d86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:16.086586 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ffcb6-607d-4150-8d0f-de0194232d86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:16.088882 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ffcb6-607d-4150-8d0f-de0194232d86 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:16.103786 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1019/2013] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:07:16.106231 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ffcb6-607d-4150-8d0f-de0194232d86 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:16.116205 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d049f9-31be-43d3-9970-162390b4a1a9 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:16.121886 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ffcb6-607d-4150-8d0f-de0194232d86 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:16.128889 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78527d-b9d0-489b-85e8-f1f2ae5e4203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:16.128889 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78527d-b9d0-489b-85e8-f1f2ae5e4203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:16.129113 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c5929-ca9c-4cc7-a678-355748e881d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:16.129222 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78527d-b9d0-489b-85e8-f1f2ae5e4203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:16.129222 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78527d-b9d0-489b-85e8-f1f2ae5e4203 admin admin] PATH_INFO: `/v3/projects/05ea57ebb5d34ac2adc7e8687af4f3fb` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:16.129408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c5929-ca9c-4cc7-a678-355748e881d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:16.129408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c5929-ca9c-4cc7-a678-355748e881d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:16.129408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c5929-ca9c-4cc7-a678-355748e881d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:16.129629 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f78527d-b9d0-489b-85e8-f1f2ae5e4203 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05ea57ebb5d34ac2adc7e8687af4f3fb)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:16.129711 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c5929-ca9c-4cc7-a678-355748e881d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:16.131682 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c5929-ca9c-4cc7-a678-355748e881d3 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:16.134115 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f78527d-b9d0-489b-85e8-f1f2ae5e4203 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:16.143539 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1020/2014] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:07:16.144754 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c5929-ca9c-4cc7-a678-355748e881d3 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:16.162235 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c5929-ca9c-4cc7-a678-355748e881d3 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:16.167636 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eafd788-2282-40a7-8419-21b8c4483181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:16.168481 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafd788-2282-40a7-8419-21b8c4483181 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:16.168854 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafd788-2282-40a7-8419-21b8c4483181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:16.169169 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafd788-2282-40a7-8419-21b8c4483181 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:16.174233 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eafd788-2282-40a7-8419-21b8c4483181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:16.175928 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eafd788-2282-40a7-8419-21b8c4483181 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:16.187608 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1021/2015] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:07:16.188429 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eafd788-2282-40a7-8419-21b8c4483181 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:16.201698 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eafd788-2282-40a7-8419-21b8c4483181 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:16.207191 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e28a72-2c8a-4abb-8230-f5479b5c1993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:16.208303 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e28a72-2c8a-4abb-8230-f5479b5c1993 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:16.208624 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e28a72-2c8a-4abb-8230-f5479b5c1993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:16.209061 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e28a72-2c8a-4abb-8230-f5479b5c1993 admin admin] PATH_INFO: `/v3/projects/9e8aef1470ad43f18f656530cdedc8f9/users/a5f26738138a405aae7d201df3c6c952/roles/86273ff072f3438d822e870272491768` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:16.215216 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e28a72-2c8a-4abb-8230-f5479b5c1993 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e8aef1470ad43f18f656530cdedc8f9, user_id=a5f26738138a405aae7d201df3c6c952, role_id=86273ff072f3438d822e870272491768)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:16.215216 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e28a72-2c8a-4abb-8230-f5479b5c1993 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:16.224492 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1022/2016] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:07:16 2022] PUT /identity/v3/projects/9e8aef1470ad43f18f656530cdedc8f9/users/a5f26738138a405aae7d201df3c6c952/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:16.225262 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e28a72-2c8a-4abb-8230-f5479b5c1993 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:16.288442 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e28a72-2c8a-4abb-8230-f5479b5c1993 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:16.309873 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-8f78527d-b9d0-489b-85e8-f1f2ae5e4203 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05ea57ebb5d34ac2adc7e8687af4f3fb', 'request_id': 'req-8f78527d-b9d0-489b-85e8-f1f2ae5e4203'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:16.317915 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-8f78527d-b9d0-489b-85e8-f1f2ae5e4203 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05ea57ebb5d34ac2adc7e8687af4f3fb', 'request_id': 'req-8f78527d-b9d0-489b-85e8-f1f2ae5e4203'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:16.333510 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-8f78527d-b9d0-489b-85e8-f1f2ae5e4203 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05ea57ebb5d34ac2adc7e8687af4f3fb', 'request_id': 'req-8f78527d-b9d0-489b-85e8-f1f2ae5e4203'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:16.356492 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c042eb4-f72c-4137-a855-5a52b76d608a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:16.357397 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c042eb4-f72c-4137-a855-5a52b76d608a admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:16.357685 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c042eb4-f72c-4137-a855-5a52b76d608a admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:16.357978 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c042eb4-f72c-4137-a855-5a52b76d608a admin admin] PATH_INFO: `/v3/projects/4439039fe49c499888cf624551befcff/users/61f1ca8c4c174ab49d2b722990d7b8f1/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:16.372315 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c042eb4-f72c-4137-a855-5a52b76d608a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4439039fe49c499888cf624551befcff, user_id=61f1ca8c4c174ab49d2b722990d7b8f1, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:16.374997 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c042eb4-f72c-4137-a855-5a52b76d608a admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:16.411946 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-8f78527d-b9d0-489b-85e8-f1f2ae5e4203 admin admin] The token cache is being invalidate because project 05ea57ebb5d34ac2adc7e8687af4f3fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:07:16.412272 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-8f78527d-b9d0-489b-85e8-f1f2ae5e4203 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:16.412905 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-8f78527d-b9d0-489b-85e8-f1f2ae5e4203 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:16.417908 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 995/2017] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:07:15 2022] DELETE /identity/v3/projects/05ea57ebb5d34ac2adc7e8687af4f3fb => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:16.417908 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf871a7-560a-47d3-b191-e7548fac1baf None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:16.417908 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf871a7-560a-47d3-b191-e7548fac1baf None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:16.417908 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf871a7-560a-47d3-b191-e7548fac1baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:16.443389 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-4cf871a7-560a-47d3-b191-e7548fac1baf None None] MFA Rules not processed for user `a5f26738138a405aae7d201df3c6c952`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:16.444780 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-4cf871a7-560a-47d3-b191-e7548fac1baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:16.465511 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1023/2018] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:07:16 2022] PUT /identity/v3/projects/4439039fe49c499888cf624551befcff/users/61f1ca8c4c174ab49d2b722990d7b8f1/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:16.469305 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c042eb4-f72c-4137-a855-5a52b76d608a admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:16.469305 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-8c042eb4-f72c-4137-a855-5a52b76d608a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:16.517479 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:16.523902 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 996/2019] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:16 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:16.528261 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf871a7-560a-47d3-b191-e7548fac1baf None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:16.528261 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-4cf871a7-560a-47d3-b191-e7548fac1baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:16.543793 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c042eb4-f72c-4137-a855-5a52b76d608a admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:16.545209 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf871a7-560a-47d3-b191-e7548fac1baf None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:16.554515 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae17fad-f4cf-4b72-b1bb-bd8d151ad63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:16.554515 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae17fad-f4cf-4b72-b1bb-bd8d151ad63c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:16.554515 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae17fad-f4cf-4b72-b1bb-bd8d151ad63c admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:16.554765 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e71b9e-3687-4d6a-bb19-db527f0cad42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:16.554876 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae17fad-f4cf-4b72-b1bb-bd8d151ad63c admin admin] PATH_INFO: `/v3/projects/f2117df65c374bc99b069d519bb0b6e8` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:16.554961 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e71b9e-3687-4d6a-bb19-db527f0cad42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:16.554961 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e71b9e-3687-4d6a-bb19-db527f0cad42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:16.555120 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae17fad-f4cf-4b72-b1bb-bd8d151ad63c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2117df65c374bc99b069d519bb0b6e8)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:16.555211 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e71b9e-3687-4d6a-bb19-db527f0cad42 admin admin] PATH_INFO: `/v3/users/28fdc2fcf0044cda84c076ef40f0ec42` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:16.555211 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e71b9e-3687-4d6a-bb19-db527f0cad42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28fdc2fcf0044cda84c076ef40f0ec42)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:16.555368 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae17fad-f4cf-4b72-b1bb-bd8d151ad63c admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:16.555775 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e71b9e-3687-4d6a-bb19-db527f0cad42 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:16.731225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3ae17fad-f4cf-4b72-b1bb-bd8d151ad63c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2117df65c374bc99b069d519bb0b6e8', 'request_id': 'req-3ae17fad-f4cf-4b72-b1bb-bd8d151ad63c'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:16.731426 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-67e71b9e-3687-4d6a-bb19-db527f0cad42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28fdc2fcf0044cda84c076ef40f0ec42'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:16.737673 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3ae17fad-f4cf-4b72-b1bb-bd8d151ad63c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2117df65c374bc99b069d519bb0b6e8', 'request_id': 'req-3ae17fad-f4cf-4b72-b1bb-bd8d151ad63c'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:16.738934 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-67e71b9e-3687-4d6a-bb19-db527f0cad42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28fdc2fcf0044cda84c076ef40f0ec42'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:16.739679 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-67e71b9e-3687-4d6a-bb19-db527f0cad42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28fdc2fcf0044cda84c076ef40f0ec42'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:16.740368 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-67e71b9e-3687-4d6a-bb19-db527f0cad42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28fdc2fcf0044cda84c076ef40f0ec42'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:16.743337 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3ae17fad-f4cf-4b72-b1bb-bd8d151ad63c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2117df65c374bc99b069d519bb0b6e8', 'request_id': 'req-3ae17fad-f4cf-4b72-b1bb-bd8d151ad63c'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:16.827650 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-67e71b9e-3687-4d6a-bb19-db527f0cad42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28fdc2fcf0044cda84c076ef40f0ec42'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:16.840957 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=96 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:16.847340 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 997/2020] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:07:16 2022] DELETE /identity/v3/users/28fdc2fcf0044cda84c076ef40f0ec42 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:16.850519 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c8071-f088-4e92-9fa6-65b38170b7ed None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:16.851177 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c8071-f088-4e92-9fa6-65b38170b7ed None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:16.851177 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c8071-f088-4e92-9fa6-65b38170b7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:16.867888 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-f22c8071-f088-4e92-9fa6-65b38170b7ed None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:16.869146 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-f22c8071-f088-4e92-9fa6-65b38170b7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:16.892733 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3ae17fad-f4cf-4b72-b1bb-bd8d151ad63c admin admin] The token cache is being invalidate because project f2117df65c374bc99b069d519bb0b6e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:07:16.894519 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3ae17fad-f4cf-4b72-b1bb-bd8d151ad63c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:16.894519 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3ae17fad-f4cf-4b72-b1bb-bd8d151ad63c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:16.899375 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1024/2021] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:07:16 2022] DELETE /identity/v3/projects/f2117df65c374bc99b069d519bb0b6e8 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:16.899375 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae17fad-f4cf-4b72-b1bb-bd8d151ad63c admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:16.899375 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-3ae17fad-f4cf-4b72-b1bb-bd8d151ad63c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:16.938196 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 998/2022] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:16.939545 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1caaa0b-6b91-45b4-912c-d30ce0b0bca0 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:16.939825 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1caaa0b-6b91-45b4-912c-d30ce0b0bca0 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:16.940140 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1caaa0b-6b91-45b4-912c-d30ce0b0bca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:16.962166 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-b1caaa0b-6b91-45b4-912c-d30ce0b0bca0 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:16.963173 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b1caaa0b-6b91-45b4-912c-d30ce0b0bca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:16.968827 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae17fad-f4cf-4b72-b1bb-bd8d151ad63c admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:16.979174 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 999/2023] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:16.979174 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1caaa0b-6b91-45b4-912c-d30ce0b0bca0 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:16.979174 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b1caaa0b-6b91-45b4-912c-d30ce0b0bca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:17.017922 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34804ee-37e8-41fe-8ca1-b8f11bcf4299 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:17.018588 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34804ee-37e8-41fe-8ca1-b8f11bcf4299 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:17.018862 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34804ee-37e8-41fe-8ca1-b8f11bcf4299 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:17.019139 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34804ee-37e8-41fe-8ca1-b8f11bcf4299 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:17.020935 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-d34804ee-37e8-41fe-8ca1-b8f11bcf4299 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:17.036255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1caaa0b-6b91-45b4-912c-d30ce0b0bca0 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:17.040212 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11624a7a-cde7-4746-b457-e9fc4e5ac63e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:17.040872 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11624a7a-cde7-4746-b457-e9fc4e5ac63e service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:17.041158 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11624a7a-cde7-4746-b457-e9fc4e5ac63e service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:17.041433 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11624a7a-cde7-4746-b457-e9fc4e5ac63e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:17.051455 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11624a7a-cde7-4746-b457-e9fc4e5ac63e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:17.056961 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11624a7a-cde7-4746-b457-e9fc4e5ac63e service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:17.063752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1000/2024] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:07:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:07:17.065097 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7a6f7-cddd-4d0f-9e65-5d5a95c3b2b5 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:17.065389 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7a6f7-cddd-4d0f-9e65-5d5a95c3b2b5 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:17.065664 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7a6f7-cddd-4d0f-9e65-5d5a95c3b2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:17.084003 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-1ea7a6f7-cddd-4d0f-9e65-5d5a95c3b2b5 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:17.085206 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-1ea7a6f7-cddd-4d0f-9e65-5d5a95c3b2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:17.087367 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34804ee-37e8-41fe-8ca1-b8f11bcf4299 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:17.089711 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34804ee-37e8-41fe-8ca1-b8f11bcf4299 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:17.097838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1001/2025] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:17.102128 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea7a6f7-cddd-4d0f-9e65-5d5a95c3b2b5 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:17.110638 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1025/2026] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:07:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:07:17.114060 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea7a6f7-cddd-4d0f-9e65-5d5a95c3b2b5 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:17.119428 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bdc439-7e9a-4326-8442-80deb87d7144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:17.120697 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdc439-7e9a-4326-8442-80deb87d7144 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:17.125838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdc439-7e9a-4326-8442-80deb87d7144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:17.125838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bdc439-7e9a-4326-8442-80deb87d7144 admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:17.125838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bdc439-7e9a-4326-8442-80deb87d7144 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:07:17.125838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bdc439-7e9a-4326-8442-80deb87d7144 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:17.125838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bdc439-7e9a-4326-8442-80deb87d7144 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:17.138073 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1002/2027] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:07:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:07:17.142860 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34804ee-37e8-41fe-8ca1-b8f11bcf4299 service cinder] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:17.155671 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34804ee-37e8-41fe-8ca1-b8f11bcf4299 service cinder] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:17.161391 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4e96b-16a0-4d63-8bd0-67e092155f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:17.162483 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4e96b-16a0-4d63-8bd0-67e092155f40 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:17.163173 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4e96b-16a0-4d63-8bd0-67e092155f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:17.163533 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4e96b-16a0-4d63-8bd0-67e092155f40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:17.164384 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb4e96b-16a0-4d63-8bd0-67e092155f40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:17.167992 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb4e96b-16a0-4d63-8bd0-67e092155f40 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:17.289767 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1026/2028] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:07:17 2022] POST /identity/v3/projects => generated 371 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:07:17.290842 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bdc439-7e9a-4326-8442-80deb87d7144 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:17.301578 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bdc439-7e9a-4326-8442-80deb87d7144 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:17.360970 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4e96b-16a0-4d63-8bd0-67e092155f40 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:17.362772 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-4eb4e96b-16a0-4d63-8bd0-67e092155f40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:17.396925 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41089b2-8544-4e72-a6fb-0662c13146ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:17.397629 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41089b2-8544-4e72-a6fb-0662c13146ae admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:17.398058 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41089b2-8544-4e72-a6fb-0662c13146ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:17.398194 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41089b2-8544-4e72-a6fb-0662c13146ae admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:17.398894 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41089b2-8544-4e72-a6fb-0662c13146ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:17.400875 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41089b2-8544-4e72-a6fb-0662c13146ae admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:17.449681 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4e96b-16a0-4d63-8bd0-67e092155f40 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:17.455287 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f100c-5356-4138-9163-4cc5a7604a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:17.456335 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f100c-5356-4138-9163-4cc5a7604a57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:17.456622 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f100c-5356-4138-9163-4cc5a7604a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:17.456901 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f100c-5356-4138-9163-4cc5a7604a57 admin admin] PATH_INFO: `/v3/projects/849ed5107f404f9aacc8eb440e2eeb5a` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:17.458103 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f100c-5356-4138-9163-4cc5a7604a57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=849ed5107f404f9aacc8eb440e2eeb5a)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:17.460084 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f100c-5356-4138-9163-4cc5a7604a57 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:17.480691 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1003/2029] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:07:17 2022] POST /identity/v3/users => generated 286 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:07:17.485249 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41089b2-8544-4e72-a6fb-0662c13146ae admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:17.496229 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41089b2-8544-4e72-a6fb-0662c13146ae admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:17.500915 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569db181-9fed-46d5-847f-d95f9a03637f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:17.501584 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569db181-9fed-46d5-847f-d95f9a03637f admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:17.501874 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569db181-9fed-46d5-847f-d95f9a03637f admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:17.502183 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569db181-9fed-46d5-847f-d95f9a03637f admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:17.502904 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569db181-9fed-46d5-847f-d95f9a03637f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:17.504528 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569db181-9fed-46d5-847f-d95f9a03637f admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:17.514900 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1004/2030] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 21:07:17.519017 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569db181-9fed-46d5-847f-d95f9a03637f admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:17.528654 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569db181-9fed-46d5-847f-d95f9a03637f admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:17.533353 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb82d0-cb02-4512-b9af-c38ea05474f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:17.534006 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb82d0-cb02-4512-b9af-c38ea05474f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:17.534335 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb82d0-cb02-4512-b9af-c38ea05474f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:17.534713 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb82d0-cb02-4512-b9af-c38ea05474f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:17.535946 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb82d0-cb02-4512-b9af-c38ea05474f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:17.537580 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb82d0-cb02-4512-b9af-c38ea05474f0 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:17.549045 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1005/2031] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 21:07:17.553209 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb82d0-cb02-4512-b9af-c38ea05474f0 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:17.563998 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb82d0-cb02-4512-b9af-c38ea05474f0 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:17.569089 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0462683-6224-4989-9260-4cbc45d4a121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:17.569891 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0462683-6224-4989-9260-4cbc45d4a121 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:17.570181 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0462683-6224-4989-9260-4cbc45d4a121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:17.570459 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0462683-6224-4989-9260-4cbc45d4a121 admin admin] PATH_INFO: `/v3/projects/d5c3c899ba6448b3b962b30f54a36db1/users/0908feda0c8645eea9ec7021db1d2add/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:17.590325 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0462683-6224-4989-9260-4cbc45d4a121 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5c3c899ba6448b3b962b30f54a36db1, user_id=0908feda0c8645eea9ec7021db1d2add, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:17.593914 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0462683-6224-4989-9260-4cbc45d4a121 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:17.596298 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-670f100c-5356-4138-9163-4cc5a7604a57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '849ed5107f404f9aacc8eb440e2eeb5a', 'request_id': 'req-670f100c-5356-4138-9163-4cc5a7604a57'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:17.603071 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-670f100c-5356-4138-9163-4cc5a7604a57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '849ed5107f404f9aacc8eb440e2eeb5a', 'request_id': 'req-670f100c-5356-4138-9163-4cc5a7604a57'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:17.609541 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-670f100c-5356-4138-9163-4cc5a7604a57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '849ed5107f404f9aacc8eb440e2eeb5a', 'request_id': 'req-670f100c-5356-4138-9163-4cc5a7604a57'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:17.699007 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-670f100c-5356-4138-9163-4cc5a7604a57 admin admin] The token cache is being invalidate because project 849ed5107f404f9aacc8eb440e2eeb5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:07:17.699307 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-670f100c-5356-4138-9163-4cc5a7604a57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:17.705756 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-670f100c-5356-4138-9163-4cc5a7604a57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:17.709253 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1027/2032] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:07:17 2022] DELETE /identity/v3/projects/849ed5107f404f9aacc8eb440e2eeb5a => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:17.712509 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b070fe-f278-44e4-a3cf-a7cf76c34a61 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:17.712797 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b070fe-f278-44e4-a3cf-a7cf76c34a61 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:17.713078 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b070fe-f278-44e4-a3cf-a7cf76c34a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:17.715947 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1006/2033] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:07:17 2022] PUT /identity/v3/projects/d5c3c899ba6448b3b962b30f54a36db1/users/0908feda0c8645eea9ec7021db1d2add/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:17.721404 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded1e17-00e0-4155-8325-2f1a591bd2b2 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:17.721934 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded1e17-00e0-4155-8325-2f1a591bd2b2 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:17.722226 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded1e17-00e0-4155-8325-2f1a591bd2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:17.740480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-b6b070fe-f278-44e4-a3cf-a7cf76c34a61 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:17.742168 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-bded1e17-00e0-4155-8325-2f1a591bd2b2 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:17.742518 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-b6b070fe-f278-44e4-a3cf-a7cf76c34a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:17.743558 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-bded1e17-00e0-4155-8325-2f1a591bd2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:17.838867 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1028/2034] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:07:17.843229 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7af3d-d462-4abb-8cc7-e01aae525123 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:17.843887 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7af3d-d462-4abb-8cc7-e01aae525123 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:17.850735 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7af3d-d462-4abb-8cc7-e01aae525123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:17.880990 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1007/2035] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:17.892557 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded1e17-00e0-4155-8325-2f1a591bd2b2 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:17.894489 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-bded1e17-00e0-4155-8325-2f1a591bd2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:17.898153 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-9cc7af3d-d462-4abb-8cc7-e01aae525123 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:17.899625 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-9cc7af3d-d462-4abb-8cc7-e01aae525123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:17.913395 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1029/2036] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:17.914312 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7af3d-d462-4abb-8cc7-e01aae525123 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:17.928005 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7af3d-d462-4abb-8cc7-e01aae525123 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:17.934626 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489efae7-2385-447f-92d6-efd44ee9172b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:17.936583 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489efae7-2385-447f-92d6-efd44ee9172b admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:17.936843 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489efae7-2385-447f-92d6-efd44ee9172b admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:17.937140 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489efae7-2385-447f-92d6-efd44ee9172b admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:17.937880 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489efae7-2385-447f-92d6-efd44ee9172b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:07:17.938197 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489efae7-2385-447f-92d6-efd44ee9172b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:17.939808 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489efae7-2385-447f-92d6-efd44ee9172b admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:17.986725 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1030/2037] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:07:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:07:17.992217 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded1e17-00e0-4155-8325-2f1a591bd2b2 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:17.992721 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489efae7-2385-447f-92d6-efd44ee9172b admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:17.998274 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b18fa-b334-40af-a5ed-29b1f60df61e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:17.998962 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b18fa-b334-40af-a5ed-29b1f60df61e service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:17.999260 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b18fa-b334-40af-a5ed-29b1f60df61e service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:17.999547 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b18fa-b334-40af-a5ed-29b1f60df61e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:18.005629 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489efae7-2385-447f-92d6-efd44ee9172b admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:18.009909 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b18fa-b334-40af-a5ed-29b1f60df61e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:18.011825 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b18fa-b334-40af-a5ed-29b1f60df61e service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:18.013558 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a02e51-6341-4e04-97fc-88acaa087142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:18.015010 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a02e51-6341-4e04-97fc-88acaa087142 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:18.015696 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a02e51-6341-4e04-97fc-88acaa087142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:18.016307 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a02e51-6341-4e04-97fc-88acaa087142 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:18.018673 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a02e51-6341-4e04-97fc-88acaa087142 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:18.020678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a02e51-6341-4e04-97fc-88acaa087142 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:18.023318 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1008/2038] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:07:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 21:07:18.166219 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1031/2039] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:07:17 2022] POST /identity/v3/projects => generated 383 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:07:18.168070 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b18fa-b334-40af-a5ed-29b1f60df61e service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:18.177565 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b18fa-b334-40af-a5ed-29b1f60df61e service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:18.234977 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d753b1-05f9-4af1-aa8b-b02a1e75b896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:18.235722 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d753b1-05f9-4af1-aa8b-b02a1e75b896 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:18.236039 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d753b1-05f9-4af1-aa8b-b02a1e75b896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:18.236319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d753b1-05f9-4af1-aa8b-b02a1e75b896 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:18.237011 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d753b1-05f9-4af1-aa8b-b02a1e75b896 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:18.238920 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d753b1-05f9-4af1-aa8b-b02a1e75b896 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:18.333760 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1009/2040] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:07:18 2022] POST /identity/v3/users => generated 292 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 21:07:18.337799 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a02e51-6341-4e04-97fc-88acaa087142 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:18.348968 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a02e51-6341-4e04-97fc-88acaa087142 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:18.358504 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13503b26-372b-4409-bb3a-b8739de0058f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:18.359179 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13503b26-372b-4409-bb3a-b8739de0058f admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:18.359527 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13503b26-372b-4409-bb3a-b8739de0058f admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:18.359818 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13503b26-372b-4409-bb3a-b8739de0058f admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:18.360612 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13503b26-372b-4409-bb3a-b8739de0058f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:18.362365 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13503b26-372b-4409-bb3a-b8739de0058f admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:18.375153 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1032/2041] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:07:18.379348 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d753b1-05f9-4af1-aa8b-b02a1e75b896 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:18.390195 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d753b1-05f9-4af1-aa8b-b02a1e75b896 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:18.394744 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:18.395521 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba386b-9518-47e4-b564-750a444f041a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:18.396417 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba386b-9518-47e4-b564-750a444f041a admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:18.396706 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba386b-9518-47e4-b564-750a444f041a admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:18.396988 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba386b-9518-47e4-b564-750a444f041a admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:18.398226 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba386b-9518-47e4-b564-750a444f041a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:18.399346 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba386b-9518-47e4-b564-750a444f041a admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:18.410287 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1010/2042] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:07:18.414578 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13503b26-372b-4409-bb3a-b8739de0058f admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:18.427761 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13503b26-372b-4409-bb3a-b8739de0058f admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:18.435998 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b34dc2-325c-4715-9949-2a452881c64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:18.437671 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b34dc2-325c-4715-9949-2a452881c64d admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:18.437982 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b34dc2-325c-4715-9949-2a452881c64d admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:18.438697 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b34dc2-325c-4715-9949-2a452881c64d admin admin] PATH_INFO: `/v3/projects/8e7207ffbad641a3a46e1d7fa10d9d1f/users/31e0afbcffd745c2aac4c9bd831a4846/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:18.456897 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b34dc2-325c-4715-9949-2a452881c64d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e7207ffbad641a3a46e1d7fa10d9d1f, user_id=31e0afbcffd745c2aac4c9bd831a4846, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:18.460054 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b34dc2-325c-4715-9949-2a452881c64d admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:18.543905 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1033/2043] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:07:18 2022] PUT /identity/v3/projects/8e7207ffbad641a3a46e1d7fa10d9d1f/users/31e0afbcffd745c2aac4c9bd831a4846/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:18.556343 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf6dd6-ce6c-4994-9b68-3a13e20d0fa2 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:18.556663 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf6dd6-ce6c-4994-9b68-3a13e20d0fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:18.556947 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf6dd6-ce6c-4994-9b68-3a13e20d0fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:18.585298 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-f8cf6dd6-ce6c-4994-9b68-3a13e20d0fa2 None None] MFA Rules not processed for user `31e0afbcffd745c2aac4c9bd831a4846`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:18.586521 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-f8cf6dd6-ce6c-4994-9b68-3a13e20d0fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:18.660368 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1011/2044] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:07:18.664828 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b34dc2-325c-4715-9949-2a452881c64d admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:18.715617 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:18.734311 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41fd7d-16df-4eb6-a2cb-cfeb01c03c2c None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:18.734906 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41fd7d-16df-4eb6-a2cb-cfeb01c03c2c None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:18.735499 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41fd7d-16df-4eb6-a2cb-cfeb01c03c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:18.759058 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b34dc2-325c-4715-9949-2a452881c64d admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:18.764767 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7486a-7945-41b2-8d51-d9cf12d71044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:18.765829 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7486a-7945-41b2-8d51-d9cf12d71044 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:18.766175 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7486a-7945-41b2-8d51-d9cf12d71044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:18.766568 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7486a-7945-41b2-8d51-d9cf12d71044 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:18.767328 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e7486a-7945-41b2-8d51-d9cf12d71044 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:18.769379 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e7486a-7945-41b2-8d51-d9cf12d71044 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:18.771436 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-9c41fd7d-16df-4eb6-a2cb-cfeb01c03c2c None None] MFA Rules not processed for user `61f1ca8c4c174ab49d2b722990d7b8f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:18.772670 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-9c41fd7d-16df-4eb6-a2cb-cfeb01c03c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:18.840670 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1012/2045] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:07:18.851586 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41fd7d-16df-4eb6-a2cb-cfeb01c03c2c None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:18.853138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-9c41fd7d-16df-4eb6-a2cb-cfeb01c03c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:18.895840 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1034/2046] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:07:18 2022] POST /identity/v3/projects => generated 381 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:07:18.900727 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7486a-7945-41b2-8d51-d9cf12d71044 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:18.922705 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41fd7d-16df-4eb6-a2cb-cfeb01c03c2c None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:18.977729 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7486a-7945-41b2-8d51-d9cf12d71044 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:18.981161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680650c-beac-4023-ba64-48d4696439d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:18.981810 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680650c-beac-4023-ba64-48d4696439d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:18.982097 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680650c-beac-4023-ba64-48d4696439d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:18.982476 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680650c-beac-4023-ba64-48d4696439d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:18.984679 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d5c89-c77f-49de-8103-2502aa755949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:18.985533 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d5c89-c77f-49de-8103-2502aa755949 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:18.985970 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d5c89-c77f-49de-8103-2502aa755949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:18.986395 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d5c89-c77f-49de-8103-2502aa755949 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:18.987240 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d5c89-c77f-49de-8103-2502aa755949 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:18.989737 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d5c89-c77f-49de-8103-2502aa755949 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:19.044588 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8680650c-beac-4023-ba64-48d4696439d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:19.046026 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8680650c-beac-4023-ba64-48d4696439d9 service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:19.055496 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1013/2047] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:07:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 21:07:19.092096 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1035/2048] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:07:18 2022] POST /identity/v3/users => generated 297 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:07:19.096128 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680650c-beac-4023-ba64-48d4696439d9 service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:19.106998 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680650c-beac-4023-ba64-48d4696439d9 service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:19.111688 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843c5f9-c4eb-4135-a7e3-930c095911cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:19.112492 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843c5f9-c4eb-4135-a7e3-930c095911cd admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:19.112778 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843c5f9-c4eb-4135-a7e3-930c095911cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:19.113054 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843c5f9-c4eb-4135-a7e3-930c095911cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:19.113841 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8843c5f9-c4eb-4135-a7e3-930c095911cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:19.115574 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8843c5f9-c4eb-4135-a7e3-930c095911cd admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:19.128858 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1014/2049] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:07:19.131436 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d5c89-c77f-49de-8103-2502aa755949 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:19.143185 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d5c89-c77f-49de-8103-2502aa755949 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:19.148790 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b77dc0-2fb7-43e2-ad6c-0601cba63848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:19.151881 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b77dc0-2fb7-43e2-ad6c-0601cba63848 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:19.151881 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b77dc0-2fb7-43e2-ad6c-0601cba63848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:19.151881 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b77dc0-2fb7-43e2-ad6c-0601cba63848 admin admin] PATH_INFO: `/v3/projects/be1e1580df284597b89035beabbd0aae/users/ed10d762d39041dd9bd4c871c0437b12/roles/86273ff072f3438d822e870272491768` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:19.167755 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b77dc0-2fb7-43e2-ad6c-0601cba63848 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be1e1580df284597b89035beabbd0aae, user_id=ed10d762d39041dd9bd4c871c0437b12, role_id=86273ff072f3438d822e870272491768)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:19.170572 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b77dc0-2fb7-43e2-ad6c-0601cba63848 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:19.237493 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843c5f9-c4eb-4135-a7e3-930c095911cd admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:19.239497 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-8843c5f9-c4eb-4135-a7e3-930c095911cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:19.255483 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843c5f9-c4eb-4135-a7e3-930c095911cd admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:19.257288 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10146b6f-3309-4b4b-8903-2fe29bc8b6aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:19.257951 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10146b6f-3309-4b4b-8903-2fe29bc8b6aa service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:19.258239 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10146b6f-3309-4b4b-8903-2fe29bc8b6aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:19.259436 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10146b6f-3309-4b4b-8903-2fe29bc8b6aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:19.262161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-10146b6f-3309-4b4b-8903-2fe29bc8b6aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:19.279415 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1036/2050] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:07:19 2022] PUT /identity/v3/projects/be1e1580df284597b89035beabbd0aae/users/ed10d762d39041dd9bd4c871c0437b12/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:07:19.284204 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b77dc0-2fb7-43e2-ad6c-0601cba63848 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:19.324531 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10146b6f-3309-4b4b-8903-2fe29bc8b6aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:19.326053 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10146b6f-3309-4b4b-8903-2fe29bc8b6aa service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:19.335717 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1015/2051] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:07:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 21:07:19.353155 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b77dc0-2fb7-43e2-ad6c-0601cba63848 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:19.359343 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c7989-a97d-43a4-9f79-8cb5a28cfd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:19.360084 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c7989-a97d-43a4-9f79-8cb5a28cfd88 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:19.360377 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c7989-a97d-43a4-9f79-8cb5a28cfd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:19.360659 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c7989-a97d-43a4-9f79-8cb5a28cfd88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:19.361400 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c7989-a97d-43a4-9f79-8cb5a28cfd88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:19.363014 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c7989-a97d-43a4-9f79-8cb5a28cfd88 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:19.374214 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1037/2052] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 21:07:19.378318 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10146b6f-3309-4b4b-8903-2fe29bc8b6aa service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:19.389123 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10146b6f-3309-4b4b-8903-2fe29bc8b6aa service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:19.394019 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810266a-4399-4625-9e1a-89de6248f3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:19.394907 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810266a-4399-4625-9e1a-89de6248f3d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:19.395223 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810266a-4399-4625-9e1a-89de6248f3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:19.398749 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810266a-4399-4625-9e1a-89de6248f3d6 admin admin] PATH_INFO: `/v3/projects/be1e1580df284597b89035beabbd0aae/users/ed10d762d39041dd9bd4c871c0437b12/roles/86273ff072f3438d822e870272491768` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:19.398749 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a810266a-4399-4625-9e1a-89de6248f3d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be1e1580df284597b89035beabbd0aae, user_id=ed10d762d39041dd9bd4c871c0437b12, role_id=86273ff072f3438d822e870272491768)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:19.400124 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a810266a-4399-4625-9e1a-89de6248f3d6 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:19.411225 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1016/2053] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:07:19 2022] PUT /identity/v3/projects/be1e1580df284597b89035beabbd0aae/users/ed10d762d39041dd9bd4c871c0437b12/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:19.421981 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59310044-04d4-4d22-b922-6387b1d29c1e None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:19.427513 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59310044-04d4-4d22-b922-6387b1d29c1e None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:19.427513 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59310044-04d4-4d22-b922-6387b1d29c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:19.468527 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-59310044-04d4-4d22-b922-6387b1d29c1e None None] MFA Rules not processed for user `ed10d762d39041dd9bd4c871c0437b12`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:19.469955 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-59310044-04d4-4d22-b922-6387b1d29c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:19.544642 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1038/2054] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:07:19.570496 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce46142-91ab-44a6-a219-b47de65105af None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:19.570882 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce46142-91ab-44a6-a219-b47de65105af None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:19.571236 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce46142-91ab-44a6-a219-b47de65105af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:19.601041 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-2ce46142-91ab-44a6-a219-b47de65105af None None] MFA Rules not processed for user `0908feda0c8645eea9ec7021db1d2add`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:19.602413 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-2ce46142-91ab-44a6-a219-b47de65105af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:19.683571 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1017/2055] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:19.688681 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59310044-04d4-4d22-b922-6387b1d29c1e None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:19.690198 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-59310044-04d4-4d22-b922-6387b1d29c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:19.777692 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce46142-91ab-44a6-a219-b47de65105af None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:19.789291 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59310044-04d4-4d22-b922-6387b1d29c1e None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:19.799374 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8175cf-dc17-432a-9a87-e92808a34c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:19.799902 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8175cf-dc17-432a-9a87-e92808a34c67 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:19.800274 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8175cf-dc17-432a-9a87-e92808a34c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:19.800561 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8175cf-dc17-432a-9a87-e92808a34c67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:19.801310 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8175cf-dc17-432a-9a87-e92808a34c67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:19.804104 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8175cf-dc17-432a-9a87-e92808a34c67 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:19.867810 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce46142-91ab-44a6-a219-b47de65105af None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:19.871141 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae089939-9854-4630-ba9d-1f8ae2333e82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:19.871141 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae089939-9854-4630-ba9d-1f8ae2333e82 service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:19.871141 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae089939-9854-4630-ba9d-1f8ae2333e82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:19.871141 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae089939-9854-4630-ba9d-1f8ae2333e82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:19.881011 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae089939-9854-4630-ba9d-1f8ae2333e82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:19.882466 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae089939-9854-4630-ba9d-1f8ae2333e82 service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:19.894880 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1018/2056] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:07:19 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 21:07:19.922502 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1039/2057] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:07:19 2022] POST /identity/v3/projects => generated 373 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:07:19.928108 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae089939-9854-4630-ba9d-1f8ae2333e82 service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:19.938651 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae089939-9854-4630-ba9d-1f8ae2333e82 service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:20.010083 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a839bbd-c894-4d86-ae64-fcd1e36275e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:20.010929 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a839bbd-c894-4d86-ae64-fcd1e36275e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:20.011224 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a839bbd-c894-4d86-ae64-fcd1e36275e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:20.011512 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a839bbd-c894-4d86-ae64-fcd1e36275e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:20.012242 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a839bbd-c894-4d86-ae64-fcd1e36275e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:20.015303 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a839bbd-c894-4d86-ae64-fcd1e36275e9 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:20.035761 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:20.112364 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8175cf-dc17-432a-9a87-e92808a34c67 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:20.130227 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1019/2058] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:07:19 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:07:20.133660 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a839bbd-c894-4d86-ae64-fcd1e36275e9 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:20.145290 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a839bbd-c894-4d86-ae64-fcd1e36275e9 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:20.151571 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d035a-4d6d-4e64-8c55-f6299c9a9740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:20.155384 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d035a-4d6d-4e64-8c55-f6299c9a9740 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:20.155384 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d035a-4d6d-4e64-8c55-f6299c9a9740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:20.155384 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d035a-4d6d-4e64-8c55-f6299c9a9740 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:20.155384 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d035a-4d6d-4e64-8c55-f6299c9a9740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:20.155924 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d035a-4d6d-4e64-8c55-f6299c9a9740 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:20.168381 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1020/2059] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 21:07:20.172456 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d035a-4d6d-4e64-8c55-f6299c9a9740 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:20.180387 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8175cf-dc17-432a-9a87-e92808a34c67 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:20.187189 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d035a-4d6d-4e64-8c55-f6299c9a9740 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:20.187314 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d7c7f-1c92-4a99-8559-e0059d06f787 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:20.187314 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d7c7f-1c92-4a99-8559-e0059d06f787 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:20.187314 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d7c7f-1c92-4a99-8559-e0059d06f787 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:20.187314 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d7c7f-1c92-4a99-8559-e0059d06f787 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:20.188982 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990cc22c-ca32-4226-8768-94c3e5f88b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:20.189941 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990cc22c-ca32-4226-8768-94c3e5f88b4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:20.190171 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990cc22c-ca32-4226-8768-94c3e5f88b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:20.190460 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990cc22c-ca32-4226-8768-94c3e5f88b4a admin admin] PATH_INFO: `/v3/projects/ce9bdc1b6ea54d58b8da698eeb601fee/users/5c040dc8d3434d8e8b4b09d572e64333/roles/86273ff072f3438d822e870272491768` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:20.207510 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990cc22c-ca32-4226-8768-94c3e5f88b4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce9bdc1b6ea54d58b8da698eeb601fee, user_id=5c040dc8d3434d8e8b4b09d572e64333, role_id=86273ff072f3438d822e870272491768)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:20.211468 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990cc22c-ca32-4226-8768-94c3e5f88b4a admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:20.244233 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d7c7f-1c92-4a99-8559-e0059d06f787 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:20.246516 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d7c7f-1c92-4a99-8559-e0059d06f787 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:20.256131 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1040/2060] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:07:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:07:20.258602 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:20.311277 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1021/2061] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:07:20 2022] PUT /identity/v3/projects/ce9bdc1b6ea54d58b8da698eeb601fee/users/5c040dc8d3434d8e8b4b09d572e64333/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:07:20.315196 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d7c7f-1c92-4a99-8559-e0059d06f787 service cinder] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:20.326553 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d7c7f-1c92-4a99-8559-e0059d06f787 service cinder] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:20.399989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a19cf5-59a7-43f4-953a-6c71f778a1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:20.400711 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a19cf5-59a7-43f4-953a-6c71f778a1c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:20.401002 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a19cf5-59a7-43f4-953a-6c71f778a1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:20.401284 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a19cf5-59a7-43f4-953a-6c71f778a1c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:20.402025 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a19cf5-59a7-43f4-953a-6c71f778a1c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:20.403647 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a19cf5-59a7-43f4-953a-6c71f778a1c6 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:20.419292 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1041/2062] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:07:20.420520 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990cc22c-ca32-4226-8768-94c3e5f88b4a admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:20.431795 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990cc22c-ca32-4226-8768-94c3e5f88b4a admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:20.437570 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0baa7c-16aa-4d3c-9ad1-036cd896ac77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:20.438786 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0baa7c-16aa-4d3c-9ad1-036cd896ac77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:20.438786 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0baa7c-16aa-4d3c-9ad1-036cd896ac77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:20.439028 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0baa7c-16aa-4d3c-9ad1-036cd896ac77 admin admin] PATH_INFO: `/v3/projects/ce9bdc1b6ea54d58b8da698eeb601fee/users/5c040dc8d3434d8e8b4b09d572e64333/roles/86273ff072f3438d822e870272491768` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:20.441002 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0baa7c-16aa-4d3c-9ad1-036cd896ac77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce9bdc1b6ea54d58b8da698eeb601fee, user_id=5c040dc8d3434d8e8b4b09d572e64333, role_id=86273ff072f3438d822e870272491768)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:20.443855 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0baa7c-16aa-4d3c-9ad1-036cd896ac77 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:20.454811 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1022/2063] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:07:20 2022] PUT /identity/v3/projects/ce9bdc1b6ea54d58b8da698eeb601fee/users/5c040dc8d3434d8e8b4b09d572e64333/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:20.696951 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a19cf5-59a7-43f4-953a-6c71f778a1c6 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:20.706848 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a19cf5-59a7-43f4-953a-6c71f778a1c6 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:20.763991 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4308e7a2-9323-42fa-9270-3aaa63cea873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:20.764891 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308e7a2-9323-42fa-9270-3aaa63cea873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:20.765183 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308e7a2-9323-42fa-9270-3aaa63cea873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:20.765880 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308e7a2-9323-42fa-9270-3aaa63cea873 admin admin] PATH_INFO: `/v3/users/31e0afbcffd745c2aac4c9bd831a4846` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:20.767089 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4308e7a2-9323-42fa-9270-3aaa63cea873 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31e0afbcffd745c2aac4c9bd831a4846)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:20.769196 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4308e7a2-9323-42fa-9270-3aaa63cea873 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:21.045506 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1104f1-7202-4d63-a81b-ed94c3beb4c3 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:21.046189 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1104f1-7202-4d63-a81b-ed94c3beb4c3 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:21.046674 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1104f1-7202-4d63-a81b-ed94c3beb4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:21.068926 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-ce1104f1-7202-4d63-a81b-ed94c3beb4c3 None None] MFA Rules not processed for user `61f1ca8c4c174ab49d2b722990d7b8f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:21.070586 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-ce1104f1-7202-4d63-a81b-ed94c3beb4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:21.079724 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-4308e7a2-9323-42fa-9270-3aaa63cea873 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31e0afbcffd745c2aac4c9bd831a4846'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:21.088021 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-4308e7a2-9323-42fa-9270-3aaa63cea873 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31e0afbcffd745c2aac4c9bd831a4846'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:21.089039 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-4308e7a2-9323-42fa-9270-3aaa63cea873 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31e0afbcffd745c2aac4c9bd831a4846'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:21.089669 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-4308e7a2-9323-42fa-9270-3aaa63cea873 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31e0afbcffd745c2aac4c9bd831a4846'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:21.140331 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1023/2064] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:07:21.141429 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1104f1-7202-4d63-a81b-ed94c3beb4c3 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:21.142928 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-ce1104f1-7202-4d63-a81b-ed94c3beb4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:21.192139 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-4308e7a2-9323-42fa-9270-3aaa63cea873 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31e0afbcffd745c2aac4c9bd831a4846'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:21.205577 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1104f1-7202-4d63-a81b-ed94c3beb4c3 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:21.210439 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1abcb47-8131-40bd-a387-88ebe1904d8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:21.211017 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abcb47-8131-40bd-a387-88ebe1904d8c service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:21.211315 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abcb47-8131-40bd-a387-88ebe1904d8c service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:21.211759 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abcb47-8131-40bd-a387-88ebe1904d8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:21.223182 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b1abcb47-8131-40bd-a387-88ebe1904d8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:21.260102 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1042/2065] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:07:20 2022] DELETE /identity/v3/users/31e0afbcffd745c2aac4c9bd831a4846 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:21.265918 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d134f0-4a7f-4a2e-8191-612c0b28dcb8 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:21.266270 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d134f0-4a7f-4a2e-8191-612c0b28dcb8 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:21.266564 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d134f0-4a7f-4a2e-8191-612c0b28dcb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:21.294972 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-d4d134f0-4a7f-4a2e-8191-612c0b28dcb8 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:21.296517 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-d4d134f0-4a7f-4a2e-8191-612c0b28dcb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:21.311112 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1abcb47-8131-40bd-a387-88ebe1904d8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:21.312907 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1abcb47-8131-40bd-a387-88ebe1904d8c service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:21.329983 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1024/2066] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:07:21 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:07:21.394944 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1043/2067] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:07:21.406525 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1abcb47-8131-40bd-a387-88ebe1904d8c service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:21.408240 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b1abcb47-8131-40bd-a387-88ebe1904d8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:21.527238 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1abcb47-8131-40bd-a387-88ebe1904d8c service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:21.599091 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3006e-79d0-473e-8d15-168e56d9df12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:21.599091 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3006e-79d0-473e-8d15-168e56d9df12 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:21.599091 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3006e-79d0-473e-8d15-168e56d9df12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:21.599091 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3006e-79d0-473e-8d15-168e56d9df12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:21.605825 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a3006e-79d0-473e-8d15-168e56d9df12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:21.607452 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a3006e-79d0-473e-8d15-168e56d9df12 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:21.619580 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1025/2068] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:07:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:07:22.179729 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d134f0-4a7f-4a2e-8191-612c0b28dcb8 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:22.181287 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-d4d134f0-4a7f-4a2e-8191-612c0b28dcb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:22.205286 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d134f0-4a7f-4a2e-8191-612c0b28dcb8 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:22.222017 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bfc363-5229-4063-a95b-a01e22f87d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:22.223122 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bfc363-5229-4063-a95b-a01e22f87d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:22.223413 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bfc363-5229-4063-a95b-a01e22f87d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:22.223687 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bfc363-5229-4063-a95b-a01e22f87d48 admin admin] PATH_INFO: `/v3/projects/8e7207ffbad641a3a46e1d7fa10d9d1f` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:22.225465 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bfc363-5229-4063-a95b-a01e22f87d48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e7207ffbad641a3a46e1d7fa10d9d1f)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:22.230762 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bfc363-5229-4063-a95b-a01e22f87d48 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:22.345807 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:22.359706 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4c0dc-2896-4bc0-92e2-3884852ed713 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:22.360257 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4c0dc-2896-4bc0-92e2-3884852ed713 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:22.360805 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4c0dc-2896-4bc0-92e2-3884852ed713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:22.403458 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-48b4c0dc-2896-4bc0-92e2-3884852ed713 None None] MFA Rules not processed for user `5c040dc8d3434d8e8b4b09d572e64333`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:22.405151 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-48b4c0dc-2896-4bc0-92e2-3884852ed713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:22.430716 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a4bfc363-5229-4063-a95b-a01e22f87d48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e7207ffbad641a3a46e1d7fa10d9d1f', 'request_id': 'req-a4bfc363-5229-4063-a95b-a01e22f87d48'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:22.443870 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a4bfc363-5229-4063-a95b-a01e22f87d48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e7207ffbad641a3a46e1d7fa10d9d1f', 'request_id': 'req-a4bfc363-5229-4063-a95b-a01e22f87d48'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:22.455502 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a4bfc363-5229-4063-a95b-a01e22f87d48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e7207ffbad641a3a46e1d7fa10d9d1f', 'request_id': 'req-a4bfc363-5229-4063-a95b-a01e22f87d48'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:22.521643 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1026/2069] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:22 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:22.532352 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c00cab-58ca-4aa5-abc0-eb3008ebc3f3 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:22.535759 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c00cab-58ca-4aa5-abc0-eb3008ebc3f3 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:22.536206 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c00cab-58ca-4aa5-abc0-eb3008ebc3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:22.537341 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a4bfc363-5229-4063-a95b-a01e22f87d48 admin admin] The token cache is being invalidate because project 8e7207ffbad641a3a46e1d7fa10d9d1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:07:22.537819 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a4bfc363-5229-4063-a95b-a01e22f87d48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:22.540174 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a4bfc363-5229-4063-a95b-a01e22f87d48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:22.546885 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:22.551340 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1044/2070] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:07:22 2022] DELETE /identity/v3/projects/8e7207ffbad641a3a46e1d7fa10d9d1f => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:22.551340 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bfc363-5229-4063-a95b-a01e22f87d48 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:22.552382 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a4bfc363-5229-4063-a95b-a01e22f87d48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:22.558325 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-38c00cab-58ca-4aa5-abc0-eb3008ebc3f3 None None] MFA Rules not processed for user `0908feda0c8645eea9ec7021db1d2add`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:22.559681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-38c00cab-58ca-4aa5-abc0-eb3008ebc3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:22.669190 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1027/2071] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:07:22.679788 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c00cab-58ca-4aa5-abc0-eb3008ebc3f3 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:22.681395 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-38c00cab-58ca-4aa5-abc0-eb3008ebc3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:22.727843 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bfc363-5229-4063-a95b-a01e22f87d48 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:22.735254 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897eba3a-301a-4b87-8da3-172fb3e52126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:22.736511 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897eba3a-301a-4b87-8da3-172fb3e52126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:22.736805 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897eba3a-301a-4b87-8da3-172fb3e52126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:22.737087 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897eba3a-301a-4b87-8da3-172fb3e52126 admin admin] PATH_INFO: `/v3/users/ed10d762d39041dd9bd4c871c0437b12` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:22.738413 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897eba3a-301a-4b87-8da3-172fb3e52126 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed10d762d39041dd9bd4c871c0437b12)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:22.740934 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897eba3a-301a-4b87-8da3-172fb3e52126 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:22.831596 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c00cab-58ca-4aa5-abc0-eb3008ebc3f3 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:22.837536 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b28d1d-5285-4062-891b-f34f7e6650e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:22.838201 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b28d1d-5285-4062-891b-f34f7e6650e8 service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:22.838201 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b28d1d-5285-4062-891b-f34f7e6650e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:22.838951 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b28d1d-5285-4062-891b-f34f7e6650e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:22.841533 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d0b28d1d-5285-4062-891b-f34f7e6650e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:22.854632 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b28d1d-5285-4062-891b-f34f7e6650e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:22.856139 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b28d1d-5285-4062-891b-f34f7e6650e8 service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:22.865932 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1028/2072] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:07:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 21:07:23.009257 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-897eba3a-301a-4b87-8da3-172fb3e52126 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed10d762d39041dd9bd4c871c0437b12'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:23.017523 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-897eba3a-301a-4b87-8da3-172fb3e52126 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed10d762d39041dd9bd4c871c0437b12'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:23.018319 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-897eba3a-301a-4b87-8da3-172fb3e52126 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed10d762d39041dd9bd4c871c0437b12'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:23.019016 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-897eba3a-301a-4b87-8da3-172fb3e52126 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed10d762d39041dd9bd4c871c0437b12'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:23.139037 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-897eba3a-301a-4b87-8da3-172fb3e52126 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed10d762d39041dd9bd4c871c0437b12'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:23.163370 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1045/2073] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:07:22 2022] DELETE /identity/v3/users/ed10d762d39041dd9bd4c871c0437b12 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:23.738712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:23.934356 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:24.238517 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b28d1d-5285-4062-891b-f34f7e6650e8 service nova] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:24.255392 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b28d1d-5285-4062-891b-f34f7e6650e8 service nova] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:24.337092 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a16a73-e8ae-43f5-ae29-30dba5bb50bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:24.338070 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a16a73-e8ae-43f5-ae29-30dba5bb50bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:24.338588 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a16a73-e8ae-43f5-ae29-30dba5bb50bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:24.339176 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a16a73-e8ae-43f5-ae29-30dba5bb50bf admin admin] PATH_INFO: `/v3/projects/be1e1580df284597b89035beabbd0aae` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:24.341028 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a16a73-e8ae-43f5-ae29-30dba5bb50bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=be1e1580df284597b89035beabbd0aae)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:24.343225 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a16a73-e8ae-43f5-ae29-30dba5bb50bf admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:24.501762 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-38a16a73-e8ae-43f5-ae29-30dba5bb50bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be1e1580df284597b89035beabbd0aae', 'request_id': 'req-38a16a73-e8ae-43f5-ae29-30dba5bb50bf'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:24.508459 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-38a16a73-e8ae-43f5-ae29-30dba5bb50bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be1e1580df284597b89035beabbd0aae', 'request_id': 'req-38a16a73-e8ae-43f5-ae29-30dba5bb50bf'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:24.526364 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-38a16a73-e8ae-43f5-ae29-30dba5bb50bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be1e1580df284597b89035beabbd0aae', 'request_id': 'req-38a16a73-e8ae-43f5-ae29-30dba5bb50bf'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:24.641713 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-38a16a73-e8ae-43f5-ae29-30dba5bb50bf admin admin] The token cache is being invalidate because project be1e1580df284597b89035beabbd0aae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:07:24.642081 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-38a16a73-e8ae-43f5-ae29-30dba5bb50bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:24.642849 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-38a16a73-e8ae-43f5-ae29-30dba5bb50bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:24.644660 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1029/2074] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:07:24 2022] DELETE /identity/v3/projects/be1e1580df284597b89035beabbd0aae => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:24.650216 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719fca5-7850-464a-bcab-3f24b20e7204 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:24.650595 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719fca5-7850-464a-bcab-3f24b20e7204 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:24.651534 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719fca5-7850-464a-bcab-3f24b20e7204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:24.678823 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-3719fca5-7850-464a-bcab-3f24b20e7204 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:24.680608 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-3719fca5-7850-464a-bcab-3f24b20e7204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:24.815545 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1046/2075] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:24.828726 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583b1ed-85d7-4529-a3ca-923b5cc86a7d None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:24.829023 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583b1ed-85d7-4529-a3ca-923b5cc86a7d None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:24.829309 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583b1ed-85d7-4529-a3ca-923b5cc86a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:24.883521 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-5583b1ed-85d7-4529-a3ca-923b5cc86a7d None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:24.887861 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-5583b1ed-85d7-4529-a3ca-923b5cc86a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:24.911187 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1030/2076] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:24.915476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719fca5-7850-464a-bcab-3f24b20e7204 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:24.941629 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719fca5-7850-464a-bcab-3f24b20e7204 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:24.954760 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5ae85-0d58-4645-87c3-91d87e163164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:24.955916 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5ae85-0d58-4645-87c3-91d87e163164 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:24.956448 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5ae85-0d58-4645-87c3-91d87e163164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:24.957546 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5ae85-0d58-4645-87c3-91d87e163164 admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:24.965038 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba5ae85-0d58-4645-87c3-91d87e163164 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:07:24.965802 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba5ae85-0d58-4645-87c3-91d87e163164 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:24.970743 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba5ae85-0d58-4645-87c3-91d87e163164 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:24.997744 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1047/2077] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:07:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:07:25.001055 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583b1ed-85d7-4529-a3ca-923b5cc86a7d None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:25.020372 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583b1ed-85d7-4529-a3ca-923b5cc86a7d None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:25.025335 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed502ec-e9a1-463a-953c-309222ce7881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:25.029022 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed502ec-e9a1-463a-953c-309222ce7881 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:25.029022 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed502ec-e9a1-463a-953c-309222ce7881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:25.029022 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed502ec-e9a1-463a-953c-309222ce7881 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:25.029022 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed502ec-e9a1-463a-953c-309222ce7881 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:25.030374 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed502ec-e9a1-463a-953c-309222ce7881 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:25.171997 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1031/2078] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:07:24 2022] POST /identity/v3/projects => generated 385 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 21:07:25.173595 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5ae85-0d58-4645-87c3-91d87e163164 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:25.184617 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5ae85-0d58-4645-87c3-91d87e163164 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:25.245629 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8325084-2d30-4d36-9058-82c4e122d1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:25.246505 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8325084-2d30-4d36-9058-82c4e122d1f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:25.246797 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8325084-2d30-4d36-9058-82c4e122d1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:25.247081 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8325084-2d30-4d36-9058-82c4e122d1f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:25.247849 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8325084-2d30-4d36-9058-82c4e122d1f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:25.249966 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8325084-2d30-4d36-9058-82c4e122d1f3 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:25.374463 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1048/2079] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:07:25 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:07:25.378641 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed502ec-e9a1-463a-953c-309222ce7881 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:25.390311 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed502ec-e9a1-463a-953c-309222ce7881 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:25.397763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6dffdc-0839-4c88-a297-a112401c1338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:25.398411 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6dffdc-0839-4c88-a297-a112401c1338 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:25.398718 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6dffdc-0839-4c88-a297-a112401c1338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:25.399036 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6dffdc-0839-4c88-a297-a112401c1338 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:25.399696 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6dffdc-0839-4c88-a297-a112401c1338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:25.402320 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6dffdc-0839-4c88-a297-a112401c1338 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:25.418856 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1032/2080] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:07:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 21:07:25.419867 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8325084-2d30-4d36-9058-82c4e122d1f3 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:25.437856 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8325084-2d30-4d36-9058-82c4e122d1f3 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:25.442588 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6d3fa-14f0-43fb-ae44-84e2cd5cb63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:25.443420 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6d3fa-14f0-43fb-ae44-84e2cd5cb63f admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:25.443819 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6d3fa-14f0-43fb-ae44-84e2cd5cb63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:25.444054 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6d3fa-14f0-43fb-ae44-84e2cd5cb63f admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:25.445173 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6d3fa-14f0-43fb-ae44-84e2cd5cb63f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:25.455176 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6d3fa-14f0-43fb-ae44-84e2cd5cb63f admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:25.484840 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1049/2081] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:07:25 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:07:25.496589 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6dffdc-0839-4c88-a297-a112401c1338 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:25.516069 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6dffdc-0839-4c88-a297-a112401c1338 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:25.521570 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56920c24-f733-4ecc-b445-baac1491681a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:25.525270 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56920c24-f733-4ecc-b445-baac1491681a admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:25.525270 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56920c24-f733-4ecc-b445-baac1491681a admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:25.525270 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56920c24-f733-4ecc-b445-baac1491681a admin admin] PATH_INFO: `/v3/projects/3eedf11923b640c08de37b3e369828f7/users/fd5a56337c2a436291e5928078463ba0/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:25.552697 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56920c24-f733-4ecc-b445-baac1491681a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eedf11923b640c08de37b3e369828f7, user_id=fd5a56337c2a436291e5928078463ba0, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:25.556641 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56920c24-f733-4ecc-b445-baac1491681a admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:25.664039 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1033/2082] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:07:25 2022] PUT /identity/v3/projects/3eedf11923b640c08de37b3e369828f7/users/fd5a56337c2a436291e5928078463ba0/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:25.677687 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70242741-eba6-40b0-94d5-d9e6324551cd None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:25.677991 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70242741-eba6-40b0-94d5-d9e6324551cd None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:25.678275 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70242741-eba6-40b0-94d5-d9e6324551cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:25.685074 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:25.725094 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-70242741-eba6-40b0-94d5-d9e6324551cd None None] MFA Rules not processed for user `fd5a56337c2a436291e5928078463ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:25.728001 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-70242741-eba6-40b0-94d5-d9e6324551cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:25.807690 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1050/2083] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:25.820629 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56920c24-f733-4ecc-b445-baac1491681a admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:25.822483 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-56920c24-f733-4ecc-b445-baac1491681a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:25.854803 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70242741-eba6-40b0-94d5-d9e6324551cd None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:25.862059 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-70242741-eba6-40b0-94d5-d9e6324551cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:25.904535 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56920c24-f733-4ecc-b445-baac1491681a admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:25.911000 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:25.914313 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5790745-15c2-4c03-b6b6-ffb8d00b8dc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:25.916297 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5790745-15c2-4c03-b6b6-ffb8d00b8dc1 service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:25.917109 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5790745-15c2-4c03-b6b6-ffb8d00b8dc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:25.917440 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5790745-15c2-4c03-b6b6-ffb8d00b8dc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:25.929585 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5790745-15c2-4c03-b6b6-ffb8d00b8dc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:25.931458 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5790745-15c2-4c03-b6b6-ffb8d00b8dc1 service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:25.942492 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1034/2084] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:07:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:07:25.959126 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70242741-eba6-40b0-94d5-d9e6324551cd None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:25.964356 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67591ac-13eb-4515-a18f-68a5fae0d27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:25.965261 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67591ac-13eb-4515-a18f-68a5fae0d27d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:25.965547 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67591ac-13eb-4515-a18f-68a5fae0d27d admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:25.965822 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67591ac-13eb-4515-a18f-68a5fae0d27d admin admin] PATH_INFO: `/v3/users/979d4af26ce14a2b952908e5ac3062f0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:25.967033 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67591ac-13eb-4515-a18f-68a5fae0d27d admin admin] RBAC: Authorizing `identity:delete_user(user_id=979d4af26ce14a2b952908e5ac3062f0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:25.968998 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67591ac-13eb-4515-a18f-68a5fae0d27d admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:26.216429 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-c67591ac-13eb-4515-a18f-68a5fae0d27d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '979d4af26ce14a2b952908e5ac3062f0'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:26.223325 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-c67591ac-13eb-4515-a18f-68a5fae0d27d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '979d4af26ce14a2b952908e5ac3062f0'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:26.224209 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-c67591ac-13eb-4515-a18f-68a5fae0d27d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '979d4af26ce14a2b952908e5ac3062f0'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:26.224834 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-c67591ac-13eb-4515-a18f-68a5fae0d27d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '979d4af26ce14a2b952908e5ac3062f0'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:26.313279 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-c67591ac-13eb-4515-a18f-68a5fae0d27d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '979d4af26ce14a2b952908e5ac3062f0'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:26.331246 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1051/2085] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:07:25 2022] DELETE /identity/v3/users/979d4af26ce14a2b952908e5ac3062f0 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:26.585455 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5790745-15c2-4c03-b6b6-ffb8d00b8dc1 service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:26.586948 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-f5790745-15c2-4c03-b6b6-ffb8d00b8dc1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:26.601020 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67591ac-13eb-4515-a18f-68a5fae0d27d admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:26.604358 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-c67591ac-13eb-4515-a18f-68a5fae0d27d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:26.610057 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5790745-15c2-4c03-b6b6-ffb8d00b8dc1 service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:26.733831 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67591ac-13eb-4515-a18f-68a5fae0d27d admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:26.742479 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75272e03-319f-4b72-964b-2dfd55037c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:26.743701 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75272e03-319f-4b72-964b-2dfd55037c93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:26.744193 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75272e03-319f-4b72-964b-2dfd55037c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:26.744901 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75272e03-319f-4b72-964b-2dfd55037c93 admin admin] PATH_INFO: `/v3/projects/cf0b76e26f5e448f8d51b55dd2132cf7` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:26.748029 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75272e03-319f-4b72-964b-2dfd55037c93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf0b76e26f5e448f8d51b55dd2132cf7)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:26.749179 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75272e03-319f-4b72-964b-2dfd55037c93 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:26.756521 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b8abe-4622-46ee-981a-6d6ef9c4a63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:26.757359 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b8abe-4622-46ee-981a-6d6ef9c4a63d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:26.757647 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b8abe-4622-46ee-981a-6d6ef9c4a63d admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:26.757928 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b8abe-4622-46ee-981a-6d6ef9c4a63d admin admin] PATH_INFO: `/v3/users/9c683169e3484e83b7dff7a72f113766` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:26.759879 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4b8abe-4622-46ee-981a-6d6ef9c4a63d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c683169e3484e83b7dff7a72f113766)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:26.763849 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4b8abe-4622-46ee-981a-6d6ef9c4a63d admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:26.795754 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:26.984983 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-0d4b8abe-4622-46ee-981a-6d6ef9c4a63d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c683169e3484e83b7dff7a72f113766'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:26.986981 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-75272e03-319f-4b72-964b-2dfd55037c93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf0b76e26f5e448f8d51b55dd2132cf7', 'request_id': 'req-75272e03-319f-4b72-964b-2dfd55037c93'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:26.992808 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-0d4b8abe-4622-46ee-981a-6d6ef9c4a63d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c683169e3484e83b7dff7a72f113766'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:26.993863 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-0d4b8abe-4622-46ee-981a-6d6ef9c4a63d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c683169e3484e83b7dff7a72f113766'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:26.994062 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-75272e03-319f-4b72-964b-2dfd55037c93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf0b76e26f5e448f8d51b55dd2132cf7', 'request_id': 'req-75272e03-319f-4b72-964b-2dfd55037c93'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:26.994945 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-0d4b8abe-4622-46ee-981a-6d6ef9c4a63d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c683169e3484e83b7dff7a72f113766'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:27.001277 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-75272e03-319f-4b72-964b-2dfd55037c93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf0b76e26f5e448f8d51b55dd2132cf7', 'request_id': 'req-75272e03-319f-4b72-964b-2dfd55037c93'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:27.107753 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-0d4b8abe-4622-46ee-981a-6d6ef9c4a63d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c683169e3484e83b7dff7a72f113766'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:27.126413 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1035/2086] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:07:26 2022] DELETE /identity/v3/users/9c683169e3484e83b7dff7a72f113766 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:27.131223 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f0923-90bf-48f6-940b-c721bbeae747 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:27.131955 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f0923-90bf-48f6-940b-c721bbeae747 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:27.132661 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f0923-90bf-48f6-940b-c721bbeae747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:27.154983 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-e62f0923-90bf-48f6-940b-c721bbeae747 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:27.156354 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-e62f0923-90bf-48f6-940b-c721bbeae747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:27.231012 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-75272e03-319f-4b72-964b-2dfd55037c93 admin admin] The token cache is being invalidate because project cf0b76e26f5e448f8d51b55dd2132cf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:07:27.232658 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-75272e03-319f-4b72-964b-2dfd55037c93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:27.232658 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-75272e03-319f-4b72-964b-2dfd55037c93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:27.234885 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1052/2087] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:07:26 2022] DELETE /identity/v3/projects/cf0b76e26f5e448f8d51b55dd2132cf7 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:27.239478 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ee1b4-a2b0-438b-938f-c49bab5193d8 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:27.239773 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ee1b4-a2b0-438b-938f-c49bab5193d8 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:27.240087 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ee1b4-a2b0-438b-938f-c49bab5193d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:27.252177 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1036/2088] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:07:27.260749 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f0923-90bf-48f6-940b-c721bbeae747 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:27.262424 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-e62f0923-90bf-48f6-940b-c721bbeae747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:27.269316 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-d07ee1b4-a2b0-438b-938f-c49bab5193d8 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:27.271172 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-d07ee1b4-a2b0-438b-938f-c49bab5193d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:27.286457 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1053/2089] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:27.295343 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340e5f4-defc-4e8c-a571-b155ff76f559 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:27.295636 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340e5f4-defc-4e8c-a571-b155ff76f559 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:27.295913 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340e5f4-defc-4e8c-a571-b155ff76f559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:27.317044 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-a340e5f4-defc-4e8c-a571-b155ff76f559 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:27.318208 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a340e5f4-defc-4e8c-a571-b155ff76f559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:27.326934 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1054/2090] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:07:27.331048 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a340e5f4-defc-4e8c-a571-b155ff76f559 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:27.338068 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f0923-90bf-48f6-940b-c721bbeae747 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:27.340113 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a340e5f4-defc-4e8c-a571-b155ff76f559 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:27.342625 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caeee98-f183-44bd-81c3-f4325433fca4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:27.343283 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caeee98-f183-44bd-81c3-f4325433fca4 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:27.343569 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caeee98-f183-44bd-81c3-f4325433fca4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:27.343847 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caeee98-f183-44bd-81c3-f4325433fca4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:27.345024 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55746601-0ee1-44fd-9bd7-e7fc50943053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:27.345748 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55746601-0ee1-44fd-9bd7-e7fc50943053 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:27.346291 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55746601-0ee1-44fd-9bd7-e7fc50943053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:27.346548 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55746601-0ee1-44fd-9bd7-e7fc50943053 admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:27.347373 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55746601-0ee1-44fd-9bd7-e7fc50943053 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:07:27.347689 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55746601-0ee1-44fd-9bd7-e7fc50943053 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:27.349487 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55746601-0ee1-44fd-9bd7-e7fc50943053 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:27.355040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caeee98-f183-44bd-81c3-f4325433fca4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:27.356334 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caeee98-f183-44bd-81c3-f4325433fca4 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:27.364410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1055/2091] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:07:27.367311 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55746601-0ee1-44fd-9bd7-e7fc50943053 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:27.370904 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1037/2092] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:07:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:07:27.378119 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55746601-0ee1-44fd-9bd7-e7fc50943053 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:27.382982 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad56a4a-e4a7-4a7f-972a-613bd45aa3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:27.383735 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad56a4a-e4a7-4a7f-972a-613bd45aa3cd admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:27.384046 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad56a4a-e4a7-4a7f-972a-613bd45aa3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:27.389689 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad56a4a-e4a7-4a7f-972a-613bd45aa3cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:27.389689 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad56a4a-e4a7-4a7f-972a-613bd45aa3cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:27.389689 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad56a4a-e4a7-4a7f-972a-613bd45aa3cd admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:27.484012 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1056/2093] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:07:27 2022] POST /identity/v3/projects => generated 367 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 21:07:27.487259 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caeee98-f183-44bd-81c3-f4325433fca4 service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:27.497813 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caeee98-f183-44bd-81c3-f4325433fca4 service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:27.555326 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393df0d4-91da-4fa9-9171-93ba8580fce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:27.556035 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393df0d4-91da-4fa9-9171-93ba8580fce9 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:27.556324 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393df0d4-91da-4fa9-9171-93ba8580fce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:27.556602 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393df0d4-91da-4fa9-9171-93ba8580fce9 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:27.557941 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393df0d4-91da-4fa9-9171-93ba8580fce9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:27.560176 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393df0d4-91da-4fa9-9171-93ba8580fce9 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:27.673205 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1038/2094] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:07:27 2022] POST /identity/v3/users => generated 284 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:07:27.677344 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad56a4a-e4a7-4a7f-972a-613bd45aa3cd admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:27.689787 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad56a4a-e4a7-4a7f-972a-613bd45aa3cd admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:27.694714 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce0989-6f5d-4498-8d66-2e41b19d01b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:27.695455 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce0989-6f5d-4498-8d66-2e41b19d01b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:27.695747 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce0989-6f5d-4498-8d66-2e41b19d01b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:27.697448 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce0989-6f5d-4498-8d66-2e41b19d01b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:27.697448 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ce0989-6f5d-4498-8d66-2e41b19d01b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:27.698653 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ce0989-6f5d-4498-8d66-2e41b19d01b8 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:27.720674 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1057/2095] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:07:27.724540 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393df0d4-91da-4fa9-9171-93ba8580fce9 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:27.741460 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393df0d4-91da-4fa9-9171-93ba8580fce9 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:27.744646 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:27.749923 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5cb0a-46b0-4de2-8e3f-adcb5aac718c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:27.750730 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5cb0a-46b0-4de2-8e3f-adcb5aac718c admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:27.751051 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5cb0a-46b0-4de2-8e3f-adcb5aac718c admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:27.751384 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5cb0a-46b0-4de2-8e3f-adcb5aac718c admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:27.752270 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f5cb0a-46b0-4de2-8e3f-adcb5aac718c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:27.754210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f5cb0a-46b0-4de2-8e3f-adcb5aac718c admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:27.767736 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1039/2096] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:07:27.772310 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce0989-6f5d-4498-8d66-2e41b19d01b8 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:27.783666 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce0989-6f5d-4498-8d66-2e41b19d01b8 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:27.788580 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4104ac3-c883-4ae8-ad51-4dfb4000e7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:27.789497 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4104ac3-c883-4ae8-ad51-4dfb4000e7e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:27.789787 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4104ac3-c883-4ae8-ad51-4dfb4000e7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:27.790069 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4104ac3-c883-4ae8-ad51-4dfb4000e7e4 admin admin] PATH_INFO: `/v3/projects/485e3f1ec5fa4834b2304680a212a0ed/users/5dcdb038617f41b4a9eb096b92786dcf/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:27.809922 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4104ac3-c883-4ae8-ad51-4dfb4000e7e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=485e3f1ec5fa4834b2304680a212a0ed, user_id=5dcdb038617f41b4a9eb096b92786dcf, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:27.813018 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4104ac3-c883-4ae8-ad51-4dfb4000e7e4 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:27.855404 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5cb0a-46b0-4de2-8e3f-adcb5aac718c admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:27.857364 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c8f5cb0a-46b0-4de2-8e3f-adcb5aac718c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:27.872135 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5cb0a-46b0-4de2-8e3f-adcb5aac718c admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:27.877927 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62d439-0e6a-43b0-b39a-0b6cf8460121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:27.879134 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62d439-0e6a-43b0-b39a-0b6cf8460121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:27.879613 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62d439-0e6a-43b0-b39a-0b6cf8460121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:27.880084 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62d439-0e6a-43b0-b39a-0b6cf8460121 admin admin] PATH_INFO: `/v3/projects/54d89fac5cd24cf4908d44961b8ca357` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:27.881608 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62d439-0e6a-43b0-b39a-0b6cf8460121 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54d89fac5cd24cf4908d44961b8ca357)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:27.884546 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62d439-0e6a-43b0-b39a-0b6cf8460121 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:27.909011 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1058/2097] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:07:27 2022] PUT /identity/v3/projects/485e3f1ec5fa4834b2304680a212a0ed/users/5dcdb038617f41b4a9eb096b92786dcf/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:27.920462 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76fcd9-a2b0-4b06-99b1-8823ca151681 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:27.920920 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76fcd9-a2b0-4b06-99b1-8823ca151681 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:27.921201 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76fcd9-a2b0-4b06-99b1-8823ca151681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:27.950437 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-0b76fcd9-a2b0-4b06-99b1-8823ca151681 None None] MFA Rules not processed for user `5dcdb038617f41b4a9eb096b92786dcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:27.951868 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-0b76fcd9-a2b0-4b06-99b1-8823ca151681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:28.021763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-ec62d439-0e6a-43b0-b39a-0b6cf8460121 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54d89fac5cd24cf4908d44961b8ca357', 'request_id': 'req-ec62d439-0e6a-43b0-b39a-0b6cf8460121'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:28.027196 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1059/2098] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:27 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:28.031208 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-ec62d439-0e6a-43b0-b39a-0b6cf8460121 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54d89fac5cd24cf4908d44961b8ca357', 'request_id': 'req-ec62d439-0e6a-43b0-b39a-0b6cf8460121'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:28.037719 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-ec62d439-0e6a-43b0-b39a-0b6cf8460121 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54d89fac5cd24cf4908d44961b8ca357', 'request_id': 'req-ec62d439-0e6a-43b0-b39a-0b6cf8460121'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:28.037963 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76fcd9-a2b0-4b06-99b1-8823ca151681 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:28.039375 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-0b76fcd9-a2b0-4b06-99b1-8823ca151681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:28.098733 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76fcd9-a2b0-4b06-99b1-8823ca151681 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:28.127330 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-ec62d439-0e6a-43b0-b39a-0b6cf8460121 admin admin] The token cache is being invalidate because project 54d89fac5cd24cf4908d44961b8ca357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:07:28.127629 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-ec62d439-0e6a-43b0-b39a-0b6cf8460121 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:28.129423 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-ec62d439-0e6a-43b0-b39a-0b6cf8460121 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:28.131190 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1040/2099] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:07:27 2022] DELETE /identity/v3/projects/54d89fac5cd24cf4908d44961b8ca357 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:07:28.135926 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62d439-0e6a-43b0-b39a-0b6cf8460121 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:28.138638 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-ec62d439-0e6a-43b0-b39a-0b6cf8460121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:28.168955 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614fdb7-e6c3-40ef-90c7-6efb5297adc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:28.169734 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614fdb7-e6c3-40ef-90c7-6efb5297adc3 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:28.170085 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614fdb7-e6c3-40ef-90c7-6efb5297adc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:28.171063 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614fdb7-e6c3-40ef-90c7-6efb5297adc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:28.173531 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-5614fdb7-e6c3-40ef-90c7-6efb5297adc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:28.224684 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62d439-0e6a-43b0-b39a-0b6cf8460121 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:28.231545 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21ec2e-e5db-4279-a625-f1ba387e89c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:28.233110 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21ec2e-e5db-4279-a625-f1ba387e89c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:28.233432 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21ec2e-e5db-4279-a625-f1ba387e89c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:28.233622 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21ec2e-e5db-4279-a625-f1ba387e89c3 admin admin] PATH_INFO: `/v3/users/c9cc30a6796c4f9eab871b7d5ff80ae0` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:28.235207 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21ec2e-e5db-4279-a625-f1ba387e89c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9cc30a6796c4f9eab871b7d5ff80ae0)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:28.237246 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21ec2e-e5db-4279-a625-f1ba387e89c3 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:28.277728 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614fdb7-e6c3-40ef-90c7-6efb5297adc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:28.279217 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614fdb7-e6c3-40ef-90c7-6efb5297adc3 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:28.288937 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1060/2100] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:07:28 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 21:07:28.465054 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-7d21ec2e-e5db-4279-a625-f1ba387e89c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9cc30a6796c4f9eab871b7d5ff80ae0'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:28.471872 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-7d21ec2e-e5db-4279-a625-f1ba387e89c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9cc30a6796c4f9eab871b7d5ff80ae0'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:28.472778 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-7d21ec2e-e5db-4279-a625-f1ba387e89c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9cc30a6796c4f9eab871b7d5ff80ae0'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:28.473608 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-7d21ec2e-e5db-4279-a625-f1ba387e89c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9cc30a6796c4f9eab871b7d5ff80ae0'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:28.567477 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-7d21ec2e-e5db-4279-a625-f1ba387e89c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9cc30a6796c4f9eab871b7d5ff80ae0'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:28.601267 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1041/2101] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:07:28 2022] DELETE /identity/v3/users/c9cc30a6796c4f9eab871b7d5ff80ae0 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:07:28.652946 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:29.025335 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614fdb7-e6c3-40ef-90c7-6efb5297adc3 service cinder] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:29.044537 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614fdb7-e6c3-40ef-90c7-6efb5297adc3 service cinder] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:29.142499 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c99cf6-590a-4e54-947b-fc1c0cb23c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:29.143585 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c99cf6-590a-4e54-947b-fc1c0cb23c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:29.143954 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c99cf6-590a-4e54-947b-fc1c0cb23c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:29.144433 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c99cf6-590a-4e54-947b-fc1c0cb23c4f admin admin] PATH_INFO: `/v3/projects/1c3bfaf786c64a82937be5cedce4957c` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:29.145773 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c99cf6-590a-4e54-947b-fc1c0cb23c4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c3bfaf786c64a82937be5cedce4957c)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:29.148469 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c99cf6-590a-4e54-947b-fc1c0cb23c4f admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:29.295394 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-55c99cf6-590a-4e54-947b-fc1c0cb23c4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c3bfaf786c64a82937be5cedce4957c', 'request_id': 'req-55c99cf6-590a-4e54-947b-fc1c0cb23c4f'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:29.303499 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-55c99cf6-590a-4e54-947b-fc1c0cb23c4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c3bfaf786c64a82937be5cedce4957c', 'request_id': 'req-55c99cf6-590a-4e54-947b-fc1c0cb23c4f'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:29.311548 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-55c99cf6-590a-4e54-947b-fc1c0cb23c4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c3bfaf786c64a82937be5cedce4957c', 'request_id': 'req-55c99cf6-590a-4e54-947b-fc1c0cb23c4f'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:29.399170 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-55c99cf6-590a-4e54-947b-fc1c0cb23c4f admin admin] The token cache is being invalidate because project 1c3bfaf786c64a82937be5cedce4957c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:07:29.399551 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-55c99cf6-590a-4e54-947b-fc1c0cb23c4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:29.400385 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-55c99cf6-590a-4e54-947b-fc1c0cb23c4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:29.402075 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1061/2102] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:07:29 2022] DELETE /identity/v3/projects/1c3bfaf786c64a82937be5cedce4957c => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:29.406349 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21ec2e-e5db-4279-a625-f1ba387e89c3 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:29.410069 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-7d21ec2e-e5db-4279-a625-f1ba387e89c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:29.423753 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21ec2e-e5db-4279-a625-f1ba387e89c3 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:29.492928 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce19e74-e563-4209-b613-deb0370ff1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:29.493831 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce19e74-e563-4209-b613-deb0370ff1bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:29.494374 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce19e74-e563-4209-b613-deb0370ff1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:29.494485 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce19e74-e563-4209-b613-deb0370ff1bf admin admin] PATH_INFO: `/v3/users/a5f26738138a405aae7d201df3c6c952` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:29.496573 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce19e74-e563-4209-b613-deb0370ff1bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5f26738138a405aae7d201df3c6c952)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:29.500344 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce19e74-e563-4209-b613-deb0370ff1bf admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:29.548230 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:29.736434 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-4ce19e74-e563-4209-b613-deb0370ff1bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5f26738138a405aae7d201df3c6c952'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:29.746727 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-4ce19e74-e563-4209-b613-deb0370ff1bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5f26738138a405aae7d201df3c6c952'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:29.747523 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-4ce19e74-e563-4209-b613-deb0370ff1bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5f26738138a405aae7d201df3c6c952'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:29.748294 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-4ce19e74-e563-4209-b613-deb0370ff1bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5f26738138a405aae7d201df3c6c952'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:29.821982 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-4ce19e74-e563-4209-b613-deb0370ff1bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5f26738138a405aae7d201df3c6c952'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:29.841658 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1042/2103] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:07:29 2022] DELETE /identity/v3/users/a5f26738138a405aae7d201df3c6c952 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:30.321501 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:30.529876 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c99cf6-590a-4e54-947b-fc1c0cb23c4f admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:30.531454 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-55c99cf6-590a-4e54-947b-fc1c0cb23c4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:30.545969 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c99cf6-590a-4e54-947b-fc1c0cb23c4f admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:30.615318 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c375dbd-e8d0-47bc-8f14-5d3a29bb6f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:30.616239 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c375dbd-e8d0-47bc-8f14-5d3a29bb6f69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:30.616533 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c375dbd-e8d0-47bc-8f14-5d3a29bb6f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:30.616815 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c375dbd-e8d0-47bc-8f14-5d3a29bb6f69 admin admin] PATH_INFO: `/v3/projects/9e8aef1470ad43f18f656530cdedc8f9` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:30.618039 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c375dbd-e8d0-47bc-8f14-5d3a29bb6f69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e8aef1470ad43f18f656530cdedc8f9)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:30.620083 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c375dbd-e8d0-47bc-8f14-5d3a29bb6f69 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:30.982677 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-4c375dbd-e8d0-47bc-8f14-5d3a29bb6f69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e8aef1470ad43f18f656530cdedc8f9', 'request_id': 'req-4c375dbd-e8d0-47bc-8f14-5d3a29bb6f69'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:30.982677 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-4c375dbd-e8d0-47bc-8f14-5d3a29bb6f69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e8aef1470ad43f18f656530cdedc8f9', 'request_id': 'req-4c375dbd-e8d0-47bc-8f14-5d3a29bb6f69'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:30.982677 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-4c375dbd-e8d0-47bc-8f14-5d3a29bb6f69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e8aef1470ad43f18f656530cdedc8f9', 'request_id': 'req-4c375dbd-e8d0-47bc-8f14-5d3a29bb6f69'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:31.023282 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-4c375dbd-e8d0-47bc-8f14-5d3a29bb6f69 admin admin] The token cache is being invalidate because project 9e8aef1470ad43f18f656530cdedc8f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:07:31.023282 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-4c375dbd-e8d0-47bc-8f14-5d3a29bb6f69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:31.025229 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-4c375dbd-e8d0-47bc-8f14-5d3a29bb6f69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:31.032595 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1062/2104] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:07:30 2022] DELETE /identity/v3/projects/9e8aef1470ad43f18f656530cdedc8f9 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:31.034373 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af7525-6a29-4cb3-9ce3-617b1fd25edd None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:31.034845 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af7525-6a29-4cb3-9ce3-617b1fd25edd None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:31.034939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af7525-6a29-4cb3-9ce3-617b1fd25edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:31.054492 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-c5af7525-6a29-4cb3-9ce3-617b1fd25edd None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:31.055825 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c5af7525-6a29-4cb3-9ce3-617b1fd25edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:31.118255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1043/2105] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:31.127993 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282a2ee-2a6c-4772-8f57-18cd01c17072 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:31.128311 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282a2ee-2a6c-4772-8f57-18cd01c17072 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:31.128623 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282a2ee-2a6c-4772-8f57-18cd01c17072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:31.148229 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-a282a2ee-2a6c-4772-8f57-18cd01c17072 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:31.149449 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a282a2ee-2a6c-4772-8f57-18cd01c17072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:31.158507 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1063/2106] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:31.163149 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af7525-6a29-4cb3-9ce3-617b1fd25edd None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:31.174129 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af7525-6a29-4cb3-9ce3-617b1fd25edd None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:31.178936 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737def8e-b46c-43db-9ed0-8a279c24407c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:31.179612 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737def8e-b46c-43db-9ed0-8a279c24407c admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:31.179907 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737def8e-b46c-43db-9ed0-8a279c24407c admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:31.180215 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737def8e-b46c-43db-9ed0-8a279c24407c admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:31.180969 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737def8e-b46c-43db-9ed0-8a279c24407c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:07:31.181283 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737def8e-b46c-43db-9ed0-8a279c24407c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:31.184133 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737def8e-b46c-43db-9ed0-8a279c24407c admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:31.200991 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1044/2107] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:07:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:07:31.202345 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282a2ee-2a6c-4772-8f57-18cd01c17072 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:31.214388 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282a2ee-2a6c-4772-8f57-18cd01c17072 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:31.220278 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f91e23-f573-4168-920a-16c71084734b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:31.222474 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f91e23-f573-4168-920a-16c71084734b admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:31.222474 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f91e23-f573-4168-920a-16c71084734b admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:31.222474 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f91e23-f573-4168-920a-16c71084734b admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:31.222474 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f91e23-f573-4168-920a-16c71084734b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:31.224210 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f91e23-f573-4168-920a-16c71084734b admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:31.378994 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1064/2108] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:07:31 2022] POST /identity/v3/projects => generated 385 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:07:31.380707 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737def8e-b46c-43db-9ed0-8a279c24407c admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:31.392324 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737def8e-b46c-43db-9ed0-8a279c24407c admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:31.451145 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f74fb-7268-46d8-a49f-b5eec24972f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:31.451866 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f74fb-7268-46d8-a49f-b5eec24972f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:31.452198 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f74fb-7268-46d8-a49f-b5eec24972f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:31.452623 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f74fb-7268-46d8-a49f-b5eec24972f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:31.453495 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4f74fb-7268-46d8-a49f-b5eec24972f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:31.455636 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4f74fb-7268-46d8-a49f-b5eec24972f8 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:31.570437 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1045/2109] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:07:31 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:07:31.571705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f91e23-f573-4168-920a-16c71084734b admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:31.582870 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f91e23-f573-4168-920a-16c71084734b admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:31.588036 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62640ef-2ede-4380-b9e5-22cab3fd0c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:31.589208 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62640ef-2ede-4380-b9e5-22cab3fd0c41 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:31.589533 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62640ef-2ede-4380-b9e5-22cab3fd0c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:31.589811 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62640ef-2ede-4380-b9e5-22cab3fd0c41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:31.591196 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62640ef-2ede-4380-b9e5-22cab3fd0c41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:31.592833 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62640ef-2ede-4380-b9e5-22cab3fd0c41 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:31.604680 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1065/2110] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:07:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:07:31.613378 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f74fb-7268-46d8-a49f-b5eec24972f8 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:31.623961 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f74fb-7268-46d8-a49f-b5eec24972f8 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:31.629208 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627e388-a884-487c-9070-6ba380ca91a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:31.630165 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627e388-a884-487c-9070-6ba380ca91a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:31.630452 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627e388-a884-487c-9070-6ba380ca91a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:31.630754 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627e388-a884-487c-9070-6ba380ca91a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:31.631622 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627e388-a884-487c-9070-6ba380ca91a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:31.633376 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627e388-a884-487c-9070-6ba380ca91a5 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:31.645784 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1046/2111] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:07:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:07:31.648944 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62640ef-2ede-4380-b9e5-22cab3fd0c41 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:31.660197 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62640ef-2ede-4380-b9e5-22cab3fd0c41 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:31.664717 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:31.672554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142cb3e-5227-4fc6-99af-80a5d40529cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:31.673622 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142cb3e-5227-4fc6-99af-80a5d40529cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:31.673881 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142cb3e-5227-4fc6-99af-80a5d40529cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:31.674160 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142cb3e-5227-4fc6-99af-80a5d40529cb admin admin] PATH_INFO: `/v3/projects/21cdad1425d04178bfe8009ccf6c8137/users/34f3f599bae64665af3b77c52f03ea3b/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:31.691148 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0142cb3e-5227-4fc6-99af-80a5d40529cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=21cdad1425d04178bfe8009ccf6c8137, user_id=34f3f599bae64665af3b77c52f03ea3b, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:31.697567 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0142cb3e-5227-4fc6-99af-80a5d40529cb admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:31.785039 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1066/2112] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:07:31 2022] PUT /identity/v3/projects/21cdad1425d04178bfe8009ccf6c8137/users/34f3f599bae64665af3b77c52f03ea3b/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:31.790628 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af5c7b-4d47-4411-bb16-74f478db32f0 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:31.790917 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af5c7b-4d47-4411-bb16-74f478db32f0 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:31.791814 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af5c7b-4d47-4411-bb16-74f478db32f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:31.811107 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-b3af5c7b-4d47-4411-bb16-74f478db32f0 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:31.816285 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b3af5c7b-4d47-4411-bb16-74f478db32f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:31.873795 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1047/2113] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:07:31.883044 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142cb3e-5227-4fc6-99af-80a5d40529cb admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:31.884851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-0142cb3e-5227-4fc6-99af-80a5d40529cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:31.951983 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142cb3e-5227-4fc6-99af-80a5d40529cb admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:31.956464 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b3af4-794d-48f9-8f71-5c0a1665b2e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:31.957221 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b3af4-794d-48f9-8f71-5c0a1665b2e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:31.957865 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b3af4-794d-48f9-8f71-5c0a1665b2e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:31.958552 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b3af4-794d-48f9-8f71-5c0a1665b2e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:31.971391 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6b3af4-794d-48f9-8f71-5c0a1665b2e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:31.980111 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6b3af4-794d-48f9-8f71-5c0a1665b2e1 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:31.992223 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1067/2114] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:07:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 21:07:32.711164 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:33.405886 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af5c7b-4d47-4411-bb16-74f478db32f0 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:33.413414 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b3af5c7b-4d47-4411-bb16-74f478db32f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:33.420429 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af5c7b-4d47-4411-bb16-74f478db32f0 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:33.425039 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63acf8d8-7d2b-4f22-b2c5-1e0ca29b1dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:33.425911 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63acf8d8-7d2b-4f22-b2c5-1e0ca29b1dad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:33.426198 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63acf8d8-7d2b-4f22-b2c5-1e0ca29b1dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:33.426476 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63acf8d8-7d2b-4f22-b2c5-1e0ca29b1dad admin admin] PATH_INFO: `/v3/users/fd5a56337c2a436291e5928078463ba0` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:33.427657 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63acf8d8-7d2b-4f22-b2c5-1e0ca29b1dad admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd5a56337c2a436291e5928078463ba0)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:33.429819 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63acf8d8-7d2b-4f22-b2c5-1e0ca29b1dad admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:33.691745 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-63acf8d8-7d2b-4f22-b2c5-1e0ca29b1dad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd5a56337c2a436291e5928078463ba0'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:33.702251 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-63acf8d8-7d2b-4f22-b2c5-1e0ca29b1dad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd5a56337c2a436291e5928078463ba0'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:33.703087 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-63acf8d8-7d2b-4f22-b2c5-1e0ca29b1dad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd5a56337c2a436291e5928078463ba0'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:33.703793 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-63acf8d8-7d2b-4f22-b2c5-1e0ca29b1dad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd5a56337c2a436291e5928078463ba0'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:33.789518 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-63acf8d8-7d2b-4f22-b2c5-1e0ca29b1dad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd5a56337c2a436291e5928078463ba0'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:33.825012 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1048/2115] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:07:33 2022] DELETE /identity/v3/users/fd5a56337c2a436291e5928078463ba0 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:33.829227 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90441b-74fa-4692-a12a-343cffd1af88 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:33.829755 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90441b-74fa-4692-a12a-343cffd1af88 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:33.829862 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90441b-74fa-4692-a12a-343cffd1af88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:33.850915 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-5c90441b-74fa-4692-a12a-343cffd1af88 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:33.854521 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-5c90441b-74fa-4692-a12a-343cffd1af88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:33.920765 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1068/2116] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:07:33.936634 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63acf8d8-7d2b-4f22-b2c5-1e0ca29b1dad admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:33.938325 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-63acf8d8-7d2b-4f22-b2c5-1e0ca29b1dad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:33.979749 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:34.016323 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63acf8d8-7d2b-4f22-b2c5-1e0ca29b1dad admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:34.020902 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e01126-fcde-4cc2-a08d-86c4329e38cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:34.021567 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e01126-fcde-4cc2-a08d-86c4329e38cd service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:34.022179 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e01126-fcde-4cc2-a08d-86c4329e38cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:34.022603 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e01126-fcde-4cc2-a08d-86c4329e38cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:34.035491 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e01126-fcde-4cc2-a08d-86c4329e38cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:34.037354 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e01126-fcde-4cc2-a08d-86c4329e38cd service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:34.061326 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1049/2117] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:07:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:07:34.270293 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:34.701805 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90441b-74fa-4692-a12a-343cffd1af88 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:34.704396 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-5c90441b-74fa-4692-a12a-343cffd1af88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:34.740310 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90441b-74fa-4692-a12a-343cffd1af88 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:34.751598 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac6bd9-145a-4242-81e4-4eed3f7e7c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:34.755817 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac6bd9-145a-4242-81e4-4eed3f7e7c15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:34.758856 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac6bd9-145a-4242-81e4-4eed3f7e7c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:34.759157 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac6bd9-145a-4242-81e4-4eed3f7e7c15 admin admin] PATH_INFO: `/v3/projects/3eedf11923b640c08de37b3e369828f7` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:34.762578 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ac6bd9-145a-4242-81e4-4eed3f7e7c15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eedf11923b640c08de37b3e369828f7)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:34.766504 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ac6bd9-145a-4242-81e4-4eed3f7e7c15 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:34.919391 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-98ac6bd9-145a-4242-81e4-4eed3f7e7c15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eedf11923b640c08de37b3e369828f7', 'request_id': 'req-98ac6bd9-145a-4242-81e4-4eed3f7e7c15'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:34.926419 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-98ac6bd9-145a-4242-81e4-4eed3f7e7c15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eedf11923b640c08de37b3e369828f7', 'request_id': 'req-98ac6bd9-145a-4242-81e4-4eed3f7e7c15'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:34.932627 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-98ac6bd9-145a-4242-81e4-4eed3f7e7c15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eedf11923b640c08de37b3e369828f7', 'request_id': 'req-98ac6bd9-145a-4242-81e4-4eed3f7e7c15'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:35.004853 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-98ac6bd9-145a-4242-81e4-4eed3f7e7c15 admin admin] The token cache is being invalidate because project 3eedf11923b640c08de37b3e369828f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:07:35.007177 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-98ac6bd9-145a-4242-81e4-4eed3f7e7c15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:35.007177 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-98ac6bd9-145a-4242-81e4-4eed3f7e7c15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:35.007675 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1069/2118] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:07:34 2022] DELETE /identity/v3/projects/3eedf11923b640c08de37b3e369828f7 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:35.012702 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c2d42-5feb-4110-9d40-4e4c07f1011d None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:35.013242 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c2d42-5feb-4110-9d40-4e4c07f1011d None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:35.013332 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c2d42-5feb-4110-9d40-4e4c07f1011d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:35.033821 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-d79c2d42-5feb-4110-9d40-4e4c07f1011d None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:35.035303 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d79c2d42-5feb-4110-9d40-4e4c07f1011d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:35.115441 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1050/2119] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:07:35.123481 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbe478-f9cc-437e-87c8-09747557b484 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:35.123779 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbe478-f9cc-437e-87c8-09747557b484 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:35.124090 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbe478-f9cc-437e-87c8-09747557b484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:35.144789 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-cfdbe478-f9cc-437e-87c8-09747557b484 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:35.146914 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-cfdbe478-f9cc-437e-87c8-09747557b484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:35.156820 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1070/2120] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:35.161029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c2d42-5feb-4110-9d40-4e4c07f1011d None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:35.173426 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c2d42-5feb-4110-9d40-4e4c07f1011d None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:35.179315 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ee4ad-0148-4cdc-a41b-7cc5e8c20909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:35.180177 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ee4ad-0148-4cdc-a41b-7cc5e8c20909 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:35.180698 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ee4ad-0148-4cdc-a41b-7cc5e8c20909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:35.181061 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ee4ad-0148-4cdc-a41b-7cc5e8c20909 admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:35.182518 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ee4ad-0148-4cdc-a41b-7cc5e8c20909 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:07:35.183125 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ee4ad-0148-4cdc-a41b-7cc5e8c20909 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:35.184915 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ee4ad-0148-4cdc-a41b-7cc5e8c20909 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:35.200670 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1051/2121] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:07:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 21:07:35.205157 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdbe478-f9cc-437e-87c8-09747557b484 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:35.216950 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdbe478-f9cc-437e-87c8-09747557b484 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:35.225470 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481efe7d-603a-469e-9c21-1a859444c1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:35.226805 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481efe7d-603a-469e-9c21-1a859444c1a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:35.226805 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481efe7d-603a-469e-9c21-1a859444c1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:35.226805 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481efe7d-603a-469e-9c21-1a859444c1a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:35.227570 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481efe7d-603a-469e-9c21-1a859444c1a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:35.230110 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481efe7d-603a-469e-9c21-1a859444c1a2 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:35.410891 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1071/2122] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:07:35 2022] POST /identity/v3/projects => generated 359 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:07:35.414998 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ee4ad-0148-4cdc-a41b-7cc5e8c20909 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:35.426929 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ee4ad-0148-4cdc-a41b-7cc5e8c20909 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:35.530309 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605ec6f-2cdc-4b2a-bae3-f675d53cbe19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:35.531433 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605ec6f-2cdc-4b2a-bae3-f675d53cbe19 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:35.531734 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605ec6f-2cdc-4b2a-bae3-f675d53cbe19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:35.532043 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605ec6f-2cdc-4b2a-bae3-f675d53cbe19 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:35.535641 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605ec6f-2cdc-4b2a-bae3-f675d53cbe19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:35.542250 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605ec6f-2cdc-4b2a-bae3-f675d53cbe19 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:35.676866 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1052/2123] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:07:35 2022] POST /identity/v3/users => generated 280 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 21:07:35.676970 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481efe7d-603a-469e-9c21-1a859444c1a2 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:35.694785 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481efe7d-603a-469e-9c21-1a859444c1a2 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:35.703738 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d905b-810d-4d15-8aba-40dd80585ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:35.705168 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d905b-810d-4d15-8aba-40dd80585ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:35.705168 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d905b-810d-4d15-8aba-40dd80585ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:35.705168 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d905b-810d-4d15-8aba-40dd80585ab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:35.705423 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8d905b-810d-4d15-8aba-40dd80585ab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:35.706923 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8d905b-810d-4d15-8aba-40dd80585ab1 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:35.722345 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1072/2124] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:07:35.723873 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605ec6f-2cdc-4b2a-bae3-f675d53cbe19 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:35.735453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605ec6f-2cdc-4b2a-bae3-f675d53cbe19 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:35.740465 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd07e8d-96fa-4772-9dbc-2ed76217ab2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:35.741115 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd07e8d-96fa-4772-9dbc-2ed76217ab2e admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:35.741351 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd07e8d-96fa-4772-9dbc-2ed76217ab2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:35.741637 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd07e8d-96fa-4772-9dbc-2ed76217ab2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:35.742384 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd07e8d-96fa-4772-9dbc-2ed76217ab2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:35.744051 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd07e8d-96fa-4772-9dbc-2ed76217ab2e admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:35.773510 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1053/2125] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:07:35.774443 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d905b-810d-4d15-8aba-40dd80585ab1 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:35.790541 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d905b-810d-4d15-8aba-40dd80585ab1 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:35.798096 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2fc6a-db43-4c28-99e2-ee534cac41c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:35.799452 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2fc6a-db43-4c28-99e2-ee534cac41c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:35.799672 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2fc6a-db43-4c28-99e2-ee534cac41c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:35.800125 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2fc6a-db43-4c28-99e2-ee534cac41c3 admin admin] PATH_INFO: `/v3/projects/8d351d7066e84e869ef5fbb5d7caeb16/users/be1c74bc274e4c2c864a60973271947f/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:35.824752 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2fc6a-db43-4c28-99e2-ee534cac41c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d351d7066e84e869ef5fbb5d7caeb16, user_id=be1c74bc274e4c2c864a60973271947f, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:35.824752 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2fc6a-db43-4c28-99e2-ee534cac41c3 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:35.942446 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1073/2126] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:07:35 2022] PUT /identity/v3/projects/8d351d7066e84e869ef5fbb5d7caeb16/users/be1c74bc274e4c2c864a60973271947f/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:07:35.947443 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f7585-7930-4120-9368-56e9e25bc378 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:35.949391 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f7585-7930-4120-9368-56e9e25bc378 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:35.949896 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f7585-7930-4120-9368-56e9e25bc378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:35.989320 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-529f7585-7930-4120-9368-56e9e25bc378 None None] MFA Rules not processed for user `be1c74bc274e4c2c864a60973271947f`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:35.993735 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-529f7585-7930-4120-9368-56e9e25bc378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:36.082543 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1054/2127] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:35 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:36.122695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2fc6a-db43-4c28-99e2-ee534cac41c3 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:36.124791 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-90a2fc6a-db43-4c28-99e2-ee534cac41c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:36.199618 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2fc6a-db43-4c28-99e2-ee534cac41c3 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:36.203247 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f39a775-5791-4953-b13a-26139d8df126 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:36.203903 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39a775-5791-4953-b13a-26139d8df126 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:36.204228 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39a775-5791-4953-b13a-26139d8df126 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:36.204497 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39a775-5791-4953-b13a-26139d8df126 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:36.214506 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f39a775-5791-4953-b13a-26139d8df126 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:36.216215 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f39a775-5791-4953-b13a-26139d8df126 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:36.226193 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1074/2128] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:07:36 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:07:36.240616 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f7585-7930-4120-9368-56e9e25bc378 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:36.316003 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f7585-7930-4120-9368-56e9e25bc378 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:36.320745 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bac5c-ae4b-4794-a0d5-0535f5815dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:36.321667 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bac5c-ae4b-4794-a0d5-0535f5815dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:36.321960 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bac5c-ae4b-4794-a0d5-0535f5815dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:36.322240 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bac5c-ae4b-4794-a0d5-0535f5815dab admin admin] PATH_INFO: `/v3/users/be1c74bc274e4c2c864a60973271947f` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:36.324612 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925bac5c-ae4b-4794-a0d5-0535f5815dab admin admin] RBAC: Authorizing `identity:delete_user(user_id=be1c74bc274e4c2c864a60973271947f)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:36.326568 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925bac5c-ae4b-4794-a0d5-0535f5815dab admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:36.501126 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-925bac5c-ae4b-4794-a0d5-0535f5815dab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be1c74bc274e4c2c864a60973271947f'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:36.509670 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-925bac5c-ae4b-4794-a0d5-0535f5815dab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be1c74bc274e4c2c864a60973271947f'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:36.511256 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-925bac5c-ae4b-4794-a0d5-0535f5815dab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be1c74bc274e4c2c864a60973271947f'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:36.513333 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-925bac5c-ae4b-4794-a0d5-0535f5815dab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be1c74bc274e4c2c864a60973271947f'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:36.591112 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-925bac5c-ae4b-4794-a0d5-0535f5815dab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be1c74bc274e4c2c864a60973271947f'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:36.614377 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1055/2129] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:07:36 2022] DELETE /identity/v3/users/be1c74bc274e4c2c864a60973271947f => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:36.619288 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff157755-b518-4824-a1c5-30c1f97c23cf None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:36.620877 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff157755-b518-4824-a1c5-30c1f97c23cf None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:36.621170 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff157755-b518-4824-a1c5-30c1f97c23cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:36.639251 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-ff157755-b518-4824-a1c5-30c1f97c23cf None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:36.640365 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-ff157755-b518-4824-a1c5-30c1f97c23cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:36.679270 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:36.719769 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1075/2130] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:36.729797 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bac5c-ae4b-4794-a0d5-0535f5815dab admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:36.732828 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-925bac5c-ae4b-4794-a0d5-0535f5815dab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:36.825640 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bac5c-ae4b-4794-a0d5-0535f5815dab admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:36.836841 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7def87-f861-4e8e-8cca-2e8eac71bb0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:36.837730 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7def87-f861-4e8e-8cca-2e8eac71bb0c service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:36.838312 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7def87-f861-4e8e-8cca-2e8eac71bb0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:36.838750 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7def87-f861-4e8e-8cca-2e8eac71bb0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:36.866275 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7def87-f861-4e8e-8cca-2e8eac71bb0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:36.868337 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7def87-f861-4e8e-8cca-2e8eac71bb0c service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:36.914473 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1056/2131] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:07:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:07:37.767697 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:37.791648 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff157755-b518-4824-a1c5-30c1f97c23cf None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:37.793524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-ff157755-b518-4824-a1c5-30c1f97c23cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:37.816775 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff157755-b518-4824-a1c5-30c1f97c23cf None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:37.824028 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd753b7-ede0-40b3-a0f6-d7b36f8ff590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:37.825150 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd753b7-ede0-40b3-a0f6-d7b36f8ff590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:37.826167 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd753b7-ede0-40b3-a0f6-d7b36f8ff590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:37.826590 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd753b7-ede0-40b3-a0f6-d7b36f8ff590 admin admin] PATH_INFO: `/v3/projects/8d351d7066e84e869ef5fbb5d7caeb16` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:37.828857 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd753b7-ede0-40b3-a0f6-d7b36f8ff590 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d351d7066e84e869ef5fbb5d7caeb16)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:37.831011 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd753b7-ede0-40b3-a0f6-d7b36f8ff590 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:37.948815 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-4bd753b7-ede0-40b3-a0f6-d7b36f8ff590 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d351d7066e84e869ef5fbb5d7caeb16', 'request_id': 'req-4bd753b7-ede0-40b3-a0f6-d7b36f8ff590'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:37.958439 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-4bd753b7-ede0-40b3-a0f6-d7b36f8ff590 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d351d7066e84e869ef5fbb5d7caeb16', 'request_id': 'req-4bd753b7-ede0-40b3-a0f6-d7b36f8ff590'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:37.970875 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-4bd753b7-ede0-40b3-a0f6-d7b36f8ff590 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d351d7066e84e869ef5fbb5d7caeb16', 'request_id': 'req-4bd753b7-ede0-40b3-a0f6-d7b36f8ff590'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:38.061410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-4bd753b7-ede0-40b3-a0f6-d7b36f8ff590 admin admin] The token cache is being invalidate because project 8d351d7066e84e869ef5fbb5d7caeb16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:07:38.061712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-4bd753b7-ede0-40b3-a0f6-d7b36f8ff590 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:38.062423 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-4bd753b7-ede0-40b3-a0f6-d7b36f8ff590 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:38.064644 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1076/2132] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:07:37 2022] DELETE /identity/v3/projects/8d351d7066e84e869ef5fbb5d7caeb16 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:38.071200 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087bca8-495c-4db4-9722-3a4d9f77ad34 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:38.072298 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087bca8-495c-4db4-9722-3a4d9f77ad34 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:38.073388 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087bca8-495c-4db4-9722-3a4d9f77ad34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:38.098521 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-9087bca8-495c-4db4-9722-3a4d9f77ad34 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:38.100115 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-9087bca8-495c-4db4-9722-3a4d9f77ad34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:38.186011 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a51ddf-7499-48cc-a7c8-6b9c5fcab774 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:38.186527 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a51ddf-7499-48cc-a7c8-6b9c5fcab774 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:38.187672 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a51ddf-7499-48cc-a7c8-6b9c5fcab774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:38.194886 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1057/2133] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:38.202467 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f6234-28f6-42ca-a297-679bc3fd1117 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:38.203007 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f6234-28f6-42ca-a297-679bc3fd1117 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:38.203543 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f6234-28f6-42ca-a297-679bc3fd1117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:38.222788 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-509f6234-28f6-42ca-a297-679bc3fd1117 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:38.224048 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-509f6234-28f6-42ca-a297-679bc3fd1117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:38.229212 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-13a51ddf-7499-48cc-a7c8-6b9c5fcab774 None None] MFA Rules not processed for user `34f3f599bae64665af3b77c52f03ea3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:38.230887 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-13a51ddf-7499-48cc-a7c8-6b9c5fcab774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:38.232894 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1058/2134] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:07:38.238124 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f6234-28f6-42ca-a297-679bc3fd1117 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:38.248326 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f6234-28f6-42ca-a297-679bc3fd1117 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:38.253162 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478d4fe-e5e8-43b4-ab5c-6ba6319761c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:38.253840 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478d4fe-e5e8-43b4-ab5c-6ba6319761c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:38.254487 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478d4fe-e5e8-43b4-ab5c-6ba6319761c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:38.254912 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478d4fe-e5e8-43b4-ab5c-6ba6319761c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:38.255658 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c478d4fe-e5e8-43b4-ab5c-6ba6319761c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:07:38.256009 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c478d4fe-e5e8-43b4-ab5c-6ba6319761c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:38.257605 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c478d4fe-e5e8-43b4-ab5c-6ba6319761c8 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:38.282080 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1059/2135] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:07:38.283324 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478d4fe-e5e8-43b4-ab5c-6ba6319761c8 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:38.296004 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478d4fe-e5e8-43b4-ab5c-6ba6319761c8 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:38.302925 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6ec6d-dd5f-4666-9843-6df4193feb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:38.303793 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6ec6d-dd5f-4666-9843-6df4193feb5a admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:38.304641 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6ec6d-dd5f-4666-9843-6df4193feb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:38.305079 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6ec6d-dd5f-4666-9843-6df4193feb5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:38.306474 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6ec6d-dd5f-4666-9843-6df4193feb5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:38.310253 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6ec6d-dd5f-4666-9843-6df4193feb5a admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:38.352871 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1077/2136] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:07:38.357454 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a51ddf-7499-48cc-a7c8-6b9c5fcab774 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:38.358848 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-13a51ddf-7499-48cc-a7c8-6b9c5fcab774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:38.375532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a51ddf-7499-48cc-a7c8-6b9c5fcab774 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:38.382777 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79fcd6-4835-4652-b691-9f571f770b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:38.383559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79fcd6-4835-4652-b691-9f571f770b1e admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:38.383844 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79fcd6-4835-4652-b691-9f571f770b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:38.384163 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79fcd6-4835-4652-b691-9f571f770b1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:38.385455 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff79fcd6-4835-4652-b691-9f571f770b1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:38.387616 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff79fcd6-4835-4652-b691-9f571f770b1e admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:38.410389 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1060/2137] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:07:38 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:07:38.414949 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6ec6d-dd5f-4666-9843-6df4193feb5a admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:38.508380 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6ec6d-dd5f-4666-9843-6df4193feb5a admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:38.514594 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30bf265-ed47-49ec-ba33-2e7befbfc4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:38.515297 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30bf265-ed47-49ec-ba33-2e7befbfc4ba admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:38.515583 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30bf265-ed47-49ec-ba33-2e7befbfc4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:38.516155 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30bf265-ed47-49ec-ba33-2e7befbfc4ba admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:38.516860 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30bf265-ed47-49ec-ba33-2e7befbfc4ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:38.518853 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30bf265-ed47-49ec-ba33-2e7befbfc4ba admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:38.543985 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1078/2138] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:07:38 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:07:38.547469 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79fcd6-4835-4652-b691-9f571f770b1e admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:38.613933 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1061/2139] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:07:38 2022] POST /identity/v3/users => generated 288 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:07:38.621114 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30bf265-ed47-49ec-ba33-2e7befbfc4ba admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:38.646085 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30bf265-ed47-49ec-ba33-2e7befbfc4ba admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:38.672041 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe32add-a4b2-4d3e-b92b-2466b2220223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:38.673109 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79fcd6-4835-4652-b691-9f571f770b1e admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:38.673947 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe32add-a4b2-4d3e-b92b-2466b2220223 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:38.675170 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe32add-a4b2-4d3e-b92b-2466b2220223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:38.675619 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe32add-a4b2-4d3e-b92b-2466b2220223 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:38.679666 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe32add-a4b2-4d3e-b92b-2466b2220223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:38.681053 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cef53a-164d-4416-8a6c-f2a3235126ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:38.682147 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe32add-a4b2-4d3e-b92b-2466b2220223 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:38.683114 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cef53a-164d-4416-8a6c-f2a3235126ec admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:38.683369 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cef53a-164d-4416-8a6c-f2a3235126ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:38.683774 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cef53a-164d-4416-8a6c-f2a3235126ec admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:38.684761 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cef53a-164d-4416-8a6c-f2a3235126ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:38.686869 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cef53a-164d-4416-8a6c-f2a3235126ec admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:38.700809 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1062/2140] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 21:07:38.701843 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe32add-a4b2-4d3e-b92b-2466b2220223 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:38.712293 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe32add-a4b2-4d3e-b92b-2466b2220223 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:38.718044 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e48e53-3e6d-49b9-9a0a-88b1e8a0347e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:38.722931 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e48e53-3e6d-49b9-9a0a-88b1e8a0347e admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:38.722931 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e48e53-3e6d-49b9-9a0a-88b1e8a0347e admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:38.722931 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e48e53-3e6d-49b9-9a0a-88b1e8a0347e admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:38.722931 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e48e53-3e6d-49b9-9a0a-88b1e8a0347e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:38.722931 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e48e53-3e6d-49b9-9a0a-88b1e8a0347e admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:38.736592 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1063/2141] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:07:38.740380 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e48e53-3e6d-49b9-9a0a-88b1e8a0347e admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:38.754951 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e48e53-3e6d-49b9-9a0a-88b1e8a0347e admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:38.759669 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ba473-92fe-46b4-81a8-99f499029582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:38.760885 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ba473-92fe-46b4-81a8-99f499029582 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:38.761174 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ba473-92fe-46b4-81a8-99f499029582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:38.761472 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ba473-92fe-46b4-81a8-99f499029582 admin admin] PATH_INFO: `/v3/projects/ccdf7a4d11a14535822d5385c64b1056/users/252c25cc23064e52ab878d4e57926338/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:38.781620 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ba473-92fe-46b4-81a8-99f499029582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccdf7a4d11a14535822d5385c64b1056, user_id=252c25cc23064e52ab878d4e57926338, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:38.784892 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ba473-92fe-46b4-81a8-99f499029582 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:38.787809 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1079/2142] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:07:38 2022] POST /identity/v3/users => generated 299 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 21:07:38.789930 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cef53a-164d-4416-8a6c-f2a3235126ec admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:38.815906 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cef53a-164d-4416-8a6c-f2a3235126ec admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:38.821698 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4259d-2d35-4660-8296-b9674acca942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:38.822925 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4259d-2d35-4660-8296-b9674acca942 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:38.823309 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4259d-2d35-4660-8296-b9674acca942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:38.823492 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4259d-2d35-4660-8296-b9674acca942 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:38.824273 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4259d-2d35-4660-8296-b9674acca942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:38.825891 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4259d-2d35-4660-8296-b9674acca942 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:38.839171 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1080/2143] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:07:38.843413 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4259d-2d35-4660-8296-b9674acca942 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:38.854281 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4259d-2d35-4660-8296-b9674acca942 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:38.859841 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c704dc2-2576-4917-8b5f-8395872174ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:38.860884 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c704dc2-2576-4917-8b5f-8395872174ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:38.866516 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c704dc2-2576-4917-8b5f-8395872174ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:38.866516 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c704dc2-2576-4917-8b5f-8395872174ad admin admin] PATH_INFO: `/v3/projects/64666605a4e44f82bd981930ab8c3fc5/users/9e8a8a9f80f94391a4f3ebf13fd1abd3/roles/86273ff072f3438d822e870272491768` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:38.868588 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1064/2144] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:07:38 2022] PUT /identity/v3/projects/ccdf7a4d11a14535822d5385c64b1056/users/252c25cc23064e52ab878d4e57926338/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:07:38.881764 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5475b6-4653-4845-9426-ed75c069d07f None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:38.881764 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5475b6-4653-4845-9426-ed75c069d07f None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:38.881764 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5475b6-4653-4845-9426-ed75c069d07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:38.888714 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c704dc2-2576-4917-8b5f-8395872174ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=64666605a4e44f82bd981930ab8c3fc5, user_id=9e8a8a9f80f94391a4f3ebf13fd1abd3, role_id=86273ff072f3438d822e870272491768)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:38.892983 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c704dc2-2576-4917-8b5f-8395872174ad admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:38.917191 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-ed5475b6-4653-4845-9426-ed75c069d07f None None] MFA Rules not processed for user `252c25cc23064e52ab878d4e57926338`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:38.918596 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-ed5475b6-4653-4845-9426-ed75c069d07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:38.986022 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1081/2145] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:07:38 2022] PUT /identity/v3/projects/64666605a4e44f82bd981930ab8c3fc5/users/9e8a8a9f80f94391a4f3ebf13fd1abd3/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:38.989822 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c704dc2-2576-4917-8b5f-8395872174ad admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:39.000304 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1065/2146] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:07:39.014859 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5475b6-4653-4845-9426-ed75c069d07f None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:39.016671 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-ed5475b6-4653-4845-9426-ed75c069d07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:39.067851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c704dc2-2576-4917-8b5f-8395872174ad admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:39.092091 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5475b6-4653-4845-9426-ed75c069d07f None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:39.094718 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18504491-3dc0-40a5-9c18-ef7dc0090f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:39.095633 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18504491-3dc0-40a5-9c18-ef7dc0090f9f admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:39.095932 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18504491-3dc0-40a5-9c18-ef7dc0090f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:39.096547 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18504491-3dc0-40a5-9c18-ef7dc0090f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:39.097550 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18504491-3dc0-40a5-9c18-ef7dc0090f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:39.102052 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18504491-3dc0-40a5-9c18-ef7dc0090f9f admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:39.120981 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1082/2147] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 21:07:39.129764 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18504491-3dc0-40a5-9c18-ef7dc0090f9f admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:39.146367 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18504491-3dc0-40a5-9c18-ef7dc0090f9f admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:39.152760 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e58914-e3ad-4458-abce-df32f8a3dde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:39.153682 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e58914-e3ad-4458-abce-df32f8a3dde6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:39.153977 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e58914-e3ad-4458-abce-df32f8a3dde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:39.154345 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e58914-e3ad-4458-abce-df32f8a3dde6 admin admin] PATH_INFO: `/v3/projects/64666605a4e44f82bd981930ab8c3fc5/users/9e8a8a9f80f94391a4f3ebf13fd1abd3/roles/86273ff072f3438d822e870272491768` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:39.156634 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e58914-e3ad-4458-abce-df32f8a3dde6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64666605a4e44f82bd981930ab8c3fc5, user_id=9e8a8a9f80f94391a4f3ebf13fd1abd3, role_id=86273ff072f3438d822e870272491768)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:39.159436 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e58914-e3ad-4458-abce-df32f8a3dde6 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:39.173255 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1083/2148] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:07:39 2022] PUT /identity/v3/projects/64666605a4e44f82bd981930ab8c3fc5/users/9e8a8a9f80f94391a4f3ebf13fd1abd3/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:39.179532 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750647e9-857b-4d4f-b604-6293d51a198a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:39.180471 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750647e9-857b-4d4f-b604-6293d51a198a service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:39.181039 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750647e9-857b-4d4f-b604-6293d51a198a service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:39.181774 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750647e9-857b-4d4f-b604-6293d51a198a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:39.255460 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750647e9-857b-4d4f-b604-6293d51a198a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:39.257080 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750647e9-857b-4d4f-b604-6293d51a198a service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:39.270317 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1066/2149] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:07:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 21:07:39.378851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e58914-e3ad-4458-abce-df32f8a3dde6 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:39.381286 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a6e58914-e3ad-4458-abce-df32f8a3dde6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:39.463389 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e58914-e3ad-4458-abce-df32f8a3dde6 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:39.468213 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d5db4-c1b0-44e2-8110-6de5eee96f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:39.469101 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d5db4-c1b0-44e2-8110-6de5eee96f07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:39.469394 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d5db4-c1b0-44e2-8110-6de5eee96f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:39.469677 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d5db4-c1b0-44e2-8110-6de5eee96f07 admin admin] PATH_INFO: `/v3/users/5dcdb038617f41b4a9eb096b92786dcf` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:39.470904 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d5db4-c1b0-44e2-8110-6de5eee96f07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dcdb038617f41b4a9eb096b92786dcf)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:39.472895 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d5db4-c1b0-44e2-8110-6de5eee96f07 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:39.672443 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:39.697429 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-062d5db4-c1b0-44e2-8110-6de5eee96f07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dcdb038617f41b4a9eb096b92786dcf'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:39.719632 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-062d5db4-c1b0-44e2-8110-6de5eee96f07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dcdb038617f41b4a9eb096b92786dcf'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:39.724803 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-062d5db4-c1b0-44e2-8110-6de5eee96f07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dcdb038617f41b4a9eb096b92786dcf'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:39.726355 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-062d5db4-c1b0-44e2-8110-6de5eee96f07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dcdb038617f41b4a9eb096b92786dcf'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:39.814816 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-062d5db4-c1b0-44e2-8110-6de5eee96f07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dcdb038617f41b4a9eb096b92786dcf'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:39.837722 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1084/2150] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:07:39 2022] DELETE /identity/v3/users/5dcdb038617f41b4a9eb096b92786dcf => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:39.846969 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a5924-6d28-45a4-970b-8190b38a0437 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:39.847433 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a5924-6d28-45a4-970b-8190b38a0437 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:39.847783 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a5924-6d28-45a4-970b-8190b38a0437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:39.878755 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-268a5924-6d28-45a4-970b-8190b38a0437 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:39.889473 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-268a5924-6d28-45a4-970b-8190b38a0437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:40.005898 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1067/2151] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:40.045090 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d5db4-c1b0-44e2-8110-6de5eee96f07 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:40.047634 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-062d5db4-c1b0-44e2-8110-6de5eee96f07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:40.201230 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:40.223331 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d5db4-c1b0-44e2-8110-6de5eee96f07 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:40.235150 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c02861-0a59-4ad3-ab9b-927150a97c4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:40.235150 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c02861-0a59-4ad3-ab9b-927150a97c4c service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:40.235150 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c02861-0a59-4ad3-ab9b-927150a97c4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:40.235150 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c02861-0a59-4ad3-ab9b-927150a97c4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:40.262762 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c02861-0a59-4ad3-ab9b-927150a97c4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:40.264283 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c02861-0a59-4ad3-ab9b-927150a97c4c service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:40.277473 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1085/2152] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:07:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:07:40.843895 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a5924-6d28-45a4-970b-8190b38a0437 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:40.845579 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-268a5924-6d28-45a4-970b-8190b38a0437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:40.861681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a5924-6d28-45a4-970b-8190b38a0437 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:40.866598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c576b-c90e-45e1-ae59-3c3baf48862d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:40.868540 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c576b-c90e-45e1-ae59-3c3baf48862d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:40.869738 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c576b-c90e-45e1-ae59-3c3baf48862d admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:40.870294 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c576b-c90e-45e1-ae59-3c3baf48862d admin admin] PATH_INFO: `/v3/projects/485e3f1ec5fa4834b2304680a212a0ed` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:40.876970 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c576b-c90e-45e1-ae59-3c3baf48862d admin admin] RBAC: Authorizing `identity:delete_project(project_id=485e3f1ec5fa4834b2304680a212a0ed)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:40.876970 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c576b-c90e-45e1-ae59-3c3baf48862d admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:41.007310 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-061c576b-c90e-45e1-ae59-3c3baf48862d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '485e3f1ec5fa4834b2304680a212a0ed', 'request_id': 'req-061c576b-c90e-45e1-ae59-3c3baf48862d'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:41.015457 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-061c576b-c90e-45e1-ae59-3c3baf48862d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '485e3f1ec5fa4834b2304680a212a0ed', 'request_id': 'req-061c576b-c90e-45e1-ae59-3c3baf48862d'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:41.039833 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-061c576b-c90e-45e1-ae59-3c3baf48862d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '485e3f1ec5fa4834b2304680a212a0ed', 'request_id': 'req-061c576b-c90e-45e1-ae59-3c3baf48862d'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:41.084421 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e195e-7a05-41b7-8131-dcffd28d9b9c None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:41.084853 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e195e-7a05-41b7-8131-dcffd28d9b9c None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:41.085050 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e195e-7a05-41b7-8131-dcffd28d9b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:41.121695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-e27e195e-7a05-41b7-8131-dcffd28d9b9c None None] MFA Rules not processed for user `252c25cc23064e52ab878d4e57926338`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:41.124062 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-e27e195e-7a05-41b7-8131-dcffd28d9b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:41.138176 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-061c576b-c90e-45e1-ae59-3c3baf48862d admin admin] The token cache is being invalidate because project 485e3f1ec5fa4834b2304680a212a0ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:07:41.139758 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-061c576b-c90e-45e1-ae59-3c3baf48862d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:41.139758 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-061c576b-c90e-45e1-ae59-3c3baf48862d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:41.141343 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1068/2153] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:07:40 2022] DELETE /identity/v3/projects/485e3f1ec5fa4834b2304680a212a0ed => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:41.145738 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165bcb51-39ba-4192-8cd1-478a1b81a603 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:41.146037 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165bcb51-39ba-4192-8cd1-478a1b81a603 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:41.146320 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165bcb51-39ba-4192-8cd1-478a1b81a603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:41.204714 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-165bcb51-39ba-4192-8cd1-478a1b81a603 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:41.206000 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-165bcb51-39ba-4192-8cd1-478a1b81a603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:41.260384 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1086/2154] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:07:41.362767 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1069/2155] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:41.368507 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13101d25-d561-4ed7-a55f-bc596f7dd8f2 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:41.368860 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13101d25-d561-4ed7-a55f-bc596f7dd8f2 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:41.369155 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13101d25-d561-4ed7-a55f-bc596f7dd8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:41.399185 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-13101d25-d561-4ed7-a55f-bc596f7dd8f2 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:41.400682 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-13101d25-d561-4ed7-a55f-bc596f7dd8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:41.413833 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1087/2156] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:41.414666 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165bcb51-39ba-4192-8cd1-478a1b81a603 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:41.426295 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165bcb51-39ba-4192-8cd1-478a1b81a603 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:41.462272 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73932835-9570-4e0e-b9c3-e65847ab5476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:41.463081 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73932835-9570-4e0e-b9c3-e65847ab5476 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:41.463377 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73932835-9570-4e0e-b9c3-e65847ab5476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:41.464057 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73932835-9570-4e0e-b9c3-e65847ab5476 admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:41.471752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73932835-9570-4e0e-b9c3-e65847ab5476 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:07:41.471752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73932835-9570-4e0e-b9c3-e65847ab5476 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:41.471994 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73932835-9570-4e0e-b9c3-e65847ab5476 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:41.501062 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1070/2157] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:07:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:07:41.505296 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13101d25-d561-4ed7-a55f-bc596f7dd8f2 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:41.517665 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13101d25-d561-4ed7-a55f-bc596f7dd8f2 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:41.528806 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196bb0b8-5017-4a39-a7ab-b130e53fdec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:41.529556 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bb0b8-5017-4a39-a7ab-b130e53fdec4 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:41.529845 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bb0b8-5017-4a39-a7ab-b130e53fdec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:41.530130 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bb0b8-5017-4a39-a7ab-b130e53fdec4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:41.530832 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196bb0b8-5017-4a39-a7ab-b130e53fdec4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:41.537568 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196bb0b8-5017-4a39-a7ab-b130e53fdec4 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:41.627142 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:41.675878 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1088/2158] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:07:41 2022] POST /identity/v3/projects => generated 369 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:07:41.680567 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73932835-9570-4e0e-b9c3-e65847ab5476 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:41.715594 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73932835-9570-4e0e-b9c3-e65847ab5476 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:41.733629 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:41.862859 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3504de0-7592-4454-b5b2-0ff59c76a498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:41.863494 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3504de0-7592-4454-b5b2-0ff59c76a498 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:41.863885 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3504de0-7592-4454-b5b2-0ff59c76a498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:41.864310 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3504de0-7592-4454-b5b2-0ff59c76a498 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:41.865213 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3504de0-7592-4454-b5b2-0ff59c76a498 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:41.882350 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3504de0-7592-4454-b5b2-0ff59c76a498 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:42.033370 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1071/2159] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:07:41 2022] POST /identity/v3/users => generated 285 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:07:42.037446 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196bb0b8-5017-4a39-a7ab-b130e53fdec4 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:42.057656 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196bb0b8-5017-4a39-a7ab-b130e53fdec4 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:42.086016 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d4b0f-baf2-49a1-aadf-1f74c1877f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:42.086692 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d4b0f-baf2-49a1-aadf-1f74c1877f39 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:42.089399 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d4b0f-baf2-49a1-aadf-1f74c1877f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:42.090006 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d4b0f-baf2-49a1-aadf-1f74c1877f39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:42.104855 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d4b0f-baf2-49a1-aadf-1f74c1877f39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:42.118730 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d4b0f-baf2-49a1-aadf-1f74c1877f39 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:42.170419 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1089/2160] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:07:42.174595 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3504de0-7592-4454-b5b2-0ff59c76a498 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:42.199452 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3504de0-7592-4454-b5b2-0ff59c76a498 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:42.223184 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c556b6-e97e-4fa5-a921-a3660ef65e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:42.224736 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c556b6-e97e-4fa5-a921-a3660ef65e79 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:42.225247 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c556b6-e97e-4fa5-a921-a3660ef65e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:42.226347 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c556b6-e97e-4fa5-a921-a3660ef65e79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:42.227507 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c556b6-e97e-4fa5-a921-a3660ef65e79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:42.232668 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c556b6-e97e-4fa5-a921-a3660ef65e79 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:42.257044 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1072/2161] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:07:42.261867 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d4b0f-baf2-49a1-aadf-1f74c1877f39 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:42.276741 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d4b0f-baf2-49a1-aadf-1f74c1877f39 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:42.282979 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f235b3e-5e7d-40f6-adf8-76440c1dfdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:42.284319 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f235b3e-5e7d-40f6-adf8-76440c1dfdd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:42.285000 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f235b3e-5e7d-40f6-adf8-76440c1dfdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:42.285491 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f235b3e-5e7d-40f6-adf8-76440c1dfdd7 admin admin] PATH_INFO: `/v3/projects/8a0ecab42dea47819a8a76b401a46aa6/users/a0c348a0183b498caf281989329117db/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:42.315045 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f235b3e-5e7d-40f6-adf8-76440c1dfdd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a0ecab42dea47819a8a76b401a46aa6, user_id=a0c348a0183b498caf281989329117db, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:42.321999 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f235b3e-5e7d-40f6-adf8-76440c1dfdd7 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:42.484547 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1090/2162] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:07:42 2022] PUT /identity/v3/projects/8a0ecab42dea47819a8a76b401a46aa6/users/a0c348a0183b498caf281989329117db/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:42.498555 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f3bb1-fbe5-4a59-aa25-6fddfe22e18c None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:42.498948 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f3bb1-fbe5-4a59-aa25-6fddfe22e18c None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:42.499292 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f3bb1-fbe5-4a59-aa25-6fddfe22e18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:42.549393 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-139f3bb1-fbe5-4a59-aa25-6fddfe22e18c None None] MFA Rules not processed for user `a0c348a0183b498caf281989329117db`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:42.551352 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-139f3bb1-fbe5-4a59-aa25-6fddfe22e18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:42.663554 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1073/2163] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:42 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:42.667904 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f235b3e-5e7d-40f6-adf8-76440c1dfdd7 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:42.748211 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:42.790024 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f235b3e-5e7d-40f6-adf8-76440c1dfdd7 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:42.802283 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc84434-5dfc-4e18-9d20-fa2ef0fabd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:42.803701 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc84434-5dfc-4e18-9d20-fa2ef0fabd83 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:42.804192 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc84434-5dfc-4e18-9d20-fa2ef0fabd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:42.805481 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc84434-5dfc-4e18-9d20-fa2ef0fabd83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:42.806562 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc84434-5dfc-4e18-9d20-fa2ef0fabd83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:42.810278 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc84434-5dfc-4e18-9d20-fa2ef0fabd83 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:42.931214 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1091/2164] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:07:42 2022] POST /identity/v3/projects => generated 367 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:07:42.935792 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f3bb1-fbe5-4a59-aa25-6fddfe22e18c None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:42.952175 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f3bb1-fbe5-4a59-aa25-6fddfe22e18c None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:43.074528 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa7187-03a6-44a3-ad8e-0bfd8653f613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:43.075591 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa7187-03a6-44a3-ad8e-0bfd8653f613 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:43.076438 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa7187-03a6-44a3-ad8e-0bfd8653f613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:43.076921 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa7187-03a6-44a3-ad8e-0bfd8653f613 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:43.078192 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa7187-03a6-44a3-ad8e-0bfd8653f613 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:43.080474 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa7187-03a6-44a3-ad8e-0bfd8653f613 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:43.214056 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1074/2165] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:07:42 2022] POST /identity/v3/users => generated 290 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:07:43.217863 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc84434-5dfc-4e18-9d20-fa2ef0fabd83 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:43.236288 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc84434-5dfc-4e18-9d20-fa2ef0fabd83 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:43.245569 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de3255-fcc3-4d8c-8f57-1eb9b4f8abbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:43.246681 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de3255-fcc3-4d8c-8f57-1eb9b4f8abbd admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:43.247190 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de3255-fcc3-4d8c-8f57-1eb9b4f8abbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:43.247712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de3255-fcc3-4d8c-8f57-1eb9b4f8abbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:43.248722 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28de3255-fcc3-4d8c-8f57-1eb9b4f8abbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:43.250977 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28de3255-fcc3-4d8c-8f57-1eb9b4f8abbd admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:43.266834 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1092/2166] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 21:07:43.273213 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa7187-03a6-44a3-ad8e-0bfd8653f613 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:43.285993 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa7187-03a6-44a3-ad8e-0bfd8653f613 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:43.292011 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c67980-bc74-46e9-bb36-94c2d0b8303f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:43.298362 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c67980-bc74-46e9-bb36-94c2d0b8303f admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:43.298742 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c67980-bc74-46e9-bb36-94c2d0b8303f admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:43.303471 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c67980-bc74-46e9-bb36-94c2d0b8303f admin admin] PATH_INFO: `/v3/projects/11ae91824fb140138011b7a5d1b5ec18/users/da21d5e703a047289db109435e222aa1/roles/86273ff072f3438d822e870272491768` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:43.328772 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c67980-bc74-46e9-bb36-94c2d0b8303f admin admin] RBAC: Authorizing `identity:create_grant(project_id=11ae91824fb140138011b7a5d1b5ec18, user_id=da21d5e703a047289db109435e222aa1, role_id=86273ff072f3438d822e870272491768)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:43.331945 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c67980-bc74-46e9-bb36-94c2d0b8303f admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:43.420336 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1075/2167] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:07:43 2022] PUT /identity/v3/projects/11ae91824fb140138011b7a5d1b5ec18/users/da21d5e703a047289db109435e222aa1/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:43.424357 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de3255-fcc3-4d8c-8f57-1eb9b4f8abbd admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:43.437848 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de3255-fcc3-4d8c-8f57-1eb9b4f8abbd admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:43.596938 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46d625-378d-4494-bc2c-9d192f32cfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:43.597874 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46d625-378d-4494-bc2c-9d192f32cfb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:43.603113 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46d625-378d-4494-bc2c-9d192f32cfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:43.603113 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46d625-378d-4494-bc2c-9d192f32cfb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:43.603113 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc46d625-378d-4494-bc2c-9d192f32cfb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:43.637052 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc46d625-378d-4494-bc2c-9d192f32cfb0 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:43.688008 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1093/2168] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:07:43.688706 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c67980-bc74-46e9-bb36-94c2d0b8303f admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:43.705286 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c67980-bc74-46e9-bb36-94c2d0b8303f admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:43.726323 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13983674-f42c-4f49-8b83-d78b8ba2d976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:43.727258 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13983674-f42c-4f49-8b83-d78b8ba2d976 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:43.727546 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13983674-f42c-4f49-8b83-d78b8ba2d976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:43.727830 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13983674-f42c-4f49-8b83-d78b8ba2d976 admin admin] PATH_INFO: `/v3/projects/11ae91824fb140138011b7a5d1b5ec18/users/da21d5e703a047289db109435e222aa1/roles/86273ff072f3438d822e870272491768` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:43.734442 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13983674-f42c-4f49-8b83-d78b8ba2d976 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11ae91824fb140138011b7a5d1b5ec18, user_id=da21d5e703a047289db109435e222aa1, role_id=86273ff072f3438d822e870272491768)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:43.738603 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13983674-f42c-4f49-8b83-d78b8ba2d976 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:43.767459 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1076/2169] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:07:43 2022] PUT /identity/v3/projects/11ae91824fb140138011b7a5d1b5ec18/users/da21d5e703a047289db109435e222aa1/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:07:43.785301 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcadc4b-12ea-40d4-b57c-171cfe152acd None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:43.786447 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcadc4b-12ea-40d4-b57c-171cfe152acd None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:43.786447 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcadc4b-12ea-40d4-b57c-171cfe152acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:43.882192 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:43.894973 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-cbcadc4b-12ea-40d4-b57c-171cfe152acd None None] MFA Rules not processed for user `da21d5e703a047289db109435e222aa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:43.900223 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-cbcadc4b-12ea-40d4-b57c-171cfe152acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:44.097567 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1094/2170] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:43 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:44.121635 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13983674-f42c-4f49-8b83-d78b8ba2d976 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:44.125316 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-13983674-f42c-4f49-8b83-d78b8ba2d976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:44.281317 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:44.312915 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13983674-f42c-4f49-8b83-d78b8ba2d976 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:44.319595 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f9a51-7cca-449f-81a3-b57ea3c15036 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:44.321447 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f9a51-7cca-449f-81a3-b57ea3c15036 service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:44.321921 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f9a51-7cca-449f-81a3-b57ea3c15036 service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:44.322945 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f9a51-7cca-449f-81a3-b57ea3c15036 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:44.347317 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f9a51-7cca-449f-81a3-b57ea3c15036 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:44.350328 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f9a51-7cca-449f-81a3-b57ea3c15036 service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:44.379487 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1077/2171] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:07:44 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:07:44.556839 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcadc4b-12ea-40d4-b57c-171cfe152acd None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:44.569675 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcadc4b-12ea-40d4-b57c-171cfe152acd None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:44.574991 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0533be0-bb85-441f-b511-9980a9a015e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:44.576246 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0533be0-bb85-441f-b511-9980a9a015e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:44.576740 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0533be0-bb85-441f-b511-9980a9a015e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:44.577388 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0533be0-bb85-441f-b511-9980a9a015e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:44.678210 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0533be0-bb85-441f-b511-9980a9a015e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:44.680563 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0533be0-bb85-441f-b511-9980a9a015e0 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:44.698447 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1095/2172] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:07:44 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:07:45.058905 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f9a51-7cca-449f-81a3-b57ea3c15036 service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:45.060677 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-dd1f9a51-7cca-449f-81a3-b57ea3c15036 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:45.072749 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:45.077133 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f9a51-7cca-449f-81a3-b57ea3c15036 service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:45.081625 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd3d4b-a4b1-4470-9641-c433b1d1ef33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:45.082574 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd3d4b-a4b1-4470-9641-c433b1d1ef33 service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:45.083646 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd3d4b-a4b1-4470-9641-c433b1d1ef33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:45.084176 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd3d4b-a4b1-4470-9641-c433b1d1ef33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:45.086879 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-79dd3d4b-a4b1-4470-9641-c433b1d1ef33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:45.191090 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd3d4b-a4b1-4470-9641-c433b1d1ef33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:45.192943 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd3d4b-a4b1-4470-9641-c433b1d1ef33 service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:45.208295 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1078/2173] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:07:45 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:07:45.960750 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:46.205608 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:46.706685 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:46.993989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4dc56e-f15d-45dd-8bcc-57b4518fe504 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:46.994942 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4dc56e-f15d-45dd-8bcc-57b4518fe504 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:46.995578 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4dc56e-f15d-45dd-8bcc-57b4518fe504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:47.039707 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-fb4dc56e-f15d-45dd-8bcc-57b4518fe504 None None] MFA Rules not processed for user `9e8a8a9f80f94391a4f3ebf13fd1abd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:47.041113 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-fb4dc56e-f15d-45dd-8bcc-57b4518fe504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:47.167041 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1096/2174] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:47.180029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd3d4b-a4b1-4470-9641-c433b1d1ef33 service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:47.182155 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-79dd3d4b-a4b1-4470-9641-c433b1d1ef33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:47.312905 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd3d4b-a4b1-4470-9641-c433b1d1ef33 service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:47.318572 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef06eada-12a8-41af-b104-7908d9d449ae service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da488c75631e4e5992304ff6c0579aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:47.318572 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06eada-12a8-41af-b104-7908d9d449ae service glance] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:47.318572 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06eada-12a8-41af-b104-7908d9d449ae service glance] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:47.318572 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06eada-12a8-41af-b104-7908d9d449ae service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:47.325351 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-ef06eada-12a8-41af-b104-7908d9d449ae service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:47.373329 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:47.431015 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef06eada-12a8-41af-b104-7908d9d449ae service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:47.433341 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef06eada-12a8-41af-b104-7908d9d449ae service glance] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:47.452808 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1079/2175] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:07:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:07:47.665098 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:47.774490 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2af888-371f-4dff-8ae8-426ce12c4e54 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:47.775113 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2af888-371f-4dff-8ae8-426ce12c4e54 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:47.776444 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2af888-371f-4dff-8ae8-426ce12c4e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:47.803921 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-5a2af888-371f-4dff-8ae8-426ce12c4e54 None None] MFA Rules not processed for user `90ea5d52fd6d4068b7837d363eebb94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:47.805267 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-5a2af888-371f-4dff-8ae8-426ce12c4e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:47.875265 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1097/2176] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Jul 11 21:07:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:47.918863 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef06eada-12a8-41af-b104-7908d9d449ae service glance] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:47.920327 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-ef06eada-12a8-41af-b104-7908d9d449ae service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:48.008180 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef06eada-12a8-41af-b104-7908d9d449ae service glance] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:48.014950 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182c4f8-7df8-49e4-b448-1612250acf32 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc950dfb1d3b4308a33f3d430fe34c1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:48.016126 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182c4f8-7df8-49e4-b448-1612250acf32 service swift] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:48.020479 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182c4f8-7df8-49e4-b448-1612250acf32 service swift] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:48.020479 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182c4f8-7df8-49e4-b448-1612250acf32 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:48.029725 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182c4f8-7df8-49e4-b448-1612250acf32 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:48.031387 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182c4f8-7df8-49e4-b448-1612250acf32 service swift] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:48.040513 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1080/2177] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jul 11 21:07:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 21:07:48.315357 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:48.538063 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:49.464049 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:50.785352 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:51.022396 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2af888-371f-4dff-8ae8-426ce12c4e54 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:51.112695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2af888-371f-4dff-8ae8-426ce12c4e54 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:51.118493 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201019d-8400-4b5b-a82a-a44459001e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:51.119914 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201019d-8400-4b5b-a82a-a44459001e01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:51.120418 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201019d-8400-4b5b-a82a-a44459001e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:51.120859 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201019d-8400-4b5b-a82a-a44459001e01 admin admin] PATH_INFO: `/v3/users/a0c348a0183b498caf281989329117db` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:51.122255 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1201019d-8400-4b5b-a82a-a44459001e01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0c348a0183b498caf281989329117db)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:51.124584 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1201019d-8400-4b5b-a82a-a44459001e01 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:51.436263 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-1201019d-8400-4b5b-a82a-a44459001e01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0c348a0183b498caf281989329117db'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:51.446413 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-1201019d-8400-4b5b-a82a-a44459001e01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0c348a0183b498caf281989329117db'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:51.449802 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-1201019d-8400-4b5b-a82a-a44459001e01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0c348a0183b498caf281989329117db'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:51.461085 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-1201019d-8400-4b5b-a82a-a44459001e01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0c348a0183b498caf281989329117db'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:51.583624 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-1201019d-8400-4b5b-a82a-a44459001e01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0c348a0183b498caf281989329117db'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:51.613358 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1098/2178] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:07:51 2022] DELETE /identity/v3/users/a0c348a0183b498caf281989329117db => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:51.618520 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be1641-c51c-4973-afb1-d59ab6add349 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:51.624674 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be1641-c51c-4973-afb1-d59ab6add349 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:51.626243 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be1641-c51c-4973-afb1-d59ab6add349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:51.654177 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-b4be1641-c51c-4973-afb1-d59ab6add349 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:51.655717 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b4be1641-c51c-4973-afb1-d59ab6add349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:51.814972 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1081/2179] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:51.818191 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201019d-8400-4b5b-a82a-a44459001e01 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:51.820244 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-1201019d-8400-4b5b-a82a-a44459001e01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:51.939901 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201019d-8400-4b5b-a82a-a44459001e01 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:51.955259 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ff220-1264-4291-b31b-9ef47ad53764 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:51.956180 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ff220-1264-4291-b31b-9ef47ad53764 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:51.956739 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ff220-1264-4291-b31b-9ef47ad53764 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:51.958485 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ff220-1264-4291-b31b-9ef47ad53764 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:51.990186 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ff220-1264-4291-b31b-9ef47ad53764 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:51.992370 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ff220-1264-4291-b31b-9ef47ad53764 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:52.039800 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1099/2180] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:07:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:07:52.532156 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:53.220884 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be1641-c51c-4973-afb1-d59ab6add349 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:53.222420 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b4be1641-c51c-4973-afb1-d59ab6add349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:53.250090 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be1641-c51c-4973-afb1-d59ab6add349 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:53.255578 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca594f1c-cfad-4023-8a94-bec6818a5a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:53.256597 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca594f1c-cfad-4023-8a94-bec6818a5a5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:53.256884 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca594f1c-cfad-4023-8a94-bec6818a5a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:53.257289 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca594f1c-cfad-4023-8a94-bec6818a5a5b admin admin] PATH_INFO: `/v3/projects/8a0ecab42dea47819a8a76b401a46aa6` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:53.258537 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca594f1c-cfad-4023-8a94-bec6818a5a5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a0ecab42dea47819a8a76b401a46aa6)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:53.261019 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca594f1c-cfad-4023-8a94-bec6818a5a5b admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:53.411619 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-ca594f1c-cfad-4023-8a94-bec6818a5a5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a0ecab42dea47819a8a76b401a46aa6', 'request_id': 'req-ca594f1c-cfad-4023-8a94-bec6818a5a5b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:53.435812 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-ca594f1c-cfad-4023-8a94-bec6818a5a5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a0ecab42dea47819a8a76b401a46aa6', 'request_id': 'req-ca594f1c-cfad-4023-8a94-bec6818a5a5b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:53.461426 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-ca594f1c-cfad-4023-8a94-bec6818a5a5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a0ecab42dea47819a8a76b401a46aa6', 'request_id': 'req-ca594f1c-cfad-4023-8a94-bec6818a5a5b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:53.571071 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-ca594f1c-cfad-4023-8a94-bec6818a5a5b admin admin] The token cache is being invalidate because project 8a0ecab42dea47819a8a76b401a46aa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:07:53.571619 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-ca594f1c-cfad-4023-8a94-bec6818a5a5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:53.574049 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-ca594f1c-cfad-4023-8a94-bec6818a5a5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:53.584232 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1082/2181] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:07:53 2022] DELETE /identity/v3/projects/8a0ecab42dea47819a8a76b401a46aa6 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:53.584362 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ff220-1264-4291-b31b-9ef47ad53764 service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:53.610575 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ff220-1264-4291-b31b-9ef47ad53764 service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:53.920557 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b7aae-c361-4e60-b27e-de6f0b8fb99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:53.929058 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b7aae-c361-4e60-b27e-de6f0b8fb99b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:53.929058 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b7aae-c361-4e60-b27e-de6f0b8fb99b admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:53.929058 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b7aae-c361-4e60-b27e-de6f0b8fb99b admin admin] PATH_INFO: `/v3/users/da21d5e703a047289db109435e222aa1` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:53.933649 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b7aae-c361-4e60-b27e-de6f0b8fb99b admin admin] RBAC: Authorizing `identity:delete_user(user_id=da21d5e703a047289db109435e222aa1)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:53.936287 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b7aae-c361-4e60-b27e-de6f0b8fb99b admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:54.188166 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-637b7aae-c361-4e60-b27e-de6f0b8fb99b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da21d5e703a047289db109435e222aa1'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:54.216888 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-637b7aae-c361-4e60-b27e-de6f0b8fb99b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da21d5e703a047289db109435e222aa1'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:54.218446 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-637b7aae-c361-4e60-b27e-de6f0b8fb99b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da21d5e703a047289db109435e222aa1'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:54.220362 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-637b7aae-c361-4e60-b27e-de6f0b8fb99b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da21d5e703a047289db109435e222aa1'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:54.259126 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:54.326407 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-637b7aae-c361-4e60-b27e-de6f0b8fb99b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da21d5e703a047289db109435e222aa1'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:54.367582 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1100/2182] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:07:53 2022] DELETE /identity/v3/users/da21d5e703a047289db109435e222aa1 => generated 0 bytes in 784 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:55.193099 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca594f1c-cfad-4023-8a94-bec6818a5a5b admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:55.194937 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-ca594f1c-cfad-4023-8a94-bec6818a5a5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:55.226268 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca594f1c-cfad-4023-8a94-bec6818a5a5b admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:55.333557 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35962d-b378-41c7-9575-7c381d90fca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:55.335048 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35962d-b378-41c7-9575-7c381d90fca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:55.335429 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35962d-b378-41c7-9575-7c381d90fca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:55.335768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35962d-b378-41c7-9575-7c381d90fca4 admin admin] PATH_INFO: `/v3/projects/11ae91824fb140138011b7a5d1b5ec18` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:55.338068 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f35962d-b378-41c7-9575-7c381d90fca4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11ae91824fb140138011b7a5d1b5ec18)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:55.340539 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f35962d-b378-41c7-9575-7c381d90fca4 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:55.475338 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-6f35962d-b378-41c7-9575-7c381d90fca4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11ae91824fb140138011b7a5d1b5ec18', 'request_id': 'req-6f35962d-b378-41c7-9575-7c381d90fca4'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:55.483259 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-6f35962d-b378-41c7-9575-7c381d90fca4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11ae91824fb140138011b7a5d1b5ec18', 'request_id': 'req-6f35962d-b378-41c7-9575-7c381d90fca4'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:55.490451 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-6f35962d-b378-41c7-9575-7c381d90fca4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11ae91824fb140138011b7a5d1b5ec18', 'request_id': 'req-6f35962d-b378-41c7-9575-7c381d90fca4'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:55.565618 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-6f35962d-b378-41c7-9575-7c381d90fca4 admin admin] The token cache is being invalidate because project 11ae91824fb140138011b7a5d1b5ec18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:07:55.566255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-6f35962d-b378-41c7-9575-7c381d90fca4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:55.567195 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-6f35962d-b378-41c7-9575-7c381d90fca4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:55.576579 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1083/2183] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:07:55 2022] DELETE /identity/v3/projects/11ae91824fb140138011b7a5d1b5ec18 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:55.580416 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609052f-0254-4f0d-b6bb-5c7deb9ebd66 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:55.581360 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609052f-0254-4f0d-b6bb-5c7deb9ebd66 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:55.581682 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609052f-0254-4f0d-b6bb-5c7deb9ebd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:55.602190 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-8609052f-0254-4f0d-b6bb-5c7deb9ebd66 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:55.604157 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-8609052f-0254-4f0d-b6bb-5c7deb9ebd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:55.697845 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1101/2184] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:55.706161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb82fe-6f3f-4b7a-b1d4-688b4898d516 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:55.707156 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb82fe-6f3f-4b7a-b1d4-688b4898d516 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:55.707648 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb82fe-6f3f-4b7a-b1d4-688b4898d516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:55.735407 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-f5cb82fe-6f3f-4b7a-b1d4-688b4898d516 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:55.737227 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-f5cb82fe-6f3f-4b7a-b1d4-688b4898d516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:55.746451 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1084/2185] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:55.752523 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609052f-0254-4f0d-b6bb-5c7deb9ebd66 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:55.768687 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609052f-0254-4f0d-b6bb-5c7deb9ebd66 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:55.779040 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b825997-5c42-40b8-bbfd-2374821c5e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:55.782010 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b825997-5c42-40b8-bbfd-2374821c5e3c admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:55.782473 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b825997-5c42-40b8-bbfd-2374821c5e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:55.782759 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b825997-5c42-40b8-bbfd-2374821c5e3c admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:55.783519 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b825997-5c42-40b8-bbfd-2374821c5e3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:07:55.788359 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b825997-5c42-40b8-bbfd-2374821c5e3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:55.790071 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b825997-5c42-40b8-bbfd-2374821c5e3c admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:55.833687 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1102/2186] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:07:55.838267 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb82fe-6f3f-4b7a-b1d4-688b4898d516 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:55.848807 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb82fe-6f3f-4b7a-b1d4-688b4898d516 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:55.855083 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea1890-5591-4318-b649-f97a9a0d2d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:55.855584 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea1890-5591-4318-b649-f97a9a0d2d17 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:55.855869 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea1890-5591-4318-b649-f97a9a0d2d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:55.856254 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea1890-5591-4318-b649-f97a9a0d2d17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:55.858526 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea1890-5591-4318-b649-f97a9a0d2d17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:55.861053 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea1890-5591-4318-b649-f97a9a0d2d17 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:55.958320 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1085/2187] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:07:55 2022] POST /identity/v3/projects => generated 387 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:07:55.960166 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b825997-5c42-40b8-bbfd-2374821c5e3c admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:55.976771 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b825997-5c42-40b8-bbfd-2374821c5e3c admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:56.071316 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b2ee2-2369-487f-b3b3-d7bdb5c0c608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:56.072224 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b2ee2-2369-487f-b3b3-d7bdb5c0c608 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:56.072611 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b2ee2-2369-487f-b3b3-d7bdb5c0c608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:56.072942 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b2ee2-2369-487f-b3b3-d7bdb5c0c608 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:56.073762 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b2ee2-2369-487f-b3b3-d7bdb5c0c608 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:56.075846 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b2ee2-2369-487f-b3b3-d7bdb5c0c608 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:56.148423 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:56.213100 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1103/2188] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:07:55 2022] POST /identity/v3/users => generated 294 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:07:56.217070 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea1890-5591-4318-b649-f97a9a0d2d17 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:56.237781 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea1890-5591-4318-b649-f97a9a0d2d17 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:56.244916 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282e860-819e-4462-a3bc-da2066eadb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:56.245652 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282e860-819e-4462-a3bc-da2066eadb29 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:56.245948 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282e860-819e-4462-a3bc-da2066eadb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:56.246229 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282e860-819e-4462-a3bc-da2066eadb29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:56.246973 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282e860-819e-4462-a3bc-da2066eadb29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:56.248623 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282e860-819e-4462-a3bc-da2066eadb29 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:56.262422 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1086/2189] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:07:56.267243 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b2ee2-2369-487f-b3b3-d7bdb5c0c608 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:56.281894 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b2ee2-2369-487f-b3b3-d7bdb5c0c608 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:56.288458 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede25e6-6c12-44fb-b064-3c18d92841c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:56.289265 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede25e6-6c12-44fb-b064-3c18d92841c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:56.289654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede25e6-6c12-44fb-b064-3c18d92841c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:56.290289 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede25e6-6c12-44fb-b064-3c18d92841c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:56.291711 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede25e6-6c12-44fb-b064-3c18d92841c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:56.293606 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede25e6-6c12-44fb-b064-3c18d92841c5 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:56.313186 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1104/2190] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:07:56.314681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282e860-819e-4462-a3bc-da2066eadb29 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:56.329482 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282e860-819e-4462-a3bc-da2066eadb29 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:56.342619 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e685b05-911e-4a92-9473-7a34d046912d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:56.343551 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e685b05-911e-4a92-9473-7a34d046912d admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:56.343841 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e685b05-911e-4a92-9473-7a34d046912d admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:56.344154 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e685b05-911e-4a92-9473-7a34d046912d admin admin] PATH_INFO: `/v3/projects/546f55f45d3e4e68bd1cbddd68c9fa9e/users/8ecbd074485a4d10a46fbc064a8aa48b/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:56.378350 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e685b05-911e-4a92-9473-7a34d046912d admin admin] RBAC: Authorizing `identity:create_grant(project_id=546f55f45d3e4e68bd1cbddd68c9fa9e, user_id=8ecbd074485a4d10a46fbc064a8aa48b, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:56.381476 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e685b05-911e-4a92-9473-7a34d046912d admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:56.482129 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1087/2191] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:07:56 2022] PUT /identity/v3/projects/546f55f45d3e4e68bd1cbddd68c9fa9e/users/8ecbd074485a4d10a46fbc064a8aa48b/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:56.494818 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb286c49-c2b8-4f04-add9-620a673ccae4 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:56.500149 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb286c49-c2b8-4f04-add9-620a673ccae4 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:56.500149 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb286c49-c2b8-4f04-add9-620a673ccae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:56.500149 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:56.527843 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-bb286c49-c2b8-4f04-add9-620a673ccae4 None None] MFA Rules not processed for user `8ecbd074485a4d10a46fbc064a8aa48b`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:56.529391 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-bb286c49-c2b8-4f04-add9-620a673ccae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:56.605915 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1105/2192] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:56.610421 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e685b05-911e-4a92-9473-7a34d046912d admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:56.712215 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e685b05-911e-4a92-9473-7a34d046912d admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:56.725167 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83376c05-3d5b-4c6d-b942-9f52e720b1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:56.727552 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83376c05-3d5b-4c6d-b942-9f52e720b1e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:56.727552 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83376c05-3d5b-4c6d-b942-9f52e720b1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:56.727552 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83376c05-3d5b-4c6d-b942-9f52e720b1e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:56.728332 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83376c05-3d5b-4c6d-b942-9f52e720b1e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:56.738830 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83376c05-3d5b-4c6d-b942-9f52e720b1e5 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:56.858016 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1088/2193] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:07:56 2022] POST /identity/v3/projects => generated 387 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 21:07:56.859218 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb286c49-c2b8-4f04-add9-620a673ccae4 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:56.899677 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb286c49-c2b8-4f04-add9-620a673ccae4 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:57.035660 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572141a-3a33-4169-98be-13e4eca249ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:57.037105 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572141a-3a33-4169-98be-13e4eca249ea admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:57.037497 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572141a-3a33-4169-98be-13e4eca249ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:57.037958 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572141a-3a33-4169-98be-13e4eca249ea admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:57.038938 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4572141a-3a33-4169-98be-13e4eca249ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:57.041399 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4572141a-3a33-4169-98be-13e4eca249ea admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:57.150694 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1106/2194] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:07:56 2022] POST /identity/v3/users => generated 300 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 21:07:57.155156 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83376c05-3d5b-4c6d-b942-9f52e720b1e5 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:57.173425 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83376c05-3d5b-4c6d-b942-9f52e720b1e5 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:57.197548 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd27ad4-8305-45ff-8a31-36d7f5ce97bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:57.197548 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd27ad4-8305-45ff-8a31-36d7f5ce97bb admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:57.197548 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd27ad4-8305-45ff-8a31-36d7f5ce97bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:57.197548 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd27ad4-8305-45ff-8a31-36d7f5ce97bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:57.198127 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd27ad4-8305-45ff-8a31-36d7f5ce97bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:57.198127 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd27ad4-8305-45ff-8a31-36d7f5ce97bb admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:57.208222 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1089/2195] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:07:57.212529 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572141a-3a33-4169-98be-13e4eca249ea admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:57.237562 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572141a-3a33-4169-98be-13e4eca249ea admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:57.245448 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d0e64-2c2d-42fd-991d-774c894dbe3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:57.245794 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d0e64-2c2d-42fd-991d-774c894dbe3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:57.246064 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d0e64-2c2d-42fd-991d-774c894dbe3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:57.252304 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d0e64-2c2d-42fd-991d-774c894dbe3c admin admin] PATH_INFO: `/v3/projects/1d8ce973c17241cdaacbf40eb8a06d2b/users/a40b4cbf65784290a96d5d4b3cfaa892/roles/86273ff072f3438d822e870272491768` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:57.280312 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d0e64-2c2d-42fd-991d-774c894dbe3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d8ce973c17241cdaacbf40eb8a06d2b, user_id=a40b4cbf65784290a96d5d4b3cfaa892, role_id=86273ff072f3438d822e870272491768)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:57.283005 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d0e64-2c2d-42fd-991d-774c894dbe3c admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:57.368162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1107/2196] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:07:57 2022] PUT /identity/v3/projects/1d8ce973c17241cdaacbf40eb8a06d2b/users/a40b4cbf65784290a96d5d4b3cfaa892/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:57.372723 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd27ad4-8305-45ff-8a31-36d7f5ce97bb admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:57.385198 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd27ad4-8305-45ff-8a31-36d7f5ce97bb admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:57.477458 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f24320-da68-4f12-aa40-8ce52ed426ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:57.478231 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f24320-da68-4f12-aa40-8ce52ed426ba admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:57.484363 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f24320-da68-4f12-aa40-8ce52ed426ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:57.485666 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f24320-da68-4f12-aa40-8ce52ed426ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:57.488132 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f24320-da68-4f12-aa40-8ce52ed426ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:57.492774 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f24320-da68-4f12-aa40-8ce52ed426ba admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:57.512504 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1090/2197] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:07:57.518070 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d0e64-2c2d-42fd-991d-774c894dbe3c admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:57.534466 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d0e64-2c2d-42fd-991d-774c894dbe3c admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:57.541935 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e40d8-6075-4267-a80c-48a9e44bad0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:57.543225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e40d8-6075-4267-a80c-48a9e44bad0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:57.543738 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e40d8-6075-4267-a80c-48a9e44bad0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:57.544210 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e40d8-6075-4267-a80c-48a9e44bad0a admin admin] PATH_INFO: `/v3/projects/1d8ce973c17241cdaacbf40eb8a06d2b/users/a40b4cbf65784290a96d5d4b3cfaa892/roles/86273ff072f3438d822e870272491768` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:57.546428 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e40d8-6075-4267-a80c-48a9e44bad0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d8ce973c17241cdaacbf40eb8a06d2b, user_id=a40b4cbf65784290a96d5d4b3cfaa892, role_id=86273ff072f3438d822e870272491768)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:57.550494 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e40d8-6075-4267-a80c-48a9e44bad0a admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:57.564921 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1108/2198] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:07:57 2022] PUT /identity/v3/projects/1d8ce973c17241cdaacbf40eb8a06d2b/users/a40b4cbf65784290a96d5d4b3cfaa892/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:07:57.583721 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b634cbd-ce27-4d05-b66f-e672a47f8ca8 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:57.586309 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b634cbd-ce27-4d05-b66f-e672a47f8ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:57.586730 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b634cbd-ce27-4d05-b66f-e672a47f8ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:57.675198 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-0b634cbd-ce27-4d05-b66f-e672a47f8ca8 None None] MFA Rules not processed for user `a40b4cbf65784290a96d5d4b3cfaa892`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:57.676765 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-0b634cbd-ce27-4d05-b66f-e672a47f8ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:57.873579 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1091/2199] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:57.899566 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e40d8-6075-4267-a80c-48a9e44bad0a admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:57.902148 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-2e7e40d8-6075-4267-a80c-48a9e44bad0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:57.967846 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e40d8-6075-4267-a80c-48a9e44bad0a admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:57.971656 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084b9ff-8086-4361-ad47-e62f408253b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:57.972486 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084b9ff-8086-4361-ad47-e62f408253b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:57.972780 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084b9ff-8086-4361-ad47-e62f408253b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:57.973064 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084b9ff-8086-4361-ad47-e62f408253b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:57.991726 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084b9ff-8086-4361-ad47-e62f408253b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:57.993545 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084b9ff-8086-4361-ad47-e62f408253b5 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:58.006507 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1109/2200] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:07:57 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:07:58.086074 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b634cbd-ce27-4d05-b66f-e672a47f8ca8 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:58.167874 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b634cbd-ce27-4d05-b66f-e672a47f8ca8 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:58.173537 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469aea8a-7f92-4343-b30b-b1dad2e9771f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:58.174247 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469aea8a-7f92-4343-b30b-b1dad2e9771f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:58.174541 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469aea8a-7f92-4343-b30b-b1dad2e9771f admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:58.174824 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469aea8a-7f92-4343-b30b-b1dad2e9771f admin admin] PATH_INFO: `/v3/users/8ecbd074485a4d10a46fbc064a8aa48b` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:58.176098 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469aea8a-7f92-4343-b30b-b1dad2e9771f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ecbd074485a4d10a46fbc064a8aa48b)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:58.178296 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469aea8a-7f92-4343-b30b-b1dad2e9771f admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:58.516155 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-469aea8a-7f92-4343-b30b-b1dad2e9771f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ecbd074485a4d10a46fbc064a8aa48b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:58.532258 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-469aea8a-7f92-4343-b30b-b1dad2e9771f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ecbd074485a4d10a46fbc064a8aa48b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:58.532258 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-469aea8a-7f92-4343-b30b-b1dad2e9771f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ecbd074485a4d10a46fbc064a8aa48b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:58.532258 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-469aea8a-7f92-4343-b30b-b1dad2e9771f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ecbd074485a4d10a46fbc064a8aa48b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:58.601347 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-469aea8a-7f92-4343-b30b-b1dad2e9771f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ecbd074485a4d10a46fbc064a8aa48b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:07:58.627516 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1092/2201] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:07:58 2022] DELETE /identity/v3/users/8ecbd074485a4d10a46fbc064a8aa48b => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:07:58.629936 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03564b2-34b9-4577-92d6-becd679cb592 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:58.630558 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03564b2-34b9-4577-92d6-becd679cb592 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:58.631291 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03564b2-34b9-4577-92d6-becd679cb592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:58.656772 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-f03564b2-34b9-4577-92d6-becd679cb592 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:07:58.660934 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-f03564b2-34b9-4577-92d6-becd679cb592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:58.741717 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1110/2202] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:07:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:07:58.753617 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469aea8a-7f92-4343-b30b-b1dad2e9771f admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:58.755529 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-469aea8a-7f92-4343-b30b-b1dad2e9771f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:58.939183 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469aea8a-7f92-4343-b30b-b1dad2e9771f admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:58.949566 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fcd4ad-aa5a-4874-8e49-127dd250fb06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:58.951892 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcd4ad-aa5a-4874-8e49-127dd250fb06 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:58.952314 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcd4ad-aa5a-4874-8e49-127dd250fb06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:58.952925 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcd4ad-aa5a-4874-8e49-127dd250fb06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:58.976697 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fcd4ad-aa5a-4874-8e49-127dd250fb06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:58.981810 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fcd4ad-aa5a-4874-8e49-127dd250fb06 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:07:58.991153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:59.015033 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1093/2203] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:07:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:07:59.115472 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:07:59.857670 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03564b2-34b9-4577-92d6-becd679cb592 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:07:59.874947 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-f03564b2-34b9-4577-92d6-becd679cb592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:07:59.898408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03564b2-34b9-4577-92d6-becd679cb592 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:07:59.908268 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf301e-9a5f-4fc8-9d4e-d61d3e01cee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:07:59.909202 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf301e-9a5f-4fc8-9d4e-d61d3e01cee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:07:59.909497 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf301e-9a5f-4fc8-9d4e-d61d3e01cee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:07:59.909777 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf301e-9a5f-4fc8-9d4e-d61d3e01cee8 admin admin] PATH_INFO: `/v3/projects/546f55f45d3e4e68bd1cbddd68c9fa9e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:07:59.911131 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf301e-9a5f-4fc8-9d4e-d61d3e01cee8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=546f55f45d3e4e68bd1cbddd68c9fa9e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:07:59.913666 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf301e-9a5f-4fc8-9d4e-d61d3e01cee8 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:00.092104 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-0baf301e-9a5f-4fc8-9d4e-d61d3e01cee8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '546f55f45d3e4e68bd1cbddd68c9fa9e', 'request_id': 'req-0baf301e-9a5f-4fc8-9d4e-d61d3e01cee8'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:00.100472 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-0baf301e-9a5f-4fc8-9d4e-d61d3e01cee8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '546f55f45d3e4e68bd1cbddd68c9fa9e', 'request_id': 'req-0baf301e-9a5f-4fc8-9d4e-d61d3e01cee8'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:00.106481 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-0baf301e-9a5f-4fc8-9d4e-d61d3e01cee8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '546f55f45d3e4e68bd1cbddd68c9fa9e', 'request_id': 'req-0baf301e-9a5f-4fc8-9d4e-d61d3e01cee8'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:00.229968 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-0baf301e-9a5f-4fc8-9d4e-d61d3e01cee8 admin admin] The token cache is being invalidate because project 546f55f45d3e4e68bd1cbddd68c9fa9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:08:00.230593 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-0baf301e-9a5f-4fc8-9d4e-d61d3e01cee8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:00.231724 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-0baf301e-9a5f-4fc8-9d4e-d61d3e01cee8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:00.235493 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1111/2204] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:07:59 2022] DELETE /identity/v3/projects/546f55f45d3e4e68bd1cbddd68c9fa9e => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:08:00.239556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fcd4ad-aa5a-4874-8e49-127dd250fb06 service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:00.250657 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fcd4ad-aa5a-4874-8e49-127dd250fb06 service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:00.324744 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24528ac2-cfdc-4c7b-a7d3-e7ff409b16ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:00.325646 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24528ac2-cfdc-4c7b-a7d3-e7ff409b16ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:00.325935 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24528ac2-cfdc-4c7b-a7d3-e7ff409b16ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:00.326216 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24528ac2-cfdc-4c7b-a7d3-e7ff409b16ad admin admin] PATH_INFO: `/v3/users/a40b4cbf65784290a96d5d4b3cfaa892` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:00.327447 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24528ac2-cfdc-4c7b-a7d3-e7ff409b16ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=a40b4cbf65784290a96d5d4b3cfaa892)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:00.329480 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24528ac2-cfdc-4c7b-a7d3-e7ff409b16ad admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:00.549650 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:00.564852 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-24528ac2-cfdc-4c7b-a7d3-e7ff409b16ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a40b4cbf65784290a96d5d4b3cfaa892'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:00.593509 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-24528ac2-cfdc-4c7b-a7d3-e7ff409b16ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a40b4cbf65784290a96d5d4b3cfaa892'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:00.595463 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-24528ac2-cfdc-4c7b-a7d3-e7ff409b16ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a40b4cbf65784290a96d5d4b3cfaa892'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:00.598142 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-24528ac2-cfdc-4c7b-a7d3-e7ff409b16ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a40b4cbf65784290a96d5d4b3cfaa892'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:00.643556 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:00.692412 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-24528ac2-cfdc-4c7b-a7d3-e7ff409b16ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a40b4cbf65784290a96d5d4b3cfaa892'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:00.771463 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1094/2205] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:08:00 2022] DELETE /identity/v3/users/a40b4cbf65784290a96d5d4b3cfaa892 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:08:01.431026 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf301e-9a5f-4fc8-9d4e-d61d3e01cee8 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:01.433867 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-0baf301e-9a5f-4fc8-9d4e-d61d3e01cee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:01.449225 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:01.454976 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf301e-9a5f-4fc8-9d4e-d61d3e01cee8 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:01.546705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd48b7-b96c-4152-9977-14637c4c0586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:01.547825 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:DELETE=3,keystone:SELECT=91,keystone:INSERT=6 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:01.548602 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd48b7-b96c-4152-9977-14637c4c0586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:01.554525 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd48b7-b96c-4152-9977-14637c4c0586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:01.554525 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd48b7-b96c-4152-9977-14637c4c0586 admin admin] PATH_INFO: `/v3/projects/1d8ce973c17241cdaacbf40eb8a06d2b` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:01.554525 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd48b7-b96c-4152-9977-14637c4c0586 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d8ce973c17241cdaacbf40eb8a06d2b)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:01.556837 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd48b7-b96c-4152-9977-14637c4c0586 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:01.738017 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-1ecd48b7-b96c-4152-9977-14637c4c0586 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d8ce973c17241cdaacbf40eb8a06d2b', 'request_id': 'req-1ecd48b7-b96c-4152-9977-14637c4c0586'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:01.745991 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-1ecd48b7-b96c-4152-9977-14637c4c0586 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d8ce973c17241cdaacbf40eb8a06d2b', 'request_id': 'req-1ecd48b7-b96c-4152-9977-14637c4c0586'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:01.752438 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-1ecd48b7-b96c-4152-9977-14637c4c0586 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d8ce973c17241cdaacbf40eb8a06d2b', 'request_id': 'req-1ecd48b7-b96c-4152-9977-14637c4c0586'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:01.828208 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-1ecd48b7-b96c-4152-9977-14637c4c0586 admin admin] The token cache is being invalidate because project 1d8ce973c17241cdaacbf40eb8a06d2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:08:01.828524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-1ecd48b7-b96c-4152-9977-14637c4c0586 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:01.829273 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-1ecd48b7-b96c-4152-9977-14637c4c0586 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:01.831201 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1112/2206] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:08:01 2022] DELETE /identity/v3/projects/1d8ce973c17241cdaacbf40eb8a06d2b => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:08:01.835953 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c0f24-139a-43bd-b619-9233de69c7b5 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:01.836286 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c0f24-139a-43bd-b619-9233de69c7b5 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:01.836731 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c0f24-139a-43bd-b619-9233de69c7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:01.890358 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-4a9c0f24-139a-43bd-b619-9233de69c7b5 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:08:01.897143 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-4a9c0f24-139a-43bd-b619-9233de69c7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:02.015658 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:02.018061 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1095/2207] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:08:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:08:02.027021 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4803c1-7d64-44df-babb-52ad32c77af3 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:02.027459 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4803c1-7d64-44df-babb-52ad32c77af3 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:02.028118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4803c1-7d64-44df-babb-52ad32c77af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:02.046962 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:02.049412 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-cb4803c1-7d64-44df-babb-52ad32c77af3 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:08:02.050719 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-cb4803c1-7d64-44df-babb-52ad32c77af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:02.060450 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1113/2208] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:08:02.064622 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c0f24-139a-43bd-b619-9233de69c7b5 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:02.076657 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c0f24-139a-43bd-b619-9233de69c7b5 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:02.081476 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a567079-d207-4a12-b88d-c3a92e157796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:02.087857 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a567079-d207-4a12-b88d-c3a92e157796 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:02.087857 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a567079-d207-4a12-b88d-c3a92e157796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:02.087857 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a567079-d207-4a12-b88d-c3a92e157796 admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:02.087857 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a567079-d207-4a12-b88d-c3a92e157796 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:08:02.087857 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a567079-d207-4a12-b88d-c3a92e157796 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:02.087857 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a567079-d207-4a12-b88d-c3a92e157796 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:02.099639 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1096/2209] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:08:02.104330 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4803c1-7d64-44df-babb-52ad32c77af3 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:02.114262 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4803c1-7d64-44df-babb-52ad32c77af3 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:02.119640 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f1a1d2-888c-49ba-85e7-97ae7d2da03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:02.120476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1a1d2-888c-49ba-85e7-97ae7d2da03a admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:02.120856 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1a1d2-888c-49ba-85e7-97ae7d2da03a admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:02.121204 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1a1d2-888c-49ba-85e7-97ae7d2da03a admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:02.121995 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f1a1d2-888c-49ba-85e7-97ae7d2da03a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:02.124154 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f1a1d2-888c-49ba-85e7-97ae7d2da03a admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:02.319651 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1114/2210] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:08:02 2022] POST /identity/v3/projects => generated 383 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 21:08:02.324668 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a567079-d207-4a12-b88d-c3a92e157796 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:02.339662 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a567079-d207-4a12-b88d-c3a92e157796 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:02.408275 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb74859-1082-479e-82d0-f8de2e285bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:02.409108 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb74859-1082-479e-82d0-f8de2e285bbe admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:02.409420 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb74859-1082-479e-82d0-f8de2e285bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:02.409680 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb74859-1082-479e-82d0-f8de2e285bbe admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:02.410399 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb74859-1082-479e-82d0-f8de2e285bbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:02.412497 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb74859-1082-479e-82d0-f8de2e285bbe admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:02.942283 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1097/2211] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:08:02 2022] POST /identity/v3/users => generated 292 bytes in 619 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:08:02.946502 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f1a1d2-888c-49ba-85e7-97ae7d2da03a admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:02.958022 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f1a1d2-888c-49ba-85e7-97ae7d2da03a admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:02.966441 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5aa06-f7d7-43ae-b5cc-9746c978d7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:02.967306 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5aa06-f7d7-43ae-b5cc-9746c978d7bb admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:02.967603 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5aa06-f7d7-43ae-b5cc-9746c978d7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:02.967914 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5aa06-f7d7-43ae-b5cc-9746c978d7bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:02.969581 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce5aa06-f7d7-43ae-b5cc-9746c978d7bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:02.971704 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce5aa06-f7d7-43ae-b5cc-9746c978d7bb admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:02.985806 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1115/2212] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:08:02.989793 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb74859-1082-479e-82d0-f8de2e285bbe admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:03.002607 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb74859-1082-479e-82d0-f8de2e285bbe admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:03.008531 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46de6e-f1ba-4229-8d0d-6a137ad20f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:03.009801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46de6e-f1ba-4229-8d0d-6a137ad20f92 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:03.010776 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46de6e-f1ba-4229-8d0d-6a137ad20f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:03.011228 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46de6e-f1ba-4229-8d0d-6a137ad20f92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:03.012165 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b46de6e-f1ba-4229-8d0d-6a137ad20f92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:03.013952 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b46de6e-f1ba-4229-8d0d-6a137ad20f92 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:03.039631 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1098/2213] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:08:03.043472 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5aa06-f7d7-43ae-b5cc-9746c978d7bb admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:03.061189 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5aa06-f7d7-43ae-b5cc-9746c978d7bb admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:03.069730 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a2149-7140-4493-a39b-a35c0f3425b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:03.070638 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a2149-7140-4493-a39b-a35c0f3425b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:03.070925 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a2149-7140-4493-a39b-a35c0f3425b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:03.071202 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a2149-7140-4493-a39b-a35c0f3425b3 admin admin] PATH_INFO: `/v3/projects/269c55be9bed44a2bc3467255c0bbeca/users/4a199df2c6874d22845c122efbc09d0b/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:03.095276 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a2149-7140-4493-a39b-a35c0f3425b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=269c55be9bed44a2bc3467255c0bbeca, user_id=4a199df2c6874d22845c122efbc09d0b, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:03.098948 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a2149-7140-4493-a39b-a35c0f3425b3 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:03.232635 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1116/2214] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:08:03 2022] PUT /identity/v3/projects/269c55be9bed44a2bc3467255c0bbeca/users/4a199df2c6874d22845c122efbc09d0b/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:08:03.236227 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672b5bf-51cf-4c15-8d07-e20c1edf892b None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:03.236530 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672b5bf-51cf-4c15-8d07-e20c1edf892b None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:03.236825 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672b5bf-51cf-4c15-8d07-e20c1edf892b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:03.283244 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-c672b5bf-51cf-4c15-8d07-e20c1edf892b None None] MFA Rules not processed for user `4a199df2c6874d22845c122efbc09d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:08:03.283244 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c672b5bf-51cf-4c15-8d07-e20c1edf892b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:03.376185 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1099/2215] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:08:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:08:03.386029 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a2149-7140-4493-a39b-a35c0f3425b3 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:03.387761 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-4b2a2149-7140-4493-a39b-a35c0f3425b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:03.470252 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:03.505614 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a2149-7140-4493-a39b-a35c0f3425b3 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:03.513394 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be2f28c-3e97-4093-b7ca-d1dd83ae179b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:03.514100 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2f28c-3e97-4093-b7ca-d1dd83ae179b service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:03.514397 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2f28c-3e97-4093-b7ca-d1dd83ae179b service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:03.514912 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2f28c-3e97-4093-b7ca-d1dd83ae179b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:03.528948 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be2f28c-3e97-4093-b7ca-d1dd83ae179b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:03.530440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be2f28c-3e97-4093-b7ca-d1dd83ae179b service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:03.542491 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1117/2216] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:08:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:08:03.574222 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672b5bf-51cf-4c15-8d07-e20c1edf892b None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:03.688017 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672b5bf-51cf-4c15-8d07-e20c1edf892b None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:03.704156 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e7e81-6fc5-403a-94ca-b6808462a1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:03.704156 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e7e81-6fc5-403a-94ca-b6808462a1c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:03.704156 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e7e81-6fc5-403a-94ca-b6808462a1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:03.704156 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e7e81-6fc5-403a-94ca-b6808462a1c8 admin admin] PATH_INFO: `/v3/users/4a199df2c6874d22845c122efbc09d0b` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:03.704556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e7e81-6fc5-403a-94ca-b6808462a1c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a199df2c6874d22845c122efbc09d0b)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:03.704556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e7e81-6fc5-403a-94ca-b6808462a1c8 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:03.890799 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:04.001206 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c70e7e81-6fc5-403a-94ca-b6808462a1c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a199df2c6874d22845c122efbc09d0b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:04.033924 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c70e7e81-6fc5-403a-94ca-b6808462a1c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a199df2c6874d22845c122efbc09d0b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:04.035066 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c70e7e81-6fc5-403a-94ca-b6808462a1c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a199df2c6874d22845c122efbc09d0b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:04.036312 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c70e7e81-6fc5-403a-94ca-b6808462a1c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a199df2c6874d22845c122efbc09d0b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:04.101848 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c70e7e81-6fc5-403a-94ca-b6808462a1c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a199df2c6874d22845c122efbc09d0b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:04.122698 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1100/2217] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:08:03 2022] DELETE /identity/v3/users/4a199df2c6874d22845c122efbc09d0b => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:08:04.130287 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d0ddf-933a-449f-945b-eda4915ca906 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:04.131947 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d0ddf-933a-449f-945b-eda4915ca906 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:04.132807 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d0ddf-933a-449f-945b-eda4915ca906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:04.158068 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-b17d0ddf-933a-449f-945b-eda4915ca906 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:08:04.159395 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-b17d0ddf-933a-449f-945b-eda4915ca906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:04.236883 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1118/2218] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:08:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:08:04.248014 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e7e81-6fc5-403a-94ca-b6808462a1c8 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:04.249707 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c70e7e81-6fc5-403a-94ca-b6808462a1c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:04.321039 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e7e81-6fc5-403a-94ca-b6808462a1c8 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:04.325395 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b4057-b12a-4137-82e4-47fc36563664 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:04.326057 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b4057-b12a-4137-82e4-47fc36563664 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:04.326345 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b4057-b12a-4137-82e4-47fc36563664 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:04.326626 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b4057-b12a-4137-82e4-47fc36563664 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:04.335804 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959b4057-b12a-4137-82e4-47fc36563664 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:04.337290 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959b4057-b12a-4137-82e4-47fc36563664 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:04.346900 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1101/2219] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:08:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:08:04.387401 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fd82c-66b6-4231-82e2-95298e4dd0e1 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:04.387724 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fd82c-66b6-4231-82e2-95298e4dd0e1 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:04.388593 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fd82c-66b6-4231-82e2-95298e4dd0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:04.410482 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-702fd82c-66b6-4231-82e2-95298e4dd0e1 None None] MFA Rules not processed for user `34f3f599bae64665af3b77c52f03ea3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:08:04.411882 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-702fd82c-66b6-4231-82e2-95298e4dd0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:04.488097 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1119/2220] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:08:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:08:04.941846 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:05.079338 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b4057-b12a-4137-82e4-47fc36563664 service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:05.080885 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-959b4057-b12a-4137-82e4-47fc36563664 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:05.096673 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b4057-b12a-4137-82e4-47fc36563664 service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:05.123421 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b771feb-db23-4eec-a2b9-c9768fc0ef3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:05.132973 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b771feb-db23-4eec-a2b9-c9768fc0ef3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:05.132973 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b771feb-db23-4eec-a2b9-c9768fc0ef3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:05.132973 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b771feb-db23-4eec-a2b9-c9768fc0ef3f admin admin] PATH_INFO: `/v3/projects/269c55be9bed44a2bc3467255c0bbeca` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:05.132973 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b771feb-db23-4eec-a2b9-c9768fc0ef3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=269c55be9bed44a2bc3467255c0bbeca)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:05.132973 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b771feb-db23-4eec-a2b9-c9768fc0ef3f admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:05.291166 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-0b771feb-db23-4eec-a2b9-c9768fc0ef3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '269c55be9bed44a2bc3467255c0bbeca', 'request_id': 'req-0b771feb-db23-4eec-a2b9-c9768fc0ef3f'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:05.303579 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-0b771feb-db23-4eec-a2b9-c9768fc0ef3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '269c55be9bed44a2bc3467255c0bbeca', 'request_id': 'req-0b771feb-db23-4eec-a2b9-c9768fc0ef3f'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:05.311534 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-0b771feb-db23-4eec-a2b9-c9768fc0ef3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '269c55be9bed44a2bc3467255c0bbeca', 'request_id': 'req-0b771feb-db23-4eec-a2b9-c9768fc0ef3f'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:05.343250 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:05.406721 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-0b771feb-db23-4eec-a2b9-c9768fc0ef3f admin admin] The token cache is being invalidate because project 269c55be9bed44a2bc3467255c0bbeca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:08:05.406947 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-0b771feb-db23-4eec-a2b9-c9768fc0ef3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:05.407857 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-0b771feb-db23-4eec-a2b9-c9768fc0ef3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:05.410107 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1102/2221] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:08:05 2022] DELETE /identity/v3/projects/269c55be9bed44a2bc3467255c0bbeca => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:08:05.415076 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36551665-0ea2-4ef4-bfbd-a6045750810f None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:05.416291 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36551665-0ea2-4ef4-bfbd-a6045750810f None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:05.416291 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36551665-0ea2-4ef4-bfbd-a6045750810f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:05.440639 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-36551665-0ea2-4ef4-bfbd-a6045750810f None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:08:05.442160 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-36551665-0ea2-4ef4-bfbd-a6045750810f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:05.521652 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1120/2222] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:08:05.529953 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198d7f7-3c82-4e93-81ae-da094b107d7e None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:05.530243 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198d7f7-3c82-4e93-81ae-da094b107d7e None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:05.530521 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198d7f7-3c82-4e93-81ae-da094b107d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:05.549995 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-4198d7f7-3c82-4e93-81ae-da094b107d7e None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:08:05.551451 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-4198d7f7-3c82-4e93-81ae-da094b107d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:05.559998 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1103/2223] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:08:05.564469 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36551665-0ea2-4ef4-bfbd-a6045750810f None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:05.576284 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36551665-0ea2-4ef4-bfbd-a6045750810f None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:05.581731 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956cca8-b154-4580-be47-5cc1e4a5dc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:05.582403 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956cca8-b154-4580-be47-5cc1e4a5dc75 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:05.582699 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956cca8-b154-4580-be47-5cc1e4a5dc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:05.582993 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956cca8-b154-4580-be47-5cc1e4a5dc75 admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:05.583726 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956cca8-b154-4580-be47-5cc1e4a5dc75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:08:05.584089 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956cca8-b154-4580-be47-5cc1e4a5dc75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:05.585703 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956cca8-b154-4580-be47-5cc1e4a5dc75 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:05.598477 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1121/2224] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:08:05.605020 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198d7f7-3c82-4e93-81ae-da094b107d7e None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:05.616283 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198d7f7-3c82-4e93-81ae-da094b107d7e None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:05.622338 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f524340b-e74f-456f-8e22-a0af025fcb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:05.623091 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524340b-e74f-456f-8e22-a0af025fcb01 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:05.623594 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524340b-e74f-456f-8e22-a0af025fcb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:05.624004 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524340b-e74f-456f-8e22-a0af025fcb01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:05.624970 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f524340b-e74f-456f-8e22-a0af025fcb01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:05.626958 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f524340b-e74f-456f-8e22-a0af025fcb01 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:05.760554 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1104/2225] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:08:05 2022] POST /identity/v3/projects => generated 371 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:08:05.761525 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956cca8-b154-4580-be47-5cc1e4a5dc75 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:05.776263 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956cca8-b154-4580-be47-5cc1e4a5dc75 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:05.849425 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d4920-7ed4-4e8f-9d4e-4ee20ed35c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:05.853126 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d4920-7ed4-4e8f-9d4e-4ee20ed35c0f admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:05.853126 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d4920-7ed4-4e8f-9d4e-4ee20ed35c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:05.853126 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d4920-7ed4-4e8f-9d4e-4ee20ed35c0f admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:05.853126 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d4920-7ed4-4e8f-9d4e-4ee20ed35c0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:05.854208 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d4920-7ed4-4e8f-9d4e-4ee20ed35c0f admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:05.976655 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1122/2226] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:08:05 2022] POST /identity/v3/users => generated 286 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:08:05.977569 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f524340b-e74f-456f-8e22-a0af025fcb01 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:05.990236 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f524340b-e74f-456f-8e22-a0af025fcb01 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:05.996067 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a918221-d224-4419-b21e-297a62961900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:05.996785 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a918221-d224-4419-b21e-297a62961900 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:05.997076 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a918221-d224-4419-b21e-297a62961900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:05.997358 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a918221-d224-4419-b21e-297a62961900 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:05.998138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a918221-d224-4419-b21e-297a62961900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:05.999833 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a918221-d224-4419-b21e-297a62961900 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:06.011853 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1105/2227] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:08:06.015827 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d4920-7ed4-4e8f-9d4e-4ee20ed35c0f admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:06.029142 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d4920-7ed4-4e8f-9d4e-4ee20ed35c0f admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:06.034039 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad44f40-b9b1-4e26-9098-0dcc9890f85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:06.034748 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad44f40-b9b1-4e26-9098-0dcc9890f85c admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:06.035167 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad44f40-b9b1-4e26-9098-0dcc9890f85c admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:06.035452 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad44f40-b9b1-4e26-9098-0dcc9890f85c admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:06.036238 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad44f40-b9b1-4e26-9098-0dcc9890f85c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:06.037902 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad44f40-b9b1-4e26-9098-0dcc9890f85c admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:06.049959 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1123/2228] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:08:06.056796 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a918221-d224-4419-b21e-297a62961900 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:06.070021 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a918221-d224-4419-b21e-297a62961900 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:06.076555 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b940af5-ca6e-4ff4-b3e9-51bdb42964d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:06.077492 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b940af5-ca6e-4ff4-b3e9-51bdb42964d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:06.077772 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b940af5-ca6e-4ff4-b3e9-51bdb42964d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:06.078102 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b940af5-ca6e-4ff4-b3e9-51bdb42964d2 admin admin] PATH_INFO: `/v3/projects/cf6620a75d7245f683da286afa4d76ce/users/33c95dd165934af4b2bd741ff35ae622/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:06.094693 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b940af5-ca6e-4ff4-b3e9-51bdb42964d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf6620a75d7245f683da286afa4d76ce, user_id=33c95dd165934af4b2bd741ff35ae622, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:06.098091 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b940af5-ca6e-4ff4-b3e9-51bdb42964d2 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:06.189378 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2691553-855f-4ff3-a748-ef45958f678e None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:06.189675 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2691553-855f-4ff3-a748-ef45958f678e None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:06.189961 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2691553-855f-4ff3-a748-ef45958f678e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:06.210862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1106/2229] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:08:06 2022] PUT /identity/v3/projects/cf6620a75d7245f683da286afa4d76ce/users/33c95dd165934af4b2bd741ff35ae622/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:08:06.213354 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904de1fa-652a-4d5d-ae16-fa088867ccec None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:06.213869 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904de1fa-652a-4d5d-ae16-fa088867ccec None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:06.214330 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904de1fa-652a-4d5d-ae16-fa088867ccec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:06.217746 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-a2691553-855f-4ff3-a748-ef45958f678e None None] MFA Rules not processed for user `6b67d92f0f644bc0861995318d10441c`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:08:06.219043 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a2691553-855f-4ff3-a748-ef45958f678e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:06.232108 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-904de1fa-652a-4d5d-ae16-fa088867ccec None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:08:06.233349 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-904de1fa-652a-4d5d-ae16-fa088867ccec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:06.277876 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1124/2230] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:08:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:08:06.300882 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1107/2231] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:08:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:08:06.308841 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2691553-855f-4ff3-a748-ef45958f678e None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:06.310901 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a2691553-855f-4ff3-a748-ef45958f678e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:06.387018 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2691553-855f-4ff3-a748-ef45958f678e None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:06.389792 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:06.396809 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9c8d9-d5f8-47af-8061-68227f981d98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:06.396809 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9c8d9-d5f8-47af-8061-68227f981d98 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:06.396809 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9c8d9-d5f8-47af-8061-68227f981d98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:06.396809 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9c8d9-d5f8-47af-8061-68227f981d98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:06.405864 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc9c8d9-d5f8-47af-8061-68227f981d98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:06.407295 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc9c8d9-d5f8-47af-8061-68227f981d98 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:06.417203 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1125/2232] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:08:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 21:08:06.421745 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29934d9-5102-4560-b5cf-ee11ffd7761e None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:06.422132 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29934d9-5102-4560-b5cf-ee11ffd7761e None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:06.422486 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29934d9-5102-4560-b5cf-ee11ffd7761e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:06.447885 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-b29934d9-5102-4560-b5cf-ee11ffd7761e None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:08:06.449407 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b29934d9-5102-4560-b5cf-ee11ffd7761e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:06.458482 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1108/2233] 10.222.0.27 () {58 vars in 1016 bytes} [Mon Jul 11 21:08:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:08:06.472295 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9c8d9-d5f8-47af-8061-68227f981d98 service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:06.473767 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-9bc9c8d9-d5f8-47af-8061-68227f981d98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:06.549914 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9c8d9-d5f8-47af-8061-68227f981d98 service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:06.556678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b8b8b-ea1d-433a-8c5d-007a2a17e2cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:06.557489 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b8b8b-ea1d-433a-8c5d-007a2a17e2cc service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:06.557779 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b8b8b-ea1d-433a-8c5d-007a2a17e2cc service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:06.559265 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b8b8b-ea1d-433a-8c5d-007a2a17e2cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:06.567898 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42b8b8b-ea1d-433a-8c5d-007a2a17e2cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:06.569767 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42b8b8b-ea1d-433a-8c5d-007a2a17e2cc service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:06.580761 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1126/2234] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:08:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:08:06.630073 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:07.359848 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:07.617927 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:08.173748 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60122de0-0794-40cb-a2da-ad0eb9759e91 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:08.174050 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60122de0-0794-40cb-a2da-ad0eb9759e91 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:08.174334 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60122de0-0794-40cb-a2da-ad0eb9759e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:08.209020 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-60122de0-0794-40cb-a2da-ad0eb9759e91 None None] MFA Rules not processed for user `33c95dd165934af4b2bd741ff35ae622`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:08:08.210638 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-60122de0-0794-40cb-a2da-ad0eb9759e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:08.321166 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:08.346728 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1109/2235] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:08:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:08:08.360146 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b8b8b-ea1d-433a-8c5d-007a2a17e2cc service nova] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:08.361475 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a42b8b8b-ea1d-433a-8c5d-007a2a17e2cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:08.438413 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b8b8b-ea1d-433a-8c5d-007a2a17e2cc service nova] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:08.442882 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b98da6-f0e5-4a1f-aabe-cd3befae8b4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:08.444130 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b98da6-f0e5-4a1f-aabe-cd3befae8b4e service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:08.444627 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b98da6-f0e5-4a1f-aabe-cd3befae8b4e service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:08.445117 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b98da6-f0e5-4a1f-aabe-cd3befae8b4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:08.458691 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b98da6-f0e5-4a1f-aabe-cd3befae8b4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:08.460472 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b98da6-f0e5-4a1f-aabe-cd3befae8b4e service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:08.482017 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1127/2236] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:08:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:08:08.511308 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:09.828171 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:10.208104 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf9e29-84b3-494a-b75a-a4acb61f9048 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:10.208576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf9e29-84b3-494a-b75a-a4acb61f9048 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:10.208864 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf9e29-84b3-494a-b75a-a4acb61f9048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:10.230426 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-5faf9e29-84b3-494a-b75a-a4acb61f9048 None None] MFA Rules not processed for user `33c95dd165934af4b2bd741ff35ae622`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:08:10.231763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-5faf9e29-84b3-494a-b75a-a4acb61f9048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:10.239343 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1110/2237] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:08:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:08:10.286130 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:11.303946 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:11.714222 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c5e9c-efa3-4e0c-bb21-fb360810f541 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:11.714222 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c5e9c-efa3-4e0c-bb21-fb360810f541 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:11.714222 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c5e9c-efa3-4e0c-bb21-fb360810f541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:11.742452 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-bd4c5e9c-efa3-4e0c-bb21-fb360810f541 None None] MFA Rules not processed for user `90ea5d52fd6d4068b7837d363eebb94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:08:11.745221 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-bd4c5e9c-efa3-4e0c-bb21-fb360810f541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:11.794019 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:11.894164 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1128/2238] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Jul 11 21:08:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:08:11.909908 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf9e29-84b3-494a-b75a-a4acb61f9048 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:11.911395 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-5faf9e29-84b3-494a-b75a-a4acb61f9048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:11.940712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c3362-58e9-4a81-a76e-c5a2b97c9c6f None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:11.941273 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c3362-58e9-4a81-a76e-c5a2b97c9c6f None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:11.943448 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c3362-58e9-4a81-a76e-c5a2b97c9c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:11.965588 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-005c3362-58e9-4a81-a76e-c5a2b97c9c6f None None] MFA Rules not processed for user `90ea5d52fd6d4068b7837d363eebb94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:08:11.967187 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-005c3362-58e9-4a81-a76e-c5a2b97c9c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:11.983112 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1129/2239] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Jul 11 21:08:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:08:11.992613 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c3362-58e9-4a81-a76e-c5a2b97c9c6f None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:11.995861 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-005c3362-58e9-4a81-a76e-c5a2b97c9c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:12.032564 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf9e29-84b3-494a-b75a-a4acb61f9048 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:12.046784 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c745c5fe-f08b-435c-b3ed-520b31f29880 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc950dfb1d3b4308a33f3d430fe34c1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:12.049686 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745c5fe-f08b-435c-b3ed-520b31f29880 service swift] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:12.049983 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745c5fe-f08b-435c-b3ed-520b31f29880 service swift] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:12.050269 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745c5fe-f08b-435c-b3ed-520b31f29880 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:12.065740 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c745c5fe-f08b-435c-b3ed-520b31f29880 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:12.068209 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c745c5fe-f08b-435c-b3ed-520b31f29880 service swift] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:12.079260 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1111/2240] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jul 11 21:08:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 21:08:12.091128 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:12.103296 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c3362-58e9-4a81-a76e-c5a2b97c9c6f None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:12.110339 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff16c0-f44f-425f-9ff4-dc941a75c371 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc950dfb1d3b4308a33f3d430fe34c1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:12.111071 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff16c0-f44f-425f-9ff4-dc941a75c371 service swift] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:12.111364 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff16c0-f44f-425f-9ff4-dc941a75c371 service swift] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:12.112008 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff16c0-f44f-425f-9ff4-dc941a75c371 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:12.122082 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff16c0-f44f-425f-9ff4-dc941a75c371 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:12.123792 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff16c0-f44f-425f-9ff4-dc941a75c371 service swift] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:12.135958 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374505df-3512-4b99-93e5-8afec2fe3935 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:12.136409 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374505df-3512-4b99-93e5-8afec2fe3935 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:12.136994 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374505df-3512-4b99-93e5-8afec2fe3935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:12.163591 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1130/2241] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jul 11 21:08:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 21:08:12.231506 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-374505df-3512-4b99-93e5-8afec2fe3935 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:08:12.232902 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-374505df-3512-4b99-93e5-8afec2fe3935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:12.257173 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1112/2242] 10.222.0.27 () {58 vars in 1016 bytes} [Mon Jul 11 21:08:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:08:12.392947 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff16c0-f44f-425f-9ff4-dc941a75c371 service swift] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:12.397782 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-ccff16c0-f44f-425f-9ff4-dc941a75c371 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:12.414823 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff16c0-f44f-425f-9ff4-dc941a75c371 service swift] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:12.423587 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a87e6-418f-490e-9fff-8dc6af21b079 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:12.424191 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a87e6-418f-490e-9fff-8dc6af21b079 service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:12.424851 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a87e6-418f-490e-9fff-8dc6af21b079 service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:12.425150 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a87e6-418f-490e-9fff-8dc6af21b079 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:12.436540 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a87e6-418f-490e-9fff-8dc6af21b079 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:12.448225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a87e6-418f-490e-9fff-8dc6af21b079 service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:12.484246 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1131/2243] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:08:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:08:13.506095 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcaaf01-4f58-4d32-b871-94b82398439e None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:13.506095 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcaaf01-4f58-4d32-b871-94b82398439e None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:13.506095 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcaaf01-4f58-4d32-b871-94b82398439e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:13.527561 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-cfcaaf01-4f58-4d32-b871-94b82398439e None None] MFA Rules not processed for user `90ea5d52fd6d4068b7837d363eebb94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:08:13.528986 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-cfcaaf01-4f58-4d32-b871-94b82398439e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:13.536881 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1113/2244] 10.222.0.40 () {58 vars in 967 bytes} [Mon Jul 11 21:08:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:08:13.557528 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a87e6-418f-490e-9fff-8dc6af21b079 service nova] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:13.568838 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a87e6-418f-490e-9fff-8dc6af21b079 service nova] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:13.574492 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea87c86-b5ff-4d31-8069-8b4c1067a2a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc950dfb1d3b4308a33f3d430fe34c1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:13.575446 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea87c86-b5ff-4d31-8069-8b4c1067a2a1 service swift] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:13.575921 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea87c86-b5ff-4d31-8069-8b4c1067a2a1 service swift] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:13.576230 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea87c86-b5ff-4d31-8069-8b4c1067a2a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:13.585346 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea87c86-b5ff-4d31-8069-8b4c1067a2a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:13.586955 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea87c86-b5ff-4d31-8069-8b4c1067a2a1 service swift] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:13.596572 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1132/2245] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jul 11 21:08:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 21:08:14.297931 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea2a2b-47f5-4581-b6c6-2f7d04db3b77 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:14.303935 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea2a2b-47f5-4581-b6c6-2f7d04db3b77 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:14.303935 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea2a2b-47f5-4581-b6c6-2f7d04db3b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:14.321065 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:14.341113 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-8aea2a2b-47f5-4581-b6c6-2f7d04db3b77 None None] MFA Rules not processed for user `90ea5d52fd6d4068b7837d363eebb94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:08:14.345351 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-8aea2a2b-47f5-4581-b6c6-2f7d04db3b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:14.354358 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:14.378264 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1114/2246] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Jul 11 21:08:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:08:14.407027 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea87c86-b5ff-4d31-8069-8b4c1067a2a1 service swift] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:14.421094 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea87c86-b5ff-4d31-8069-8b4c1067a2a1 service swift] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:14.436061 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e454afc-6583-494a-ab7b-0e4f328111fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc950dfb1d3b4308a33f3d430fe34c1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:14.436807 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e454afc-6583-494a-ab7b-0e4f328111fa service swift] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:14.437434 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e454afc-6583-494a-ab7b-0e4f328111fa service swift] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:14.437734 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e454afc-6583-494a-ab7b-0e4f328111fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:14.463354 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e454afc-6583-494a-ab7b-0e4f328111fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:14.466898 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e454afc-6583-494a-ab7b-0e4f328111fa service swift] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:14.490501 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1133/2247] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jul 11 21:08:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 21:08:15.360551 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee27c02-7c9c-49b4-957f-8af7d7d2c0dc None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:15.361380 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee27c02-7c9c-49b4-957f-8af7d7d2c0dc None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:15.361888 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee27c02-7c9c-49b4-957f-8af7d7d2c0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:15.376459 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e454afc-6583-494a-ab7b-0e4f328111fa service swift] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:15.378561 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-7e454afc-6583-494a-ab7b-0e4f328111fa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:15.387479 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-2ee27c02-7c9c-49b4-957f-8af7d7d2c0dc None None] MFA Rules not processed for user `90ea5d52fd6d4068b7837d363eebb94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:08:15.389180 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-2ee27c02-7c9c-49b4-957f-8af7d7d2c0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:15.400183 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1115/2248] 10.222.0.40 () {58 vars in 967 bytes} [Mon Jul 11 21:08:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:08:15.404519 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e454afc-6583-494a-ab7b-0e4f328111fa service swift] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:15.420926 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6b64b-5e74-45fb-b9c3-360a46192b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:15.420926 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6b64b-5e74-45fb-b9c3-360a46192b15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:15.420926 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6b64b-5e74-45fb-b9c3-360a46192b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:15.420926 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6b64b-5e74-45fb-b9c3-360a46192b15 admin admin] PATH_INFO: `/v3/users/0908feda0c8645eea9ec7021db1d2add` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:15.421770 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6b64b-5e74-45fb-b9c3-360a46192b15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0908feda0c8645eea9ec7021db1d2add)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:15.421941 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6b64b-5e74-45fb-b9c3-360a46192b15 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:15.428125 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee27c02-7c9c-49b4-957f-8af7d7d2c0dc None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:15.445448 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee27c02-7c9c-49b4-957f-8af7d7d2c0dc None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:15.452476 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a5ee4-bb87-4441-aea3-82ba338ccf41 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc950dfb1d3b4308a33f3d430fe34c1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:15.453152 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a5ee4-bb87-4441-aea3-82ba338ccf41 service swift] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:15.453902 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a5ee4-bb87-4441-aea3-82ba338ccf41 service swift] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:15.454197 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a5ee4-bb87-4441-aea3-82ba338ccf41 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:15.466841 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221a5ee4-bb87-4441-aea3-82ba338ccf41 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:15.469090 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221a5ee4-bb87-4441-aea3-82ba338ccf41 service swift] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:15.487917 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1116/2249] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jul 11 21:08:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 21:08:15.688313 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a8a6b64b-5e74-45fb-b9c3-360a46192b15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0908feda0c8645eea9ec7021db1d2add'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:15.705155 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a8a6b64b-5e74-45fb-b9c3-360a46192b15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0908feda0c8645eea9ec7021db1d2add'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:15.706651 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a8a6b64b-5e74-45fb-b9c3-360a46192b15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0908feda0c8645eea9ec7021db1d2add'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:15.707764 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a8a6b64b-5e74-45fb-b9c3-360a46192b15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0908feda0c8645eea9ec7021db1d2add'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:15.778748 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:15.779648 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a8a6b64b-5e74-45fb-b9c3-360a46192b15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0908feda0c8645eea9ec7021db1d2add'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:15.821219 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1134/2250] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:08:15 2022] DELETE /identity/v3/users/0908feda0c8645eea9ec7021db1d2add => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:08:15.919294 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:16.256506 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a5ee4-bb87-4441-aea3-82ba338ccf41 service swift] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:16.318371 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a5ee4-bb87-4441-aea3-82ba338ccf41 service swift] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:16.324464 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:16.430379 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:16.474663 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:16.491822 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350ada1-767c-4794-8d1f-81695d4e51e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:16.493081 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350ada1-767c-4794-8d1f-81695d4e51e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:16.493959 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350ada1-767c-4794-8d1f-81695d4e51e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:16.495401 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350ada1-767c-4794-8d1f-81695d4e51e2 admin admin] PATH_INFO: `/v3/projects/d5c3c899ba6448b3b962b30f54a36db1` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:16.498052 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d350ada1-767c-4794-8d1f-81695d4e51e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5c3c899ba6448b3b962b30f54a36db1)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:16.501724 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d350ada1-767c-4794-8d1f-81695d4e51e2 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:16.639307 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d350ada1-767c-4794-8d1f-81695d4e51e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5c3c899ba6448b3b962b30f54a36db1', 'request_id': 'req-d350ada1-767c-4794-8d1f-81695d4e51e2'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:16.647891 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d350ada1-767c-4794-8d1f-81695d4e51e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5c3c899ba6448b3b962b30f54a36db1', 'request_id': 'req-d350ada1-767c-4794-8d1f-81695d4e51e2'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:16.655531 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d350ada1-767c-4794-8d1f-81695d4e51e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5c3c899ba6448b3b962b30f54a36db1', 'request_id': 'req-d350ada1-767c-4794-8d1f-81695d4e51e2'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:16.772210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d350ada1-767c-4794-8d1f-81695d4e51e2 admin admin] The token cache is being invalidate because project d5c3c899ba6448b3b962b30f54a36db1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:08:16.772508 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d350ada1-767c-4794-8d1f-81695d4e51e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:16.773415 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d350ada1-767c-4794-8d1f-81695d4e51e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:16.775163 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1117/2251] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:08:16 2022] DELETE /identity/v3/projects/d5c3c899ba6448b3b962b30f54a36db1 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:08:16.890531 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6b64b-5e74-45fb-b9c3-360a46192b15 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:16.890531 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a8a6b64b-5e74-45fb-b9c3-360a46192b15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:16.903432 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6b64b-5e74-45fb-b9c3-360a46192b15 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:17.033741 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5244a-ae6b-4329-bdc4-ea0e73c84089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:17.036464 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5244a-ae6b-4329-bdc4-ea0e73c84089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:17.040236 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5244a-ae6b-4329-bdc4-ea0e73c84089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:17.041569 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5244a-ae6b-4329-bdc4-ea0e73c84089 admin admin] PATH_INFO: `/v3/users/5c040dc8d3434d8e8b4b09d572e64333` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:17.044744 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d5244a-ae6b-4329-bdc4-ea0e73c84089 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c040dc8d3434d8e8b4b09d572e64333)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:17.047878 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d5244a-ae6b-4329-bdc4-ea0e73c84089 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:17.811622 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:17.850174 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-e2d5244a-ae6b-4329-bdc4-ea0e73c84089 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c040dc8d3434d8e8b4b09d572e64333'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:17.857988 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-e2d5244a-ae6b-4329-bdc4-ea0e73c84089 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c040dc8d3434d8e8b4b09d572e64333'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:17.858667 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-e2d5244a-ae6b-4329-bdc4-ea0e73c84089 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c040dc8d3434d8e8b4b09d572e64333'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:17.859324 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-e2d5244a-ae6b-4329-bdc4-ea0e73c84089 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c040dc8d3434d8e8b4b09d572e64333'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:17.949566 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-e2d5244a-ae6b-4329-bdc4-ea0e73c84089 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c040dc8d3434d8e8b4b09d572e64333'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:17.970640 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1135/2252] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:08:16 2022] DELETE /identity/v3/users/5c040dc8d3434d8e8b4b09d572e64333 => generated 0 bytes in 1087 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:08:18.279429 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:18.317542 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350ada1-767c-4794-8d1f-81695d4e51e2 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:18.319439 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d350ada1-767c-4794-8d1f-81695d4e51e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:18.356430 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350ada1-767c-4794-8d1f-81695d4e51e2 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:18.469932 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2b43a-b1ec-407a-8a4e-fccfaddd1a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:18.478154 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2b43a-b1ec-407a-8a4e-fccfaddd1a05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:18.478154 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2b43a-b1ec-407a-8a4e-fccfaddd1a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:18.478154 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2b43a-b1ec-407a-8a4e-fccfaddd1a05 admin admin] PATH_INFO: `/v3/projects/ce9bdc1b6ea54d58b8da698eeb601fee` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:18.478154 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2b43a-b1ec-407a-8a4e-fccfaddd1a05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce9bdc1b6ea54d58b8da698eeb601fee)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:18.478154 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2b43a-b1ec-407a-8a4e-fccfaddd1a05 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:18.611005 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e7c2b43a-b1ec-407a-8a4e-fccfaddd1a05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce9bdc1b6ea54d58b8da698eeb601fee', 'request_id': 'req-e7c2b43a-b1ec-407a-8a4e-fccfaddd1a05'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:18.618425 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e7c2b43a-b1ec-407a-8a4e-fccfaddd1a05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce9bdc1b6ea54d58b8da698eeb601fee', 'request_id': 'req-e7c2b43a-b1ec-407a-8a4e-fccfaddd1a05'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:18.628782 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e7c2b43a-b1ec-407a-8a4e-fccfaddd1a05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce9bdc1b6ea54d58b8da698eeb601fee', 'request_id': 'req-e7c2b43a-b1ec-407a-8a4e-fccfaddd1a05'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:18.727493 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e7c2b43a-b1ec-407a-8a4e-fccfaddd1a05 admin admin] The token cache is being invalidate because project ce9bdc1b6ea54d58b8da698eeb601fee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:08:18.727493 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e7c2b43a-b1ec-407a-8a4e-fccfaddd1a05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:18.727493 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e7c2b43a-b1ec-407a-8a4e-fccfaddd1a05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:18.739089 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1118/2253] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:08:18 2022] DELETE /identity/v3/projects/ce9bdc1b6ea54d58b8da698eeb601fee => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:08:18.745167 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f5be8-2c7d-4ae4-87c8-064215baf4ee None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:18.745513 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f5be8-2c7d-4ae4-87c8-064215baf4ee None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:18.746504 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f5be8-2c7d-4ae4-87c8-064215baf4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:18.778517 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-953f5be8-2c7d-4ae4-87c8-064215baf4ee None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:08:18.779764 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-953f5be8-2c7d-4ae4-87c8-064215baf4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:18.802388 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:18.861660 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1136/2254] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:08:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:08:18.870583 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad5a9e-9841-4613-a336-0cb1e944aae1 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:18.871181 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad5a9e-9841-4613-a336-0cb1e944aae1 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:18.871181 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad5a9e-9841-4613-a336-0cb1e944aae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:18.893761 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-bcad5a9e-9841-4613-a336-0cb1e944aae1 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:08:18.895071 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-bcad5a9e-9841-4613-a336-0cb1e944aae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:18.909399 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1119/2255] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:08:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:08:18.910543 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f5be8-2c7d-4ae4-87c8-064215baf4ee None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:18.921869 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f5be8-2c7d-4ae4-87c8-064215baf4ee None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:18.927438 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25783759-215a-414f-86dd-6e47f5424cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:18.928284 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25783759-215a-414f-86dd-6e47f5424cab admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:18.928525 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25783759-215a-414f-86dd-6e47f5424cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:18.928788 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25783759-215a-414f-86dd-6e47f5424cab admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:18.929635 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25783759-215a-414f-86dd-6e47f5424cab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:08:18.930093 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25783759-215a-414f-86dd-6e47f5424cab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:18.931804 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25783759-215a-414f-86dd-6e47f5424cab admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:18.954508 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:18.959006 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1137/2256] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:08:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 21:08:18.966861 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad5a9e-9841-4613-a336-0cb1e944aae1 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:18.993267 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad5a9e-9841-4613-a336-0cb1e944aae1 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:19.007368 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94133d51-c86e-4322-bb20-39164eb3b859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:19.007368 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94133d51-c86e-4322-bb20-39164eb3b859 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:19.007368 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94133d51-c86e-4322-bb20-39164eb3b859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:19.007368 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94133d51-c86e-4322-bb20-39164eb3b859 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:19.007874 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94133d51-c86e-4322-bb20-39164eb3b859 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:19.009857 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94133d51-c86e-4322-bb20-39164eb3b859 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:19.113450 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1120/2257] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:08:18 2022] POST /identity/v3/projects => generated 391 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:08:19.117533 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25783759-215a-414f-86dd-6e47f5424cab admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:19.129250 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25783759-215a-414f-86dd-6e47f5424cab admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:19.216195 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e3f49-d4a3-4f7b-8d9d-ca451ed78736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:19.217696 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e3f49-d4a3-4f7b-8d9d-ca451ed78736 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:19.218643 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e3f49-d4a3-4f7b-8d9d-ca451ed78736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:19.219283 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e3f49-d4a3-4f7b-8d9d-ca451ed78736 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:19.220338 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e3f49-d4a3-4f7b-8d9d-ca451ed78736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:19.222940 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e3f49-d4a3-4f7b-8d9d-ca451ed78736 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:19.369698 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1138/2258] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:08:19 2022] POST /identity/v3/users => generated 296 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:08:19.370506 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94133d51-c86e-4322-bb20-39164eb3b859 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:19.384926 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94133d51-c86e-4322-bb20-39164eb3b859 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:19.402321 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea16c47-02f7-4de8-908a-2dcffafa5610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:19.403044 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea16c47-02f7-4de8-908a-2dcffafa5610 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:19.403394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea16c47-02f7-4de8-908a-2dcffafa5610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:19.403661 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea16c47-02f7-4de8-908a-2dcffafa5610 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:19.404448 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea16c47-02f7-4de8-908a-2dcffafa5610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:19.406228 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea16c47-02f7-4de8-908a-2dcffafa5610 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:19.423734 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1121/2259] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 21:08:19.426392 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e3f49-d4a3-4f7b-8d9d-ca451ed78736 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:19.437639 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e3f49-d4a3-4f7b-8d9d-ca451ed78736 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:19.442820 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f94e8-091a-45d9-9f10-ab8be7ca60cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:19.443698 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f94e8-091a-45d9-9f10-ab8be7ca60cd admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:19.444196 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f94e8-091a-45d9-9f10-ab8be7ca60cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:19.444964 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f94e8-091a-45d9-9f10-ab8be7ca60cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:19.445910 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577f94e8-091a-45d9-9f10-ab8be7ca60cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:19.447779 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577f94e8-091a-45d9-9f10-ab8be7ca60cd admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:19.459751 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1139/2260] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:08:19.463834 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:19.465756 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea16c47-02f7-4de8-908a-2dcffafa5610 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:19.476964 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea16c47-02f7-4de8-908a-2dcffafa5610 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:19.482527 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd8925-921d-403b-b5b3-9ef76b30c728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:19.483466 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd8925-921d-403b-b5b3-9ef76b30c728 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:19.483758 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd8925-921d-403b-b5b3-9ef76b30c728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:19.484079 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd8925-921d-403b-b5b3-9ef76b30c728 admin admin] PATH_INFO: `/v3/projects/d7834fe4b3d94c09b2fb00f5653b6a38/users/22564d69b8364a0284d0c60ed6aa0425/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:19.508903 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd8925-921d-403b-b5b3-9ef76b30c728 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7834fe4b3d94c09b2fb00f5653b6a38, user_id=22564d69b8364a0284d0c60ed6aa0425, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:19.512718 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd8925-921d-403b-b5b3-9ef76b30c728 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:19.567882 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f94e8-091a-45d9-9f10-ab8be7ca60cd admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:19.569619 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-577f94e8-091a-45d9-9f10-ab8be7ca60cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:19.583796 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1122/2261] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:08:19 2022] PUT /identity/v3/projects/d7834fe4b3d94c09b2fb00f5653b6a38/users/22564d69b8364a0284d0c60ed6aa0425/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:08:19.592581 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f94e8-091a-45d9-9f10-ab8be7ca60cd admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:19.595575 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133a2f6-4a19-4522-a0ab-cb39396ef6e5 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:19.595880 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133a2f6-4a19-4522-a0ab-cb39396ef6e5 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:19.596199 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133a2f6-4a19-4522-a0ab-cb39396ef6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:19.642458 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-d133a2f6-4a19-4522-a0ab-cb39396ef6e5 None None] MFA Rules not processed for user `22564d69b8364a0284d0c60ed6aa0425`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:08:19.644026 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d133a2f6-4a19-4522-a0ab-cb39396ef6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:19.657861 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:19.763015 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b68efc-748f-4e22-a9e5-d19a9b40d207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:19.763928 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b68efc-748f-4e22-a9e5-d19a9b40d207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:19.764265 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b68efc-748f-4e22-a9e5-d19a9b40d207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:19.764595 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b68efc-748f-4e22-a9e5-d19a9b40d207 admin admin] PATH_INFO: `/v3/users/252c25cc23064e52ab878d4e57926338` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:19.765811 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b68efc-748f-4e22-a9e5-d19a9b40d207 admin admin] RBAC: Authorizing `identity:delete_user(user_id=252c25cc23064e52ab878d4e57926338)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:19.770962 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b68efc-748f-4e22-a9e5-d19a9b40d207 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:19.786319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1123/2262] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:08:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:08:19.798761 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133a2f6-4a19-4522-a0ab-cb39396ef6e5 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:19.800526 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d133a2f6-4a19-4522-a0ab-cb39396ef6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:19.899151 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133a2f6-4a19-4522-a0ab-cb39396ef6e5 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:19.903533 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da588f2-87ea-4e1f-abc3-5d910317e1f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:19.904227 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da588f2-87ea-4e1f-abc3-5d910317e1f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:19.904516 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da588f2-87ea-4e1f-abc3-5d910317e1f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:19.904818 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da588f2-87ea-4e1f-abc3-5d910317e1f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:19.918281 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da588f2-87ea-4e1f-abc3-5d910317e1f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:19.924004 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da588f2-87ea-4e1f-abc3-5d910317e1f4 service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:19.929522 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1124/2263] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:08:19 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 21:08:20.000108 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:20.020545 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-13b68efc-748f-4e22-a9e5-d19a9b40d207 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '252c25cc23064e52ab878d4e57926338'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:20.038560 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-13b68efc-748f-4e22-a9e5-d19a9b40d207 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '252c25cc23064e52ab878d4e57926338'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:20.038560 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-13b68efc-748f-4e22-a9e5-d19a9b40d207 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '252c25cc23064e52ab878d4e57926338'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:20.038560 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-13b68efc-748f-4e22-a9e5-d19a9b40d207 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '252c25cc23064e52ab878d4e57926338'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:20.135472 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-13b68efc-748f-4e22-a9e5-d19a9b40d207 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '252c25cc23064e52ab878d4e57926338'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:20.168613 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1140/2264] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:08:19 2022] DELETE /identity/v3/users/252c25cc23064e52ab878d4e57926338 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:08:20.172735 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5200c-69a2-4094-ae4d-b55e2c32a68a None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:20.173023 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5200c-69a2-4094-ae4d-b55e2c32a68a None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:20.173310 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5200c-69a2-4094-ae4d-b55e2c32a68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:20.207683 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-5da5200c-69a2-4094-ae4d-b55e2c32a68a None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:08:20.209140 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-5da5200c-69a2-4094-ae4d-b55e2c32a68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:20.302818 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1125/2265] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:08:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:08:20.315558 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b68efc-748f-4e22-a9e5-d19a9b40d207 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:20.319336 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-13b68efc-748f-4e22-a9e5-d19a9b40d207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:20.402800 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b68efc-748f-4e22-a9e5-d19a9b40d207 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:20.406145 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d94bd-4c48-4837-a74e-e71acf7a35ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:20.411321 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d94bd-4c48-4837-a74e-e71acf7a35ba service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:20.411321 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d94bd-4c48-4837-a74e-e71acf7a35ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:20.411321 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d94bd-4c48-4837-a74e-e71acf7a35ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:20.417062 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d94bd-4c48-4837-a74e-e71acf7a35ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:20.418642 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d94bd-4c48-4837-a74e-e71acf7a35ba service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:20.429935 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1141/2266] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:08:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:08:20.699225 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5200c-69a2-4094-ae4d-b55e2c32a68a None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:20.700872 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-5da5200c-69a2-4094-ae4d-b55e2c32a68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:20.716318 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5200c-69a2-4094-ae4d-b55e2c32a68a None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:20.722480 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e9cf3-8b95-4f23-a60b-d36a13f326f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:20.723488 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e9cf3-8b95-4f23-a60b-d36a13f326f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:20.724387 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e9cf3-8b95-4f23-a60b-d36a13f326f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:20.724387 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e9cf3-8b95-4f23-a60b-d36a13f326f3 admin admin] PATH_INFO: `/v3/projects/ccdf7a4d11a14535822d5385c64b1056` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:20.726477 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e9cf3-8b95-4f23-a60b-d36a13f326f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccdf7a4d11a14535822d5385c64b1056)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:20.729397 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e9cf3-8b95-4f23-a60b-d36a13f326f3 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:20.749978 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:20.870827 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-8d4e9cf3-8b95-4f23-a60b-d36a13f326f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccdf7a4d11a14535822d5385c64b1056', 'request_id': 'req-8d4e9cf3-8b95-4f23-a60b-d36a13f326f3'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:20.902434 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-8d4e9cf3-8b95-4f23-a60b-d36a13f326f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccdf7a4d11a14535822d5385c64b1056', 'request_id': 'req-8d4e9cf3-8b95-4f23-a60b-d36a13f326f3'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:20.949178 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-8d4e9cf3-8b95-4f23-a60b-d36a13f326f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccdf7a4d11a14535822d5385c64b1056', 'request_id': 'req-8d4e9cf3-8b95-4f23-a60b-d36a13f326f3'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:21.064550 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-8d4e9cf3-8b95-4f23-a60b-d36a13f326f3 admin admin] The token cache is being invalidate because project ccdf7a4d11a14535822d5385c64b1056 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:08:21.065317 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-8d4e9cf3-8b95-4f23-a60b-d36a13f326f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:21.066272 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-8d4e9cf3-8b95-4f23-a60b-d36a13f326f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:21.068358 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1126/2267] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:08:20 2022] DELETE /identity/v3/projects/ccdf7a4d11a14535822d5385c64b1056 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:08:23.704164 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee928995-cd62-4b1c-b87c-899177920d0c None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:23.704998 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee928995-cd62-4b1c-b87c-899177920d0c None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:23.706973 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee928995-cd62-4b1c-b87c-899177920d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:23.740192 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-ee928995-cd62-4b1c-b87c-899177920d0c None None] MFA Rules not processed for user `01541b7e5e984884bf87ef6d31b9480c`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:08:23.742809 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-ee928995-cd62-4b1c-b87c-899177920d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:23.889398 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1142/2268] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:08:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:08:27.056279 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873306b7-d74d-4380-ab07-a223af0e1a10 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:27.056785 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873306b7-d74d-4380-ab07-a223af0e1a10 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:27.057019 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873306b7-d74d-4380-ab07-a223af0e1a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:27.080570 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-873306b7-d74d-4380-ab07-a223af0e1a10 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:08:27.083205 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-873306b7-d74d-4380-ab07-a223af0e1a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:27.158173 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1127/2269] 10.222.0.27 () {58 vars in 1016 bytes} [Mon Jul 11 21:08:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:08:27.171784 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee928995-cd62-4b1c-b87c-899177920d0c None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:27.173320 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-ee928995-cd62-4b1c-b87c-899177920d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:27.258578 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:27.282977 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee928995-cd62-4b1c-b87c-899177920d0c None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:27.289837 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de5739-fff7-40b2-990a-a67dd11270f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:27.291565 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de5739-fff7-40b2-990a-a67dd11270f4 service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:27.292125 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de5739-fff7-40b2-990a-a67dd11270f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:27.292632 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de5739-fff7-40b2-990a-a67dd11270f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:27.303206 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de5739-fff7-40b2-990a-a67dd11270f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:27.304952 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de5739-fff7-40b2-990a-a67dd11270f4 service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:27.327635 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1143/2270] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:08:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:08:32.098596 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea0105-c3c0-462d-95a6-719faebad85f None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:32.099140 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea0105-c3c0-462d-95a6-719faebad85f None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:32.099349 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea0105-c3c0-462d-95a6-719faebad85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:32.119075 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-bfea0105-c3c0-462d-95a6-719faebad85f None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:08:32.120820 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-bfea0105-c3c0-462d-95a6-719faebad85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:32.131886 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1128/2271] 10.222.0.27 () {58 vars in 1016 bytes} [Mon Jul 11 21:08:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:08:32.146825 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de5739-fff7-40b2-990a-a67dd11270f4 service nova] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:32.149366 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-52de5739-fff7-40b2-990a-a67dd11270f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:32.168871 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de5739-fff7-40b2-990a-a67dd11270f4 service nova] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:32.175056 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e585638-f9d5-41a1-b68a-1caf31911846 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:32.176225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e585638-f9d5-41a1-b68a-1caf31911846 service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:32.176756 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e585638-f9d5-41a1-b68a-1caf31911846 service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:32.177118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e585638-f9d5-41a1-b68a-1caf31911846 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:32.186782 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e585638-f9d5-41a1-b68a-1caf31911846 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:32.188580 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e585638-f9d5-41a1-b68a-1caf31911846 service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:32.199187 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1144/2272] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:08:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:08:32.297664 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea0105-c3c0-462d-95a6-719faebad85f None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:32.299177 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-bfea0105-c3c0-462d-95a6-719faebad85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:32.313483 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea0105-c3c0-462d-95a6-719faebad85f None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:32.318319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f05d5d-6427-44a2-aa81-814c2a7629e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:32.319417 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f05d5d-6427-44a2-aa81-814c2a7629e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:32.319703 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f05d5d-6427-44a2-aa81-814c2a7629e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:32.320139 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f05d5d-6427-44a2-aa81-814c2a7629e4 admin admin] PATH_INFO: `/v3/users/22564d69b8364a0284d0c60ed6aa0425` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:32.321421 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f05d5d-6427-44a2-aa81-814c2a7629e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22564d69b8364a0284d0c60ed6aa0425)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:32.325526 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f05d5d-6427-44a2-aa81-814c2a7629e4 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:32.506509 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-10f05d5d-6427-44a2-aa81-814c2a7629e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22564d69b8364a0284d0c60ed6aa0425'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:32.515164 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-10f05d5d-6427-44a2-aa81-814c2a7629e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22564d69b8364a0284d0c60ed6aa0425'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:32.515979 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-10f05d5d-6427-44a2-aa81-814c2a7629e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22564d69b8364a0284d0c60ed6aa0425'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:32.516954 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-10f05d5d-6427-44a2-aa81-814c2a7629e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22564d69b8364a0284d0c60ed6aa0425'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:32.577458 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-10f05d5d-6427-44a2-aa81-814c2a7629e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22564d69b8364a0284d0c60ed6aa0425'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:32.598656 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1129/2273] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:08:32 2022] DELETE /identity/v3/users/22564d69b8364a0284d0c60ed6aa0425 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:08:32.603399 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a7518-ed9d-47a2-b2d3-891ca2edb009 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:32.611703 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a7518-ed9d-47a2-b2d3-891ca2edb009 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:32.611703 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a7518-ed9d-47a2-b2d3-891ca2edb009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:32.627717 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-e08a7518-ed9d-47a2-b2d3-891ca2edb009 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:08:32.629394 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-e08a7518-ed9d-47a2-b2d3-891ca2edb009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:32.707892 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1145/2274] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:08:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:08:32.726282 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f05d5d-6427-44a2-aa81-814c2a7629e4 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:32.727775 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-10f05d5d-6427-44a2-aa81-814c2a7629e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:32.739456 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:32.787280 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f05d5d-6427-44a2-aa81-814c2a7629e4 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:32.790872 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093731f5-4e4c-42ee-a355-61a6bfe53969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:32.792088 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093731f5-4e4c-42ee-a355-61a6bfe53969 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:32.792364 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093731f5-4e4c-42ee-a355-61a6bfe53969 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:32.792643 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093731f5-4e4c-42ee-a355-61a6bfe53969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:32.801967 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093731f5-4e4c-42ee-a355-61a6bfe53969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:32.803324 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093731f5-4e4c-42ee-a355-61a6bfe53969 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:32.814335 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1130/2275] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:08:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:08:33.329899 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a7518-ed9d-47a2-b2d3-891ca2edb009 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:33.331584 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-e08a7518-ed9d-47a2-b2d3-891ca2edb009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:33.344156 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a7518-ed9d-47a2-b2d3-891ca2edb009 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:33.349155 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b3e77-c972-4697-9e70-4abe6a8c6a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:33.356240 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b3e77-c972-4697-9e70-4abe6a8c6a6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:33.356240 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b3e77-c972-4697-9e70-4abe6a8c6a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:33.356240 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b3e77-c972-4697-9e70-4abe6a8c6a6c admin admin] PATH_INFO: `/v3/projects/d7834fe4b3d94c09b2fb00f5653b6a38` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:33.356240 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b3e77-c972-4697-9e70-4abe6a8c6a6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7834fe4b3d94c09b2fb00f5653b6a38)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:33.356240 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b3e77-c972-4697-9e70-4abe6a8c6a6c admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:33.476092 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b53b3e77-c972-4697-9e70-4abe6a8c6a6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7834fe4b3d94c09b2fb00f5653b6a38', 'request_id': 'req-b53b3e77-c972-4697-9e70-4abe6a8c6a6c'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:33.488009 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b53b3e77-c972-4697-9e70-4abe6a8c6a6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7834fe4b3d94c09b2fb00f5653b6a38', 'request_id': 'req-b53b3e77-c972-4697-9e70-4abe6a8c6a6c'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:33.496776 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b53b3e77-c972-4697-9e70-4abe6a8c6a6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7834fe4b3d94c09b2fb00f5653b6a38', 'request_id': 'req-b53b3e77-c972-4697-9e70-4abe6a8c6a6c'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:33.588888 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b53b3e77-c972-4697-9e70-4abe6a8c6a6c admin admin] The token cache is being invalidate because project d7834fe4b3d94c09b2fb00f5653b6a38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:08:33.589515 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b53b3e77-c972-4697-9e70-4abe6a8c6a6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:33.590343 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b53b3e77-c972-4697-9e70-4abe6a8c6a6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:33.595488 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1146/2276] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:08:33 2022] DELETE /identity/v3/projects/d7834fe4b3d94c09b2fb00f5653b6a38 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:08:33.597875 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e833850-b371-40c5-ab4e-9ae2a1266e4b None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:33.598392 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e833850-b371-40c5-ab4e-9ae2a1266e4b None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:33.598475 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e833850-b371-40c5-ab4e-9ae2a1266e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:33.619038 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-9e833850-b371-40c5-ab4e-9ae2a1266e4b None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:08:33.620912 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-9e833850-b371-40c5-ab4e-9ae2a1266e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:33.712813 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1131/2277] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:08:33.714120 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c83a42-77a3-4e41-80bc-1e83d70cf54c None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:33.714518 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c83a42-77a3-4e41-80bc-1e83d70cf54c None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:33.714904 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c83a42-77a3-4e41-80bc-1e83d70cf54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:33.735118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-97c83a42-77a3-4e41-80bc-1e83d70cf54c None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:08:33.739139 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-97c83a42-77a3-4e41-80bc-1e83d70cf54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:33.748780 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1147/2278] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:08:33.754298 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e833850-b371-40c5-ab4e-9ae2a1266e4b None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:33.764754 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e833850-b371-40c5-ab4e-9ae2a1266e4b None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:33.770336 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6ca89-4f0b-4484-8df4-25ee9d48b376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:33.770478 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6ca89-4f0b-4484-8df4-25ee9d48b376 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:33.770712 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6ca89-4f0b-4484-8df4-25ee9d48b376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:33.770993 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6ca89-4f0b-4484-8df4-25ee9d48b376 admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:33.771735 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6ca89-4f0b-4484-8df4-25ee9d48b376 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:08:33.772088 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6ca89-4f0b-4484-8df4-25ee9d48b376 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:33.773722 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6ca89-4f0b-4484-8df4-25ee9d48b376 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:33.786961 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1132/2279] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:08:33.793842 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c83a42-77a3-4e41-80bc-1e83d70cf54c None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:33.803762 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c83a42-77a3-4e41-80bc-1e83d70cf54c None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:33.809300 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96252abb-06fd-40db-857e-8b72c7b13e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:33.809979 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96252abb-06fd-40db-857e-8b72c7b13e9a admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:33.810268 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96252abb-06fd-40db-857e-8b72c7b13e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:33.810546 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96252abb-06fd-40db-857e-8b72c7b13e9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:33.811239 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96252abb-06fd-40db-857e-8b72c7b13e9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:33.813450 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96252abb-06fd-40db-857e-8b72c7b13e9a admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:33.916048 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1148/2280] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:08:33 2022] POST /identity/v3/projects => generated 399 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:08:33.920961 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6ca89-4f0b-4484-8df4-25ee9d48b376 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:33.935118 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6ca89-4f0b-4484-8df4-25ee9d48b376 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:34.008609 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac2d88-2c47-430c-a5e0-ae8940b2e290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:34.009683 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac2d88-2c47-430c-a5e0-ae8940b2e290 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:34.015519 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac2d88-2c47-430c-a5e0-ae8940b2e290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:34.015519 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac2d88-2c47-430c-a5e0-ae8940b2e290 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:34.015519 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac2d88-2c47-430c-a5e0-ae8940b2e290 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:34.015519 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac2d88-2c47-430c-a5e0-ae8940b2e290 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:34.114119 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1133/2281] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:08:33 2022] POST /identity/v3/users => generated 300 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:08:34.115240 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96252abb-06fd-40db-857e-8b72c7b13e9a admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:34.126834 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96252abb-06fd-40db-857e-8b72c7b13e9a admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:34.135374 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e65eef-eee5-4b0f-97c6-809db45d88c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:34.140531 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e65eef-eee5-4b0f-97c6-809db45d88c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:34.140531 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e65eef-eee5-4b0f-97c6-809db45d88c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:34.140531 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e65eef-eee5-4b0f-97c6-809db45d88c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:34.140531 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e65eef-eee5-4b0f-97c6-809db45d88c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:34.140531 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e65eef-eee5-4b0f-97c6-809db45d88c9 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:34.151527 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1149/2282] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:08:34.155816 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac2d88-2c47-430c-a5e0-ae8940b2e290 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:34.175089 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac2d88-2c47-430c-a5e0-ae8940b2e290 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:34.175089 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596a4e1-7d2c-4714-8bd1-ed79f9abb70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:34.175089 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596a4e1-7d2c-4714-8bd1-ed79f9abb70b admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:34.175089 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596a4e1-7d2c-4714-8bd1-ed79f9abb70b admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:34.175710 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596a4e1-7d2c-4714-8bd1-ed79f9abb70b admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:34.175710 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6596a4e1-7d2c-4714-8bd1-ed79f9abb70b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:34.176040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6596a4e1-7d2c-4714-8bd1-ed79f9abb70b admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:34.186892 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1134/2283] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:08:34.190897 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e65eef-eee5-4b0f-97c6-809db45d88c9 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:34.204158 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e65eef-eee5-4b0f-97c6-809db45d88c9 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:34.206549 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302dab38-b672-46a9-9073-a2d46bd48ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:34.207729 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302dab38-b672-46a9-9073-a2d46bd48ce2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:34.207729 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302dab38-b672-46a9-9073-a2d46bd48ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:34.208051 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302dab38-b672-46a9-9073-a2d46bd48ce2 admin admin] PATH_INFO: `/v3/projects/c7d380cc6f77461ab46fb817c23be2ce/users/ac40e2a3fb934d69b385da317549e427/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:34.221932 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:34.226333 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302dab38-b672-46a9-9073-a2d46bd48ce2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7d380cc6f77461ab46fb817c23be2ce, user_id=ac40e2a3fb934d69b385da317549e427, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:34.238541 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302dab38-b672-46a9-9073-a2d46bd48ce2 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:34.347422 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1150/2284] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:08:34 2022] PUT /identity/v3/projects/c7d380cc6f77461ab46fb817c23be2ce/users/ac40e2a3fb934d69b385da317549e427/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:08:34.361248 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbefef7-6bde-4c9b-9b30-67413b6df71f None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:34.361248 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbefef7-6bde-4c9b-9b30-67413b6df71f None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:34.361248 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbefef7-6bde-4c9b-9b30-67413b6df71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:34.405856 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-8bbefef7-6bde-4c9b-9b30-67413b6df71f None None] MFA Rules not processed for user `ac40e2a3fb934d69b385da317549e427`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:08:34.407261 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-8bbefef7-6bde-4c9b-9b30-67413b6df71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:34.415212 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:34.492646 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1135/2285] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:08:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:08:34.504615 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302dab38-b672-46a9-9073-a2d46bd48ce2 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:34.506580 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-302dab38-b672-46a9-9073-a2d46bd48ce2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:34.570374 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302dab38-b672-46a9-9073-a2d46bd48ce2 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:34.579647 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b47f6f0-7630-4604-b5a3-813a7282af3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:34.580438 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47f6f0-7630-4604-b5a3-813a7282af3c service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:34.580712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47f6f0-7630-4604-b5a3-813a7282af3c service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:34.580996 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47f6f0-7630-4604-b5a3-813a7282af3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:34.591432 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b47f6f0-7630-4604-b5a3-813a7282af3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:34.594231 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b47f6f0-7630-4604-b5a3-813a7282af3c service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:34.606255 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1151/2286] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:08:34 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:08:37.388671 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59471ab4-7255-4909-ac4b-499ba665f727 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:37.389138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59471ab4-7255-4909-ac4b-499ba665f727 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:37.389248 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59471ab4-7255-4909-ac4b-499ba665f727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:37.411937 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-59471ab4-7255-4909-ac4b-499ba665f727 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:08:37.413324 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-59471ab4-7255-4909-ac4b-499ba665f727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:37.484609 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1136/2287] 10.222.0.27 () {58 vars in 1016 bytes} [Mon Jul 11 21:08:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:08:37.802772 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b47f6f0-7630-4604-b5a3-813a7282af3c service cinder] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:37.804298 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-6b47f6f0-7630-4604-b5a3-813a7282af3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:37.879857 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b47f6f0-7630-4604-b5a3-813a7282af3c service cinder] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:37.885570 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92cae12-5bcf-4db2-b4d9-07697856252c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:37.886960 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cae12-5bcf-4db2-b4d9-07697856252c service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:37.887390 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cae12-5bcf-4db2-b4d9-07697856252c service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:37.889032 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cae12-5bcf-4db2-b4d9-07697856252c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:37.897891 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92cae12-5bcf-4db2-b4d9-07697856252c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:37.899484 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92cae12-5bcf-4db2-b4d9-07697856252c service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:37.909519 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1152/2288] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:08:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:08:40.639377 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59471ab4-7255-4909-ac4b-499ba665f727 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:40.650230 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59471ab4-7255-4909-ac4b-499ba665f727 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:40.655217 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50069e7e-a386-47b9-a543-d85c580c884d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:40.656505 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50069e7e-a386-47b9-a543-d85c580c884d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:40.657016 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50069e7e-a386-47b9-a543-d85c580c884d admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:40.657536 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50069e7e-a386-47b9-a543-d85c580c884d admin admin] PATH_INFO: `/v3/users/ac40e2a3fb934d69b385da317549e427` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:40.658952 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50069e7e-a386-47b9-a543-d85c580c884d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac40e2a3fb934d69b385da317549e427)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:40.661080 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50069e7e-a386-47b9-a543-d85c580c884d admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:40.844809 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-50069e7e-a386-47b9-a543-d85c580c884d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac40e2a3fb934d69b385da317549e427'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:40.852534 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-50069e7e-a386-47b9-a543-d85c580c884d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac40e2a3fb934d69b385da317549e427'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:40.853304 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-50069e7e-a386-47b9-a543-d85c580c884d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac40e2a3fb934d69b385da317549e427'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:40.853976 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-50069e7e-a386-47b9-a543-d85c580c884d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac40e2a3fb934d69b385da317549e427'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:40.908619 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-50069e7e-a386-47b9-a543-d85c580c884d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac40e2a3fb934d69b385da317549e427'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:40.936389 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1137/2289] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:08:40 2022] DELETE /identity/v3/users/ac40e2a3fb934d69b385da317549e427 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:08:40.945619 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d7d14-0d47-414f-8230-f3f1d42bccf3 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:40.946537 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d7d14-0d47-414f-8230-f3f1d42bccf3 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:40.947143 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d7d14-0d47-414f-8230-f3f1d42bccf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:40.968267 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-b74d7d14-0d47-414f-8230-f3f1d42bccf3 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:08:40.969543 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-b74d7d14-0d47-414f-8230-f3f1d42bccf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:41.034884 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1153/2290] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:08:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:08:41.045310 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50069e7e-a386-47b9-a543-d85c580c884d admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:41.047345 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-50069e7e-a386-47b9-a543-d85c580c884d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:41.072993 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:41.128884 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50069e7e-a386-47b9-a543-d85c580c884d admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:41.134017 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8e530-123b-4fd9-b562-07fc0ea8991d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:41.134688 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8e530-123b-4fd9-b562-07fc0ea8991d service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:41.134995 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8e530-123b-4fd9-b562-07fc0ea8991d service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:41.135391 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8e530-123b-4fd9-b562-07fc0ea8991d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:41.152599 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8e530-123b-4fd9-b562-07fc0ea8991d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:41.152599 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8e530-123b-4fd9-b562-07fc0ea8991d service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:41.162015 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1138/2291] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:08:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:08:41.550162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d7d14-0d47-414f-8230-f3f1d42bccf3 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:41.552076 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-b74d7d14-0d47-414f-8230-f3f1d42bccf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:41.570525 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d7d14-0d47-414f-8230-f3f1d42bccf3 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:41.576583 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661abfeb-9eb4-4b28-a945-c550528b4b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:41.577459 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661abfeb-9eb4-4b28-a945-c550528b4b94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:41.577812 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661abfeb-9eb4-4b28-a945-c550528b4b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:41.578023 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661abfeb-9eb4-4b28-a945-c550528b4b94 admin admin] PATH_INFO: `/v3/projects/c7d380cc6f77461ab46fb817c23be2ce` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:41.580461 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661abfeb-9eb4-4b28-a945-c550528b4b94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7d380cc6f77461ab46fb817c23be2ce)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:41.582927 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661abfeb-9eb4-4b28-a945-c550528b4b94 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:41.605545 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:41.726358 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-661abfeb-9eb4-4b28-a945-c550528b4b94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7d380cc6f77461ab46fb817c23be2ce', 'request_id': 'req-661abfeb-9eb4-4b28-a945-c550528b4b94'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:41.734786 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-661abfeb-9eb4-4b28-a945-c550528b4b94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7d380cc6f77461ab46fb817c23be2ce', 'request_id': 'req-661abfeb-9eb4-4b28-a945-c550528b4b94'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:41.746896 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-661abfeb-9eb4-4b28-a945-c550528b4b94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7d380cc6f77461ab46fb817c23be2ce', 'request_id': 'req-661abfeb-9eb4-4b28-a945-c550528b4b94'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:41.835639 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-661abfeb-9eb4-4b28-a945-c550528b4b94 admin admin] The token cache is being invalidate because project c7d380cc6f77461ab46fb817c23be2ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:08:41.835949 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-661abfeb-9eb4-4b28-a945-c550528b4b94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:41.836583 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-661abfeb-9eb4-4b28-a945-c550528b4b94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:08:41.838212 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1154/2292] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:08:41 2022] DELETE /identity/v3/projects/c7d380cc6f77461ab46fb817c23be2ce => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:08:42.709866 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a035382-ba9e-4443-ab8d-c800ce1004da None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:42.710331 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a035382-ba9e-4443-ab8d-c800ce1004da None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:42.710672 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a035382-ba9e-4443-ab8d-c800ce1004da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:42.729033 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-2a035382-ba9e-4443-ab8d-c800ce1004da None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:08:42.730237 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-2a035382-ba9e-4443-ab8d-c800ce1004da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:42.796849 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1139/2293] 10.222.0.27 () {58 vars in 1016 bytes} [Mon Jul 11 21:08:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:08:42.822594 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661abfeb-9eb4-4b28-a945-c550528b4b94 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:42.823916 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-661abfeb-9eb4-4b28-a945-c550528b4b94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:42.904823 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661abfeb-9eb4-4b28-a945-c550528b4b94 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:42.910640 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ed499a-3284-47c0-9b5b-e5d9335b4959 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:42.911291 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed499a-3284-47c0-9b5b-e5d9335b4959 service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:42.911579 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed499a-3284-47c0-9b5b-e5d9335b4959 service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:42.911856 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed499a-3284-47c0-9b5b-e5d9335b4959 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:42.920532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ed499a-3284-47c0-9b5b-e5d9335b4959 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:42.922116 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ed499a-3284-47c0-9b5b-e5d9335b4959 service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:42.931874 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1155/2294] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:08:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:08:50.370836 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8447df-23b2-4dbd-9274-0c4bb5aa552f None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:50.371316 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8447df-23b2-4dbd-9274-0c4bb5aa552f None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:50.371530 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8447df-23b2-4dbd-9274-0c4bb5aa552f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:50.392308 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-2f8447df-23b2-4dbd-9274-0c4bb5aa552f None None] MFA Rules not processed for user `33c95dd165934af4b2bd741ff35ae622`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:08:50.393464 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-2f8447df-23b2-4dbd-9274-0c4bb5aa552f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:50.472162 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1140/2295] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:08:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:08:50.714350 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ed499a-3284-47c0-9b5b-e5d9335b4959 service nova] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:08:50.715913 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-c1ed499a-3284-47c0-9b5b-e5d9335b4959 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:50.774379 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ed499a-3284-47c0-9b5b-e5d9335b4959 service nova] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:08:50.778020 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92accb8b-8d01-4e6f-8084-c4e44ace4a2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:08:50.778683 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92accb8b-8d01-4e6f-8084-c4e44ace4a2f service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:08:50.778972 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92accb8b-8d01-4e6f-8084-c4e44ace4a2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:08:50.779312 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92accb8b-8d01-4e6f-8084-c4e44ace4a2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:08:50.781185 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-92accb8b-8d01-4e6f-8084-c4e44ace4a2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:08:50.823433 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:08:50.844406 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92accb8b-8d01-4e6f-8084-c4e44ace4a2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:08:50.845874 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92accb8b-8d01-4e6f-8084-c4e44ace4a2f service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:08:50.856031 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1156/2296] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:08:50 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:09:00.461088 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=69 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:09:01.038426 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=10 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:09:04.527820 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc6e5f-abfd-4506-8f20-dc7137ff5065 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:09:04.528340 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc6e5f-abfd-4506-8f20-dc7137ff5065 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:09:04.528438 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc6e5f-abfd-4506-8f20-dc7137ff5065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:09:04.546230 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-74bc6e5f-abfd-4506-8f20-dc7137ff5065 None None] MFA Rules not processed for user `61f1ca8c4c174ab49d2b722990d7b8f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:09:04.547408 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-74bc6e5f-abfd-4506-8f20-dc7137ff5065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:09:04.600556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1141/2297] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:09:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:09:14.594418 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=25 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:09:15.914117 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92accb8b-8d01-4e6f-8084-c4e44ace4a2f service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:09:15.915584 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-92accb8b-8d01-4e6f-8084-c4e44ace4a2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:09:15.985995 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92accb8b-8d01-4e6f-8084-c4e44ace4a2f service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:09:15.991142 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33042001-7823-4c7e-857e-35107a970212 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '177a912380ad43b6a5e31b787a07ce7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:09:15.991795 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33042001-7823-4c7e-857e-35107a970212 service placement] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:09:15.992128 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33042001-7823-4c7e-857e-35107a970212 service placement] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:09:15.992414 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33042001-7823-4c7e-857e-35107a970212 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:09:15.994190 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-33042001-7823-4c7e-857e-35107a970212 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:09:16.005544 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33042001-7823-4c7e-857e-35107a970212 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:09:16.007141 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33042001-7823-4c7e-857e-35107a970212 service placement] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:09:16.017722 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1157/2298] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:09:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:09:16.501549 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e83ff3-5758-469b-9b72-125c7272c733 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:09:16.501990 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e83ff3-5758-469b-9b72-125c7272c733 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:09:16.502109 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e83ff3-5758-469b-9b72-125c7272c733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:09:16.520249 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-00e83ff3-5758-469b-9b72-125c7272c733 None None] MFA Rules not processed for user `90ea5d52fd6d4068b7837d363eebb94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:09:16.521451 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-00e83ff3-5758-469b-9b72-125c7272c733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:09:16.577927 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1142/2299] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Jul 11 21:09:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:09:16.734539 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33042001-7823-4c7e-857e-35107a970212 service placement] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:09:16.737111 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-33042001-7823-4c7e-857e-35107a970212 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:09:16.808074 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33042001-7823-4c7e-857e-35107a970212 service placement] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:09:16.813755 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df9c96-4e00-4acc-b4c6-f76ea6c31bec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc950dfb1d3b4308a33f3d430fe34c1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:09:16.814523 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df9c96-4e00-4acc-b4c6-f76ea6c31bec service swift] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:09:16.814814 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df9c96-4e00-4acc-b4c6-f76ea6c31bec service swift] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:09:16.815097 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df9c96-4e00-4acc-b4c6-f76ea6c31bec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:09:16.823045 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df9c96-4e00-4acc-b4c6-f76ea6c31bec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:09:16.824668 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df9c96-4e00-4acc-b4c6-f76ea6c31bec service swift] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:09:16.832970 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1158/2300] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jul 11 21:09:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 21:09:22.835922 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00e1b0-f22a-44ce-8819-2f02a70ed3ed None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:09:22.837899 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00e1b0-f22a-44ce-8819-2f02a70ed3ed None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:09:22.838609 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00e1b0-f22a-44ce-8819-2f02a70ed3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:09:22.860464 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-2d00e1b0-f22a-44ce-8819-2f02a70ed3ed None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:09:22.861672 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-2d00e1b0-f22a-44ce-8819-2f02a70ed3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:09:22.870416 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1143/2301] 10.222.0.27 () {58 vars in 1016 bytes} [Mon Jul 11 21:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:09:22.893877 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df9c96-4e00-4acc-b4c6-f76ea6c31bec service swift] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:09:22.908825 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df9c96-4e00-4acc-b4c6-f76ea6c31bec service swift] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:09:22.915365 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38611783-391f-4470-b2db-e9d4a2933a84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:09:22.916097 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38611783-391f-4470-b2db-e9d4a2933a84 service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:09:22.916402 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38611783-391f-4470-b2db-e9d4a2933a84 service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:09:22.916929 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38611783-391f-4470-b2db-e9d4a2933a84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:09:22.927515 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38611783-391f-4470-b2db-e9d4a2933a84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:09:22.929151 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38611783-391f-4470-b2db-e9d4a2933a84 service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:09:22.943509 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1159/2302] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:09:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:09:27.560177 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3e74f-c8c9-4dc1-baed-27407023dcaa None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:09:27.560776 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3e74f-c8c9-4dc1-baed-27407023dcaa None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:09:27.560776 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3e74f-c8c9-4dc1-baed-27407023dcaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:09:27.585331 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-7fa3e74f-c8c9-4dc1-baed-27407023dcaa None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:09:27.587313 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-7fa3e74f-c8c9-4dc1-baed-27407023dcaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:09:27.600553 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1144/2303] 10.222.0.27 () {58 vars in 1016 bytes} [Mon Jul 11 21:09:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:09:27.622856 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38611783-391f-4470-b2db-e9d4a2933a84 service nova] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:09:27.636147 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38611783-391f-4470-b2db-e9d4a2933a84 service nova] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:09:27.643899 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40af3fc-8a80-4cd1-ab9e-d8116f1ce84e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:09:27.644698 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40af3fc-8a80-4cd1-ab9e-d8116f1ce84e service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:09:27.645060 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40af3fc-8a80-4cd1-ab9e-d8116f1ce84e service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:09:27.645478 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40af3fc-8a80-4cd1-ab9e-d8116f1ce84e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:09:27.658316 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40af3fc-8a80-4cd1-ab9e-d8116f1ce84e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:09:27.661755 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40af3fc-8a80-4cd1-ab9e-d8116f1ce84e service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:09:27.675570 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1160/2304] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:09:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:09:31.496191 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5d3f0-a58d-48f2-a3e7-e94797e7cad8 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:09:31.499804 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5d3f0-a58d-48f2-a3e7-e94797e7cad8 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:09:31.499804 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5d3f0-a58d-48f2-a3e7-e94797e7cad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:09:31.521367 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-9eb5d3f0-a58d-48f2-a3e7-e94797e7cad8 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:09:31.522751 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-9eb5d3f0-a58d-48f2-a3e7-e94797e7cad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:09:31.532884 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1145/2305] 10.222.0.27 () {58 vars in 1016 bytes} [Mon Jul 11 21:09:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:09:31.551586 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40af3fc-8a80-4cd1-ab9e-d8116f1ce84e service nova] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:09:31.556526 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-c40af3fc-8a80-4cd1-ab9e-d8116f1ce84e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:09:31.582319 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40af3fc-8a80-4cd1-ab9e-d8116f1ce84e service nova] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:09:31.594971 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcac4e0-3544-4429-9dac-8fa5066f34b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:09:31.596678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcac4e0-3544-4429-9dac-8fa5066f34b7 service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:09:31.603519 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcac4e0-3544-4429-9dac-8fa5066f34b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:09:31.603519 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcac4e0-3544-4429-9dac-8fa5066f34b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:09:31.625801 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcac4e0-3544-4429-9dac-8fa5066f34b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:09:31.628375 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcac4e0-3544-4429-9dac-8fa5066f34b7 service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:09:31.663191 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1161/2306] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:09:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:09:33.211089 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a3712-d223-4404-b20c-e9442bc31dea None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:09:33.212006 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a3712-d223-4404-b20c-e9442bc31dea None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:09:33.212558 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a3712-d223-4404-b20c-e9442bc31dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:09:33.231707 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-2d8a3712-d223-4404-b20c-e9442bc31dea None None] MFA Rules not processed for user `90ea5d52fd6d4068b7837d363eebb94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:09:33.233015 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-2d8a3712-d223-4404-b20c-e9442bc31dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:09:33.241227 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1146/2307] 10.222.0.40 () {58 vars in 967 bytes} [Mon Jul 11 21:09:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:09:33.253631 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcac4e0-3544-4429-9dac-8fa5066f34b7 service nova] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:09:33.265272 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcac4e0-3544-4429-9dac-8fa5066f34b7 service nova] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:09:33.272537 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7175546-37f8-4c86-9614-1e20112ebbb5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc950dfb1d3b4308a33f3d430fe34c1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:09:33.273038 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7175546-37f8-4c86-9614-1e20112ebbb5 service swift] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:09:33.273330 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7175546-37f8-4c86-9614-1e20112ebbb5 service swift] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:09:33.273712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7175546-37f8-4c86-9614-1e20112ebbb5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:09:33.283318 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7175546-37f8-4c86-9614-1e20112ebbb5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:09:33.285204 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7175546-37f8-4c86-9614-1e20112ebbb5 service swift] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:09:33.293955 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1162/2308] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jul 11 21:09:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 21:09:35.773558 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4d2d1-7c3c-4888-b243-384958807bf1 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:09:35.774048 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4d2d1-7c3c-4888-b243-384958807bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:09:35.774315 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4d2d1-7c3c-4888-b243-384958807bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:09:35.808479 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-54c4d2d1-7c3c-4888-b243-384958807bf1 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:09:35.810010 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-54c4d2d1-7c3c-4888-b243-384958807bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:09:35.819821 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1147/2309] 10.222.0.27 () {58 vars in 1016 bytes} [Mon Jul 11 21:09:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:09:35.850487 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7175546-37f8-4c86-9614-1e20112ebbb5 service swift] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:09:35.864806 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7175546-37f8-4c86-9614-1e20112ebbb5 service swift] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:09:35.873521 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4361f0-d6be-479d-93fc-011fdf4d9e1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:09:35.874671 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4361f0-d6be-479d-93fc-011fdf4d9e1f service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:09:35.875501 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4361f0-d6be-479d-93fc-011fdf4d9e1f service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:09:35.875877 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4361f0-d6be-479d-93fc-011fdf4d9e1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:09:35.885298 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4361f0-d6be-479d-93fc-011fdf4d9e1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:09:35.886979 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4361f0-d6be-479d-93fc-011fdf4d9e1f service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:09:35.897666 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1163/2310] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:09:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:09:36.343704 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4d2d1-7c3c-4888-b243-384958807bf1 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:09:36.345336 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-54c4d2d1-7c3c-4888-b243-384958807bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:09:36.357870 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4d2d1-7c3c-4888-b243-384958807bf1 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:09:36.363238 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b2208f-8a10-4705-b714-7f203ee820a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:09:36.364174 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2208f-8a10-4705-b714-7f203ee820a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:09:36.364463 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2208f-8a10-4705-b714-7f203ee820a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:09:36.364740 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2208f-8a10-4705-b714-7f203ee820a6 admin admin] PATH_INFO: `/v3/users/33c95dd165934af4b2bd741ff35ae622` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:09:36.365944 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b2208f-8a10-4705-b714-7f203ee820a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33c95dd165934af4b2bd741ff35ae622)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:09:36.367851 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b2208f-8a10-4705-b714-7f203ee820a6 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:09:36.542392 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-16b2208f-8a10-4705-b714-7f203ee820a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33c95dd165934af4b2bd741ff35ae622'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:09:36.549375 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-16b2208f-8a10-4705-b714-7f203ee820a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33c95dd165934af4b2bd741ff35ae622'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:09:36.549996 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-16b2208f-8a10-4705-b714-7f203ee820a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33c95dd165934af4b2bd741ff35ae622'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:09:36.550606 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-16b2208f-8a10-4705-b714-7f203ee820a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33c95dd165934af4b2bd741ff35ae622'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:09:36.597702 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-16b2208f-8a10-4705-b714-7f203ee820a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33c95dd165934af4b2bd741ff35ae622'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:09:36.615378 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1148/2311] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:09:36 2022] DELETE /identity/v3/users/33c95dd165934af4b2bd741ff35ae622 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:09:36.839376 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4361f0-d6be-479d-93fc-011fdf4d9e1f service nova] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:09:36.850128 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4361f0-d6be-479d-93fc-011fdf4d9e1f service nova] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:09:36.860448 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:09:36.909439 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75927660-cbf4-4640-a022-bf7d31a06d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:09:36.910315 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75927660-cbf4-4640-a022-bf7d31a06d61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:09:36.910604 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75927660-cbf4-4640-a022-bf7d31a06d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:09:36.910887 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75927660-cbf4-4640-a022-bf7d31a06d61 admin admin] PATH_INFO: `/v3/projects/cf6620a75d7245f683da286afa4d76ce` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:09:36.912113 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75927660-cbf4-4640-a022-bf7d31a06d61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf6620a75d7245f683da286afa4d76ce)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:09:36.914051 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75927660-cbf4-4640-a022-bf7d31a06d61 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:09:37.030696 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-75927660-cbf4-4640-a022-bf7d31a06d61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf6620a75d7245f683da286afa4d76ce', 'request_id': 'req-75927660-cbf4-4640-a022-bf7d31a06d61'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:09:37.039236 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-75927660-cbf4-4640-a022-bf7d31a06d61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf6620a75d7245f683da286afa4d76ce', 'request_id': 'req-75927660-cbf4-4640-a022-bf7d31a06d61'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:09:37.045274 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-75927660-cbf4-4640-a022-bf7d31a06d61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf6620a75d7245f683da286afa4d76ce', 'request_id': 'req-75927660-cbf4-4640-a022-bf7d31a06d61'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:09:37.140952 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-75927660-cbf4-4640-a022-bf7d31a06d61 admin admin] The token cache is being invalidate because project cf6620a75d7245f683da286afa4d76ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:09:37.141258 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-75927660-cbf4-4640-a022-bf7d31a06d61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:09:37.141889 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-75927660-cbf4-4640-a022-bf7d31a06d61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:09:37.148677 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1164/2312] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:09:36 2022] DELETE /identity/v3/projects/cf6620a75d7245f683da286afa4d76ce => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:09:37.148800 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf540e5-0b1b-4064-941d-a9a260f279d8 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:09:37.149231 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf540e5-0b1b-4064-941d-a9a260f279d8 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:09:37.149231 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf540e5-0b1b-4064-941d-a9a260f279d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:09:37.167579 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-eaf540e5-0b1b-4064-941d-a9a260f279d8 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:09:37.168827 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-eaf540e5-0b1b-4064-941d-a9a260f279d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:09:37.208434 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:09:37.226986 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1149/2313] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:09:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:09:37.234994 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e691ac1-35f2-414b-998c-c259840c0ff9 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:09:37.235440 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e691ac1-35f2-414b-998c-c259840c0ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:09:37.235727 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e691ac1-35f2-414b-998c-c259840c0ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:09:37.253913 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-1e691ac1-35f2-414b-998c-c259840c0ff9 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:09:37.255112 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-1e691ac1-35f2-414b-998c-c259840c0ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:09:37.262961 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1165/2314] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:09:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:09:37.267431 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf540e5-0b1b-4064-941d-a9a260f279d8 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:09:37.276876 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf540e5-0b1b-4064-941d-a9a260f279d8 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:09:37.282177 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db754472-ed15-4c26-8737-6aadbd7147bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:09:37.282850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db754472-ed15-4c26-8737-6aadbd7147bf admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:09:37.283880 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db754472-ed15-4c26-8737-6aadbd7147bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:09:37.283880 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db754472-ed15-4c26-8737-6aadbd7147bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:09:37.284160 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db754472-ed15-4c26-8737-6aadbd7147bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:09:37.284475 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db754472-ed15-4c26-8737-6aadbd7147bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:09:37.286203 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db754472-ed15-4c26-8737-6aadbd7147bf admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:09:37.298644 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1150/2315] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:09:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:09:37.302918 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e691ac1-35f2-414b-998c-c259840c0ff9 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:09:37.312682 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e691ac1-35f2-414b-998c-c259840c0ff9 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:09:37.318194 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b785630-b6e5-4333-bf5f-97d65df16dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:09:37.319034 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b785630-b6e5-4333-bf5f-97d65df16dc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:09:37.319441 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b785630-b6e5-4333-bf5f-97d65df16dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:09:37.319790 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b785630-b6e5-4333-bf5f-97d65df16dc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:09:37.320633 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b785630-b6e5-4333-bf5f-97d65df16dc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:09:37.322804 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b785630-b6e5-4333-bf5f-97d65df16dc7 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:09:37.404880 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1166/2316] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:09:37 2022] POST /identity/v3/projects => generated 367 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:09:37.406665 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db754472-ed15-4c26-8737-6aadbd7147bf admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:09:37.429235 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db754472-ed15-4c26-8737-6aadbd7147bf admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:09:37.498449 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e48af6-5adb-44b1-bf95-06e610a7d3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:09:37.499157 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e48af6-5adb-44b1-bf95-06e610a7d3fd admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:09:37.499444 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e48af6-5adb-44b1-bf95-06e610a7d3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:09:37.499725 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e48af6-5adb-44b1-bf95-06e610a7d3fd admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:09:37.500509 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e48af6-5adb-44b1-bf95-06e610a7d3fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:09:37.502404 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e48af6-5adb-44b1-bf95-06e610a7d3fd admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:09:37.574966 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1151/2317] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:09:37 2022] POST /identity/v3/users => generated 284 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:09:37.579735 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b785630-b6e5-4333-bf5f-97d65df16dc7 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:09:37.589835 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b785630-b6e5-4333-bf5f-97d65df16dc7 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:09:37.595755 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a0497-2e13-44c5-b99a-d5943205c381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:09:37.596585 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a0497-2e13-44c5-b99a-d5943205c381 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:09:37.596880 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a0497-2e13-44c5-b99a-d5943205c381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:09:37.597167 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a0497-2e13-44c5-b99a-d5943205c381 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:09:37.597899 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a0497-2e13-44c5-b99a-d5943205c381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:09:37.599510 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a0497-2e13-44c5-b99a-d5943205c381 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:09:37.610639 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1167/2318] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:09:37.614523 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e48af6-5adb-44b1-bf95-06e610a7d3fd admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:09:37.624758 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e48af6-5adb-44b1-bf95-06e610a7d3fd admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:09:37.629909 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e654c6-1913-4098-8b84-054855952198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:09:37.630569 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e654c6-1913-4098-8b84-054855952198 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:09:37.630857 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e654c6-1913-4098-8b84-054855952198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:09:37.631140 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e654c6-1913-4098-8b84-054855952198 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:09:37.631867 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e654c6-1913-4098-8b84-054855952198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:09:37.633487 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e654c6-1913-4098-8b84-054855952198 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:09:37.644508 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1152/2319] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:09:37.648590 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a0497-2e13-44c5-b99a-d5943205c381 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:09:37.659148 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a0497-2e13-44c5-b99a-d5943205c381 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:09:37.663954 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6da784-8555-49d2-a641-737c812a2ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:09:37.664884 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6da784-8555-49d2-a641-737c812a2ef1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:09:37.665176 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6da784-8555-49d2-a641-737c812a2ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:09:37.665465 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6da784-8555-49d2-a641-737c812a2ef1 admin admin] PATH_INFO: `/v3/projects/a06fa6b43b1b473883e99fc1ee5e8f47/users/a8223548194b4d9ba0a43a990b9824df/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:09:37.680425 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6da784-8555-49d2-a641-737c812a2ef1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a06fa6b43b1b473883e99fc1ee5e8f47, user_id=a8223548194b4d9ba0a43a990b9824df, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:09:37.683053 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6da784-8555-49d2-a641-737c812a2ef1 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:09:37.746811 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1168/2320] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:09:37 2022] PUT /identity/v3/projects/a06fa6b43b1b473883e99fc1ee5e8f47/users/a8223548194b4d9ba0a43a990b9824df/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:09:37.756967 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034fa56-5bef-4007-a216-613a0ac9d2e5 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:09:37.757265 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034fa56-5bef-4007-a216-613a0ac9d2e5 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:09:37.757547 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034fa56-5bef-4007-a216-613a0ac9d2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:09:37.786609 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-4034fa56-5bef-4007-a216-613a0ac9d2e5 None None] MFA Rules not processed for user `a8223548194b4d9ba0a43a990b9824df`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:09:37.787866 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-4034fa56-5bef-4007-a216-613a0ac9d2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:09:37.862109 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1153/2321] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:09:37 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:09:37.873697 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6da784-8555-49d2-a641-737c812a2ef1 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:09:37.875946 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-1b6da784-8555-49d2-a641-737c812a2ef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:09:37.918828 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:09:37.933026 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6da784-8555-49d2-a641-737c812a2ef1 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:09:37.937057 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb54bc7-59dd-49a5-bc85-2ccc63f8742f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da488c75631e4e5992304ff6c0579aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:09:37.938562 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb54bc7-59dd-49a5-bc85-2ccc63f8742f service glance] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:09:37.938930 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb54bc7-59dd-49a5-bc85-2ccc63f8742f service glance] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:09:37.939289 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb54bc7-59dd-49a5-bc85-2ccc63f8742f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:09:37.948531 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb54bc7-59dd-49a5-bc85-2ccc63f8742f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:09:37.949995 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb54bc7-59dd-49a5-bc85-2ccc63f8742f service glance] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:09:37.960646 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1169/2322] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:09:37 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:09:40.074493 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f292cff-54ff-455a-9a45-d9d460c3b65e None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:09:40.074978 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f292cff-54ff-455a-9a45-d9d460c3b65e None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:09:40.075097 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f292cff-54ff-455a-9a45-d9d460c3b65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:09:40.093939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-1f292cff-54ff-455a-9a45-d9d460c3b65e None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:09:40.099207 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-1f292cff-54ff-455a-9a45-d9d460c3b65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:09:40.131624 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:09:40.156881 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1154/2323] 10.222.0.27 () {58 vars in 1016 bytes} [Mon Jul 11 21:09:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:09:40.172659 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb54bc7-59dd-49a5-bc85-2ccc63f8742f service glance] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:09:40.174850 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-8eb54bc7-59dd-49a5-bc85-2ccc63f8742f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:09:40.247345 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb54bc7-59dd-49a5-bc85-2ccc63f8742f service glance] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:09:40.252922 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f254d6-eb06-45d2-b8ba-435362e1157f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:09:40.253565 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f254d6-eb06-45d2-b8ba-435362e1157f service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:09:40.253853 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f254d6-eb06-45d2-b8ba-435362e1157f service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:09:40.254128 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f254d6-eb06-45d2-b8ba-435362e1157f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:09:40.262253 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f254d6-eb06-45d2-b8ba-435362e1157f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:09:40.263849 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f254d6-eb06-45d2-b8ba-435362e1157f service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:09:40.273567 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1170/2324] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:09:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:09:49.972051 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099ff8e-abb4-4be3-9bee-b4df52546618 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:09:49.972600 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099ff8e-abb4-4be3-9bee-b4df52546618 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:09:49.972600 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099ff8e-abb4-4be3-9bee-b4df52546618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:09:49.991486 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-8099ff8e-abb4-4be3-9bee-b4df52546618 None None] MFA Rules not processed for user `6b67d92f0f644bc0861995318d10441c`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:09:49.992719 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-8099ff8e-abb4-4be3-9bee-b4df52546618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:09:50.047244 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1155/2325] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:09:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:09:50.269383 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=42 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:10:00.040601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=34 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:10:04.756988 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f254d6-eb06-45d2-b8ba-435362e1157f service nova] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:10:04.768337 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f254d6-eb06-45d2-b8ba-435362e1157f service nova] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:10:04.773342 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c963b0e-b8de-4631-94f2-34ec587db97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:10:04.774250 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c963b0e-b8de-4631-94f2-34ec587db97d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:04.774545 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c963b0e-b8de-4631-94f2-34ec587db97d admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:04.776895 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c963b0e-b8de-4631-94f2-34ec587db97d admin admin] PATH_INFO: `/v3/users/a8223548194b4d9ba0a43a990b9824df` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:04.776895 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c963b0e-b8de-4631-94f2-34ec587db97d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8223548194b4d9ba0a43a990b9824df)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:10:04.778160 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c963b0e-b8de-4631-94f2-34ec587db97d admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:10:04.984231 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-9c963b0e-b8de-4631-94f2-34ec587db97d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8223548194b4d9ba0a43a990b9824df'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:10:04.992227 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-9c963b0e-b8de-4631-94f2-34ec587db97d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8223548194b4d9ba0a43a990b9824df'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:10:04.993075 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-9c963b0e-b8de-4631-94f2-34ec587db97d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8223548194b4d9ba0a43a990b9824df'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:10:04.993715 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-9c963b0e-b8de-4631-94f2-34ec587db97d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8223548194b4d9ba0a43a990b9824df'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:10:05.072357 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-9c963b0e-b8de-4631-94f2-34ec587db97d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8223548194b4d9ba0a43a990b9824df'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:10:05.092879 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1171/2326] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:10:04 2022] DELETE /identity/v3/users/a8223548194b4d9ba0a43a990b9824df => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:10:05.097340 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56883e40-51e3-46db-9ee7-952898ca4d83 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:05.097877 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56883e40-51e3-46db-9ee7-952898ca4d83 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:05.097961 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56883e40-51e3-46db-9ee7-952898ca4d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:05.116759 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-56883e40-51e3-46db-9ee7-952898ca4d83 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:10:05.118255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-56883e40-51e3-46db-9ee7-952898ca4d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:10:05.178088 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1156/2327] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:10:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:10:05.188468 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c963b0e-b8de-4631-94f2-34ec587db97d admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:10:05.189940 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-9c963b0e-b8de-4631-94f2-34ec587db97d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:10:05.251153 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c963b0e-b8de-4631-94f2-34ec587db97d admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:10:05.254930 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0cd7d-6ebc-42d3-8628-a6d06f01fd04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:10:05.264239 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0cd7d-6ebc-42d3-8628-a6d06f01fd04 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:05.264239 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0cd7d-6ebc-42d3-8628-a6d06f01fd04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:05.264239 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0cd7d-6ebc-42d3-8628-a6d06f01fd04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:05.268014 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc0cd7d-6ebc-42d3-8628-a6d06f01fd04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:10:05.269489 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc0cd7d-6ebc-42d3-8628-a6d06f01fd04 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:10:05.280382 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1172/2328] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:10:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:10:05.799515 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56883e40-51e3-46db-9ee7-952898ca4d83 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:10:05.801145 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-56883e40-51e3-46db-9ee7-952898ca4d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:10:05.814566 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56883e40-51e3-46db-9ee7-952898ca4d83 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:10:05.819882 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84dadf3-3b99-4376-a281-dfae0da5e44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:10:05.820937 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84dadf3-3b99-4376-a281-dfae0da5e44d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:05.821314 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84dadf3-3b99-4376-a281-dfae0da5e44d admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:05.821656 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84dadf3-3b99-4376-a281-dfae0da5e44d admin admin] PATH_INFO: `/v3/projects/a06fa6b43b1b473883e99fc1ee5e8f47` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:05.822888 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84dadf3-3b99-4376-a281-dfae0da5e44d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a06fa6b43b1b473883e99fc1ee5e8f47)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:10:05.824902 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84dadf3-3b99-4376-a281-dfae0da5e44d admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:10:05.930472 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e84dadf3-3b99-4376-a281-dfae0da5e44d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a06fa6b43b1b473883e99fc1ee5e8f47', 'request_id': 'req-e84dadf3-3b99-4376-a281-dfae0da5e44d'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:10:05.936650 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e84dadf3-3b99-4376-a281-dfae0da5e44d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a06fa6b43b1b473883e99fc1ee5e8f47', 'request_id': 'req-e84dadf3-3b99-4376-a281-dfae0da5e44d'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:10:05.942612 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e84dadf3-3b99-4376-a281-dfae0da5e44d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a06fa6b43b1b473883e99fc1ee5e8f47', 'request_id': 'req-e84dadf3-3b99-4376-a281-dfae0da5e44d'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:10:06.019890 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e84dadf3-3b99-4376-a281-dfae0da5e44d admin admin] The token cache is being invalidate because project a06fa6b43b1b473883e99fc1ee5e8f47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:10:06.020231 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e84dadf3-3b99-4376-a281-dfae0da5e44d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:10:06.020850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e84dadf3-3b99-4376-a281-dfae0da5e44d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:10:06.022454 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1157/2329] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:10:05 2022] DELETE /identity/v3/projects/a06fa6b43b1b473883e99fc1ee5e8f47 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:10:06.027369 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6947e8-8753-4056-ae6f-fdae8c426eea None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:06.027853 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6947e8-8753-4056-ae6f-fdae8c426eea None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:06.027951 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6947e8-8753-4056-ae6f-fdae8c426eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:06.045694 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-4f6947e8-8753-4056-ae6f-fdae8c426eea None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:10:06.046884 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-4f6947e8-8753-4056-ae6f-fdae8c426eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:10:06.107321 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1173/2330] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:10:06.115066 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d8a3b-ca11-4c5b-9626-f2fbff9377a5 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:06.115570 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d8a3b-ca11-4c5b-9626-f2fbff9377a5 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:06.115667 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d8a3b-ca11-4c5b-9626-f2fbff9377a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:06.134916 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-3d8d8a3b-ca11-4c5b-9626-f2fbff9377a5 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:10:06.136198 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-3d8d8a3b-ca11-4c5b-9626-f2fbff9377a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:10:06.144289 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1158/2331] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:10:06.148508 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6947e8-8753-4056-ae6f-fdae8c426eea None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:10:06.158398 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6947e8-8753-4056-ae6f-fdae8c426eea None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:10:06.164853 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2357b-a73f-41b2-9a89-826a76b559d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:10:06.165268 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2357b-a73f-41b2-9a89-826a76b559d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:06.165678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2357b-a73f-41b2-9a89-826a76b559d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:06.165975 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2357b-a73f-41b2-9a89-826a76b559d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:06.166721 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2357b-a73f-41b2-9a89-826a76b559d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:10:06.167041 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2357b-a73f-41b2-9a89-826a76b559d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:10:06.168699 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2357b-a73f-41b2-9a89-826a76b559d1 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:10:06.181914 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1174/2332] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:10:06.186244 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d8a3b-ca11-4c5b-9626-f2fbff9377a5 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:10:06.195769 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d8a3b-ca11-4c5b-9626-f2fbff9377a5 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:10:06.200424 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a68d7a-597f-4296-931d-e007aea90565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:10:06.201076 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a68d7a-597f-4296-931d-e007aea90565 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:06.201364 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a68d7a-597f-4296-931d-e007aea90565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:06.201641 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a68d7a-597f-4296-931d-e007aea90565 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:06.202331 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a68d7a-597f-4296-931d-e007aea90565 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:10:06.204237 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a68d7a-597f-4296-931d-e007aea90565 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:10:06.284249 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1159/2333] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:10:06 2022] POST /identity/v3/projects => generated 371 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:10:06.289035 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2357b-a73f-41b2-9a89-826a76b559d1 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:10:06.294189 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:10:06.299540 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2357b-a73f-41b2-9a89-826a76b559d1 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:10:06.354805 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d07c8-2b0e-41fd-b18e-9e12b9916601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:10:06.355479 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d07c8-2b0e-41fd-b18e-9e12b9916601 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:06.355771 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d07c8-2b0e-41fd-b18e-9e12b9916601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:06.356111 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d07c8-2b0e-41fd-b18e-9e12b9916601 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:06.356783 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d07c8-2b0e-41fd-b18e-9e12b9916601 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:10:06.358713 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d07c8-2b0e-41fd-b18e-9e12b9916601 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:10:06.448832 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1175/2334] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:10:06 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:10:06.452949 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a68d7a-597f-4296-931d-e007aea90565 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:10:06.463437 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a68d7a-597f-4296-931d-e007aea90565 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:10:06.468175 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe868df-ac44-4362-8677-b4d8b240da1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:10:06.468843 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe868df-ac44-4362-8677-b4d8b240da1d admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:06.469132 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe868df-ac44-4362-8677-b4d8b240da1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:06.469415 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe868df-ac44-4362-8677-b4d8b240da1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:06.470215 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe868df-ac44-4362-8677-b4d8b240da1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:10:06.471807 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe868df-ac44-4362-8677-b4d8b240da1d admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:10:06.482670 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1160/2335] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:10:06.486832 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d07c8-2b0e-41fd-b18e-9e12b9916601 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:10:06.498331 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d07c8-2b0e-41fd-b18e-9e12b9916601 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:10:06.502918 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86acf8c-0d5c-428d-a048-4d422f3acf24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:10:06.503588 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86acf8c-0d5c-428d-a048-4d422f3acf24 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:06.503879 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86acf8c-0d5c-428d-a048-4d422f3acf24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:06.504198 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86acf8c-0d5c-428d-a048-4d422f3acf24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:06.504961 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86acf8c-0d5c-428d-a048-4d422f3acf24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:10:06.506568 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86acf8c-0d5c-428d-a048-4d422f3acf24 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:10:06.516693 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1176/2336] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:10:06.521085 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe868df-ac44-4362-8677-b4d8b240da1d admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:10:06.531736 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe868df-ac44-4362-8677-b4d8b240da1d admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:10:06.536356 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894fa367-b2f3-44f0-8b2e-05c6a438124d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:10:06.537243 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894fa367-b2f3-44f0-8b2e-05c6a438124d admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:06.537532 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894fa367-b2f3-44f0-8b2e-05c6a438124d admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:06.537814 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894fa367-b2f3-44f0-8b2e-05c6a438124d admin admin] PATH_INFO: `/v3/projects/74ae662fedc949ceaf3cd0f5b035cd55/users/0a7f18e77aa34a7dadef708fbfc533db/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:06.552917 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894fa367-b2f3-44f0-8b2e-05c6a438124d admin admin] RBAC: Authorizing `identity:create_grant(project_id=74ae662fedc949ceaf3cd0f5b035cd55, user_id=0a7f18e77aa34a7dadef708fbfc533db, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:10:06.555681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894fa367-b2f3-44f0-8b2e-05c6a438124d admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:10:06.614598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1161/2337] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:10:06 2022] PUT /identity/v3/projects/74ae662fedc949ceaf3cd0f5b035cd55/users/0a7f18e77aa34a7dadef708fbfc533db/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:10:06.624901 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e0569-7f82-48c6-8c4c-46386908b302 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:06.625203 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e0569-7f82-48c6-8c4c-46386908b302 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:06.625490 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e0569-7f82-48c6-8c4c-46386908b302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:06.653190 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-c27e0569-7f82-48c6-8c4c-46386908b302 None None] MFA Rules not processed for user `0a7f18e77aa34a7dadef708fbfc533db`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:10:06.654423 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-c27e0569-7f82-48c6-8c4c-46386908b302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:10:06.717744 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1177/2338] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:10:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:10:06.729578 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894fa367-b2f3-44f0-8b2e-05c6a438124d admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:10:06.731251 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-894fa367-b2f3-44f0-8b2e-05c6a438124d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:10:06.754178 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:10:06.791497 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894fa367-b2f3-44f0-8b2e-05c6a438124d admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:10:06.795243 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2e314-9d0b-4afb-80c1-49df3fa1b681 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da488c75631e4e5992304ff6c0579aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:10:06.799589 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2e314-9d0b-4afb-80c1-49df3fa1b681 service glance] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:06.799589 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2e314-9d0b-4afb-80c1-49df3fa1b681 service glance] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:06.799589 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2e314-9d0b-4afb-80c1-49df3fa1b681 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:06.806347 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d2e314-9d0b-4afb-80c1-49df3fa1b681 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:10:06.808015 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d2e314-9d0b-4afb-80c1-49df3fa1b681 service glance] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:10:06.817197 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1162/2339] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:10:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:10:10.475881 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e8393-c97b-4493-8efa-d0311faed1df None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:10.477150 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e8393-c97b-4493-8efa-d0311faed1df None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:10.477351 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e8393-c97b-4493-8efa-d0311faed1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:10.496650 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-6e1e8393-c97b-4493-8efa-d0311faed1df None None] MFA Rules not processed for user `01541b7e5e984884bf87ef6d31b9480c`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:10:10.497931 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-6e1e8393-c97b-4493-8efa-d0311faed1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:10:10.555539 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1178/2340] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:10:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:10:15.311499 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2e314-9d0b-4afb-80c1-49df3fa1b681 service glance] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:10:15.313060 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b6d2e314-9d0b-4afb-80c1-49df3fa1b681 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:10:15.386140 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2e314-9d0b-4afb-80c1-49df3fa1b681 service glance] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:10:15.391009 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75377aa4-53cf-473f-b04d-39b5358f80ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:10:15.397639 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75377aa4-53cf-473f-b04d-39b5358f80ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:15.397639 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75377aa4-53cf-473f-b04d-39b5358f80ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:15.397639 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75377aa4-53cf-473f-b04d-39b5358f80ff admin admin] PATH_INFO: `/v3/users/61f1ca8c4c174ab49d2b722990d7b8f1` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:15.397639 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75377aa4-53cf-473f-b04d-39b5358f80ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=61f1ca8c4c174ab49d2b722990d7b8f1)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:10:15.397639 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75377aa4-53cf-473f-b04d-39b5358f80ff admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:10:15.584578 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-75377aa4-53cf-473f-b04d-39b5358f80ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61f1ca8c4c174ab49d2b722990d7b8f1'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:10:15.592118 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-75377aa4-53cf-473f-b04d-39b5358f80ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61f1ca8c4c174ab49d2b722990d7b8f1'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:10:15.592794 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-75377aa4-53cf-473f-b04d-39b5358f80ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61f1ca8c4c174ab49d2b722990d7b8f1'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:10:15.593395 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-75377aa4-53cf-473f-b04d-39b5358f80ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61f1ca8c4c174ab49d2b722990d7b8f1'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:10:15.632018 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-75377aa4-53cf-473f-b04d-39b5358f80ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61f1ca8c4c174ab49d2b722990d7b8f1'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:10:15.655721 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1163/2341] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:10:15 2022] DELETE /identity/v3/users/61f1ca8c4c174ab49d2b722990d7b8f1 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:10:15.909124 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e8393-c97b-4493-8efa-d0311faed1df None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:10:15.927515 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e8393-c97b-4493-8efa-d0311faed1df None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:10:15.948029 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:10:16.018301 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf7c30-614e-4c8e-a862-7e3fb474c6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:10:16.018819 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf7c30-614e-4c8e-a862-7e3fb474c6b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:16.019368 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf7c30-614e-4c8e-a862-7e3fb474c6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:16.019798 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf7c30-614e-4c8e-a862-7e3fb474c6b6 admin admin] PATH_INFO: `/v3/projects/4439039fe49c499888cf624551befcff` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:16.021357 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf7c30-614e-4c8e-a862-7e3fb474c6b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4439039fe49c499888cf624551befcff)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:10:16.023431 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf7c30-614e-4c8e-a862-7e3fb474c6b6 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:10:16.155469 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-c2bf7c30-614e-4c8e-a862-7e3fb474c6b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4439039fe49c499888cf624551befcff', 'request_id': 'req-c2bf7c30-614e-4c8e-a862-7e3fb474c6b6'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:10:16.162961 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-c2bf7c30-614e-4c8e-a862-7e3fb474c6b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4439039fe49c499888cf624551befcff', 'request_id': 'req-c2bf7c30-614e-4c8e-a862-7e3fb474c6b6'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:10:16.170773 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-c2bf7c30-614e-4c8e-a862-7e3fb474c6b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4439039fe49c499888cf624551befcff', 'request_id': 'req-c2bf7c30-614e-4c8e-a862-7e3fb474c6b6'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:10:16.215544 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-c2bf7c30-614e-4c8e-a862-7e3fb474c6b6 admin admin] The token cache is being invalidate because project 4439039fe49c499888cf624551befcff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:10:16.215864 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-c2bf7c30-614e-4c8e-a862-7e3fb474c6b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:10:16.216635 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-c2bf7c30-614e-4c8e-a862-7e3fb474c6b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:10:16.219021 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1179/2342] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:10:15 2022] DELETE /identity/v3/projects/4439039fe49c499888cf624551befcff => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:10:16.224002 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6828f-89ff-46c1-b49a-9907a01e63ad None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:16.224201 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6828f-89ff-46c1-b49a-9907a01e63ad None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:16.224402 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6828f-89ff-46c1-b49a-9907a01e63ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:16.247448 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-e5b6828f-89ff-46c1-b49a-9907a01e63ad None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:10:16.248711 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-e5b6828f-89ff-46c1-b49a-9907a01e63ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:10:16.293423 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:10:16.315907 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1164/2343] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:10:16.324778 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600d972-3ba4-4840-b943-61b79b373dc4 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:16.324778 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600d972-3ba4-4840-b943-61b79b373dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:16.325314 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600d972-3ba4-4840-b943-61b79b373dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:16.345581 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-1600d972-3ba4-4840-b943-61b79b373dc4 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:10:16.348595 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-1600d972-3ba4-4840-b943-61b79b373dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:10:16.359885 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1180/2344] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:10:16.360619 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6828f-89ff-46c1-b49a-9907a01e63ad None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:10:16.370587 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6828f-89ff-46c1-b49a-9907a01e63ad None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:10:16.375667 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85284f7e-5d2d-4371-ac19-69dfbf64cf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:10:16.376537 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85284f7e-5d2d-4371-ac19-69dfbf64cf23 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:16.376921 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85284f7e-5d2d-4371-ac19-69dfbf64cf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:16.377296 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85284f7e-5d2d-4371-ac19-69dfbf64cf23 admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:16.378201 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85284f7e-5d2d-4371-ac19-69dfbf64cf23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:10:16.378593 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85284f7e-5d2d-4371-ac19-69dfbf64cf23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:10:16.380744 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85284f7e-5d2d-4371-ac19-69dfbf64cf23 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:10:16.395206 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1165/2345] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:10:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:10:16.400274 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600d972-3ba4-4840-b943-61b79b373dc4 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:10:16.411779 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600d972-3ba4-4840-b943-61b79b373dc4 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:10:16.418668 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28970c3-9231-4de8-b137-e7ac46295d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:10:16.419366 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28970c3-9231-4de8-b137-e7ac46295d7d admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:16.419654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28970c3-9231-4de8-b137-e7ac46295d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:16.419936 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28970c3-9231-4de8-b137-e7ac46295d7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:16.420690 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28970c3-9231-4de8-b137-e7ac46295d7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:10:16.422609 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28970c3-9231-4de8-b137-e7ac46295d7d admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:10:16.514303 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1181/2346] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:10:16 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:10:16.518665 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85284f7e-5d2d-4371-ac19-69dfbf64cf23 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:10:16.532578 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85284f7e-5d2d-4371-ac19-69dfbf64cf23 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:10:16.610320 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6a07d-ab71-404d-8578-e6b5c763ca4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:10:16.611113 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6a07d-ab71-404d-8578-e6b5c763ca4d admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:16.611486 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6a07d-ab71-404d-8578-e6b5c763ca4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:16.611818 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6a07d-ab71-404d-8578-e6b5c763ca4d admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:16.612622 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a6a07d-ab71-404d-8578-e6b5c763ca4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:10:16.614627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a6a07d-ab71-404d-8578-e6b5c763ca4d admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:10:16.688015 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1166/2347] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:10:16 2022] POST /identity/v3/users => generated 287 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:10:16.689485 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28970c3-9231-4de8-b137-e7ac46295d7d admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:10:16.700059 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28970c3-9231-4de8-b137-e7ac46295d7d admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:10:16.704734 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57fdeb-3779-4262-ac59-2950d34d40dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:10:16.705473 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57fdeb-3779-4262-ac59-2950d34d40dd admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:16.705827 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57fdeb-3779-4262-ac59-2950d34d40dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:16.706172 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57fdeb-3779-4262-ac59-2950d34d40dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:16.707007 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57fdeb-3779-4262-ac59-2950d34d40dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:10:16.708733 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57fdeb-3779-4262-ac59-2950d34d40dd admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:10:16.719482 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1182/2348] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:10:16.724350 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6a07d-ab71-404d-8578-e6b5c763ca4d admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:10:16.735311 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6a07d-ab71-404d-8578-e6b5c763ca4d admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:10:16.740479 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c84bfb-4355-41cc-9e21-370a914e3aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:10:16.741487 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c84bfb-4355-41cc-9e21-370a914e3aed admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:16.741952 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c84bfb-4355-41cc-9e21-370a914e3aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:16.743288 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c84bfb-4355-41cc-9e21-370a914e3aed admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:16.744253 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c84bfb-4355-41cc-9e21-370a914e3aed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:10:16.745894 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c84bfb-4355-41cc-9e21-370a914e3aed admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:10:16.757778 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1167/2349] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:10:16.762048 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57fdeb-3779-4262-ac59-2950d34d40dd admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:10:16.772655 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57fdeb-3779-4262-ac59-2950d34d40dd admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:10:16.777800 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8cc25-34b3-49d5-8b57-b8a1ca4a233d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:10:16.778704 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8cc25-34b3-49d5-8b57-b8a1ca4a233d admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:16.778995 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8cc25-34b3-49d5-8b57-b8a1ca4a233d admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:16.779309 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8cc25-34b3-49d5-8b57-b8a1ca4a233d admin admin] PATH_INFO: `/v3/projects/e301c3c4aae441a5950a91e1833284b0/users/d010d926f1d3454495478913094d87cb/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:16.799006 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8cc25-34b3-49d5-8b57-b8a1ca4a233d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e301c3c4aae441a5950a91e1833284b0, user_id=d010d926f1d3454495478913094d87cb, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:10:16.801748 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8cc25-34b3-49d5-8b57-b8a1ca4a233d admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:10:16.889941 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1183/2350] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:10:16 2022] PUT /identity/v3/projects/e301c3c4aae441a5950a91e1833284b0/users/d010d926f1d3454495478913094d87cb/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:10:16.895626 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeef573-0101-4db6-90b5-ab5f33b99758 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:16.895945 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeef573-0101-4db6-90b5-ab5f33b99758 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:16.897233 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeef573-0101-4db6-90b5-ab5f33b99758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:16.916976 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-ceeef573-0101-4db6-90b5-ab5f33b99758 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:10:16.918341 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-ceeef573-0101-4db6-90b5-ab5f33b99758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:10:16.984302 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1168/2351] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:10:16.994544 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8cc25-34b3-49d5-8b57-b8a1ca4a233d admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:10:16.996364 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-e6f8cc25-34b3-49d5-8b57-b8a1ca4a233d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:10:17.044086 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:10:17.056048 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8cc25-34b3-49d5-8b57-b8a1ca4a233d admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:10:17.060291 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25773e01-b121-4335-bc4e-242662f29a74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:10:17.061041 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25773e01-b121-4335-bc4e-242662f29a74 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:17.061353 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25773e01-b121-4335-bc4e-242662f29a74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:17.061653 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25773e01-b121-4335-bc4e-242662f29a74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:17.071473 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25773e01-b121-4335-bc4e-242662f29a74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:10:17.073785 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25773e01-b121-4335-bc4e-242662f29a74 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:10:17.083058 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1184/2352] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:10:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:10:22.454127 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e383f8-c158-4bdc-8e78-5b90cf8ba359 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:22.454711 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e383f8-c158-4bdc-8e78-5b90cf8ba359 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:22.454711 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e383f8-c158-4bdc-8e78-5b90cf8ba359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:22.483300 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-81e383f8-c158-4bdc-8e78-5b90cf8ba359 None None] MFA Rules not processed for user `d010d926f1d3454495478913094d87cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:10:22.484774 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-81e383f8-c158-4bdc-8e78-5b90cf8ba359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:10:22.528701 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:10:22.560119 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1169/2353] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:10:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:10:22.562422 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25773e01-b121-4335-bc4e-242662f29a74 service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:10:22.572890 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25773e01-b121-4335-bc4e-242662f29a74 service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:10:22.577543 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb155d3-c194-40a1-9cf2-e83b825d8d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:10:22.578213 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb155d3-c194-40a1-9cf2-e83b825d8d7d admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:22.578501 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb155d3-c194-40a1-9cf2-e83b825d8d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:22.578782 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb155d3-c194-40a1-9cf2-e83b825d8d7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:22.579533 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb155d3-c194-40a1-9cf2-e83b825d8d7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:10:22.581476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb155d3-c194-40a1-9cf2-e83b825d8d7d admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:10:22.679423 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1185/2354] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:10:22 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:10:22.683254 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e383f8-c158-4bdc-8e78-5b90cf8ba359 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:10:22.694466 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e383f8-c158-4bdc-8e78-5b90cf8ba359 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:10:22.760184 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b23b0-1c8d-4086-9888-5d5f30f04588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:10:22.760900 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b23b0-1c8d-4086-9888-5d5f30f04588 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:22.761192 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b23b0-1c8d-4086-9888-5d5f30f04588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:22.769610 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b23b0-1c8d-4086-9888-5d5f30f04588 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:22.769610 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b23b0-1c8d-4086-9888-5d5f30f04588 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:10:22.769610 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b23b0-1c8d-4086-9888-5d5f30f04588 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:10:22.822361 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1170/2355] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:10:22 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:10:22.826247 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb155d3-c194-40a1-9cf2-e83b825d8d7d admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:10:22.837781 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb155d3-c194-40a1-9cf2-e83b825d8d7d admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:10:22.842901 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e6256-15f2-4dc4-8fc2-9b818504d51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:10:22.844055 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e6256-15f2-4dc4-8fc2-9b818504d51b admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:22.844055 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e6256-15f2-4dc4-8fc2-9b818504d51b admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:22.844256 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e6256-15f2-4dc4-8fc2-9b818504d51b admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:22.844994 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6e6256-15f2-4dc4-8fc2-9b818504d51b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:10:22.846628 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6e6256-15f2-4dc4-8fc2-9b818504d51b admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:10:22.881785 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1186/2356] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:10:22.883559 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b23b0-1c8d-4086-9888-5d5f30f04588 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:10:22.895135 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b23b0-1c8d-4086-9888-5d5f30f04588 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:10:22.901456 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37a9e0-c77a-43bc-b38c-efdb53b8053a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:10:22.902361 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37a9e0-c77a-43bc-b38c-efdb53b8053a admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:22.902647 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37a9e0-c77a-43bc-b38c-efdb53b8053a admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:22.902924 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37a9e0-c77a-43bc-b38c-efdb53b8053a admin admin] PATH_INFO: `/v3/projects/47922420541e4ece9338113b0bf86abc/users/2d694ad41b0d456485f83d3251265f74/roles/86273ff072f3438d822e870272491768` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:22.922191 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f37a9e0-c77a-43bc-b38c-efdb53b8053a admin admin] RBAC: Authorizing `identity:create_grant(project_id=47922420541e4ece9338113b0bf86abc, user_id=2d694ad41b0d456485f83d3251265f74, role_id=86273ff072f3438d822e870272491768)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:10:22.923588 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f37a9e0-c77a-43bc-b38c-efdb53b8053a admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:10:22.998769 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1171/2357] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:10:22 2022] PUT /identity/v3/projects/47922420541e4ece9338113b0bf86abc/users/2d694ad41b0d456485f83d3251265f74/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:10:23.002632 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e6256-15f2-4dc4-8fc2-9b818504d51b admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:10:23.013110 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e6256-15f2-4dc4-8fc2-9b818504d51b admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:10:23.073999 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d7b6c-0357-4dc9-bf28-dc055905fac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:10:23.074690 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d7b6c-0357-4dc9-bf28-dc055905fac9 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:23.074983 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d7b6c-0357-4dc9-bf28-dc055905fac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:23.075268 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d7b6c-0357-4dc9-bf28-dc055905fac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:23.076035 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d7b6c-0357-4dc9-bf28-dc055905fac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:10:23.077718 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d7b6c-0357-4dc9-bf28-dc055905fac9 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:10:23.088416 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1187/2358] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 21:10:23.094365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37a9e0-c77a-43bc-b38c-efdb53b8053a admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:10:23.104059 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37a9e0-c77a-43bc-b38c-efdb53b8053a admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:10:23.109013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b8d49-494e-47a9-b6f2-d2c2a2b7859b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:10:23.109914 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b8d49-494e-47a9-b6f2-d2c2a2b7859b admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:23.110196 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b8d49-494e-47a9-b6f2-d2c2a2b7859b admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:23.110594 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b8d49-494e-47a9-b6f2-d2c2a2b7859b admin admin] PATH_INFO: `/v3/projects/47922420541e4ece9338113b0bf86abc/users/2d694ad41b0d456485f83d3251265f74/roles/86273ff072f3438d822e870272491768` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:23.112623 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b8d49-494e-47a9-b6f2-d2c2a2b7859b admin admin] RBAC: Authorizing `identity:create_grant(project_id=47922420541e4ece9338113b0bf86abc, user_id=2d694ad41b0d456485f83d3251265f74, role_id=86273ff072f3438d822e870272491768)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:10:23.115292 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b8d49-494e-47a9-b6f2-d2c2a2b7859b admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:10:23.126489 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1172/2359] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:10:23 2022] PUT /identity/v3/projects/47922420541e4ece9338113b0bf86abc/users/2d694ad41b0d456485f83d3251265f74/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:10:29.539662 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca1b8a-e210-4bc1-9dbb-8e206490993d None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:29.540156 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca1b8a-e210-4bc1-9dbb-8e206490993d None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:29.540369 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca1b8a-e210-4bc1-9dbb-8e206490993d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:29.572881 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-e1ca1b8a-e210-4bc1-9dbb-8e206490993d None None] MFA Rules not processed for user `2d694ad41b0d456485f83d3251265f74`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:10:29.580745 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-e1ca1b8a-e210-4bc1-9dbb-8e206490993d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:10:29.584256 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e5a45-edec-4c11-b7af-f597c758f5ec None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:29.584761 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e5a45-edec-4c11-b7af-f597c758f5ec None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:29.584946 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e5a45-edec-4c11-b7af-f597c758f5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:29.604597 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-fd8e5a45-edec-4c11-b7af-f597c758f5ec None None] MFA Rules not processed for user `1c19d61152474a0bb1e373a9ce0310bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:10:29.605990 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-fd8e5a45-edec-4c11-b7af-f597c758f5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:10:29.676017 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1173/2360] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:10:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:10:29.678728 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1188/2361] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:10:29 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:10:29.694853 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e5a45-edec-4c11-b7af-f597c758f5ec None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:10:29.696691 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-fd8e5a45-edec-4c11-b7af-f597c758f5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:10:29.746638 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:10:29.802461 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e5a45-edec-4c11-b7af-f597c758f5ec None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:10:29.809844 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f731e0f-c9bb-48b4-b990-a4a7054ed05b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:10:29.811133 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f731e0f-c9bb-48b4-b990-a4a7054ed05b service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:29.811631 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f731e0f-c9bb-48b4-b990-a4a7054ed05b service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:29.812145 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f731e0f-c9bb-48b4-b990-a4a7054ed05b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:29.884886 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f731e0f-c9bb-48b4-b990-a4a7054ed05b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:10:29.886686 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f731e0f-c9bb-48b4-b990-a4a7054ed05b service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:10:29.916750 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1174/2362] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:10:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:10:32.800633 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0e0de-4604-4da4-ad96-c928d4e7b042 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:32.801434 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0e0de-4604-4da4-ad96-c928d4e7b042 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:32.801732 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0e0de-4604-4da4-ad96-c928d4e7b042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:32.901558 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-3ac0e0de-4604-4da4-ad96-c928d4e7b042 None None] MFA Rules not processed for user `d010d926f1d3454495478913094d87cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:10:32.902805 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-3ac0e0de-4604-4da4-ad96-c928d4e7b042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:10:32.912004 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1189/2363] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:10:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:10:33.986025 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f731e0f-c9bb-48b4-b990-a4a7054ed05b service nova] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:10:33.987620 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-4f731e0f-c9bb-48b4-b990-a4a7054ed05b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:10:34.095689 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f731e0f-c9bb-48b4-b990-a4a7054ed05b service nova] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:10:34.104307 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626b6b1-9d3f-4930-be46-ff2921f2e06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:10:34.106422 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626b6b1-9d3f-4930-be46-ff2921f2e06d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:34.106869 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626b6b1-9d3f-4930-be46-ff2921f2e06d admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:34.107255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626b6b1-9d3f-4930-be46-ff2921f2e06d admin admin] PATH_INFO: `/v3/users/0a7f18e77aa34a7dadef708fbfc533db` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:34.108678 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626b6b1-9d3f-4930-be46-ff2921f2e06d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a7f18e77aa34a7dadef708fbfc533db)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:10:34.110891 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626b6b1-9d3f-4930-be46-ff2921f2e06d admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:10:34.316557 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-a626b6b1-9d3f-4930-be46-ff2921f2e06d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a7f18e77aa34a7dadef708fbfc533db'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:10:34.325917 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-a626b6b1-9d3f-4930-be46-ff2921f2e06d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a7f18e77aa34a7dadef708fbfc533db'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:10:34.326828 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-a626b6b1-9d3f-4930-be46-ff2921f2e06d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a7f18e77aa34a7dadef708fbfc533db'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:10:34.327836 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-a626b6b1-9d3f-4930-be46-ff2921f2e06d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a7f18e77aa34a7dadef708fbfc533db'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:10:34.408953 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-a626b6b1-9d3f-4930-be46-ff2921f2e06d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a7f18e77aa34a7dadef708fbfc533db'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:10:34.426735 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:10:34.437669 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1175/2364] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:10:33 2022] DELETE /identity/v3/users/0a7f18e77aa34a7dadef708fbfc533db => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:10:34.441999 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9174c-491b-4c7d-9304-873782dc21f8 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:34.442560 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9174c-491b-4c7d-9304-873782dc21f8 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:34.442560 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9174c-491b-4c7d-9304-873782dc21f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:34.481565 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-58d9174c-491b-4c7d-9304-873782dc21f8 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:10:34.483242 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-58d9174c-491b-4c7d-9304-873782dc21f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:10:34.516512 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:10:34.569638 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1190/2365] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:10:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:10:34.578321 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626b6b1-9d3f-4930-be46-ff2921f2e06d admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:10:34.580000 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-a626b6b1-9d3f-4930-be46-ff2921f2e06d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:10:34.641650 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626b6b1-9d3f-4930-be46-ff2921f2e06d admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:10:34.645446 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedcb0f-86e6-46da-b1f7-cfdfc297dcd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:10:34.646108 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedcb0f-86e6-46da-b1f7-cfdfc297dcd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:34.646399 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedcb0f-86e6-46da-b1f7-cfdfc297dcd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:34.646683 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedcb0f-86e6-46da-b1f7-cfdfc297dcd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:34.660439 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aedcb0f-86e6-46da-b1f7-cfdfc297dcd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:10:34.662169 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aedcb0f-86e6-46da-b1f7-cfdfc297dcd2 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:10:34.673647 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1176/2366] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:10:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:10:35.248544 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9174c-491b-4c7d-9304-873782dc21f8 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:10:35.250170 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-58d9174c-491b-4c7d-9304-873782dc21f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:10:35.273496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9174c-491b-4c7d-9304-873782dc21f8 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:10:35.288771 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7d885-3083-436d-a5f9-9f3a48a48948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:10:35.292528 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7d885-3083-436d-a5f9-9f3a48a48948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:35.292645 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7d885-3083-436d-a5f9-9f3a48a48948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:35.292935 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7d885-3083-436d-a5f9-9f3a48a48948 admin admin] PATH_INFO: `/v3/projects/74ae662fedc949ceaf3cd0f5b035cd55` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:35.297048 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de7d885-3083-436d-a5f9-9f3a48a48948 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74ae662fedc949ceaf3cd0f5b035cd55)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:10:35.298904 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de7d885-3083-436d-a5f9-9f3a48a48948 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:10:35.410974 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-5de7d885-3083-436d-a5f9-9f3a48a48948 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74ae662fedc949ceaf3cd0f5b035cd55', 'request_id': 'req-5de7d885-3083-436d-a5f9-9f3a48a48948'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:10:35.418249 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-5de7d885-3083-436d-a5f9-9f3a48a48948 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74ae662fedc949ceaf3cd0f5b035cd55', 'request_id': 'req-5de7d885-3083-436d-a5f9-9f3a48a48948'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:10:35.424701 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-5de7d885-3083-436d-a5f9-9f3a48a48948 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74ae662fedc949ceaf3cd0f5b035cd55', 'request_id': 'req-5de7d885-3083-436d-a5f9-9f3a48a48948'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:10:35.500761 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-5de7d885-3083-436d-a5f9-9f3a48a48948 admin admin] The token cache is being invalidate because project 74ae662fedc949ceaf3cd0f5b035cd55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:10:35.501419 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-5de7d885-3083-436d-a5f9-9f3a48a48948 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:10:35.501683 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-5de7d885-3083-436d-a5f9-9f3a48a48948 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:10:35.503294 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1191/2367] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:10:35 2022] DELETE /identity/v3/projects/74ae662fedc949ceaf3cd0f5b035cd55 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:10:35.508428 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756ef23-3c1c-4fe1-86de-bfff483e094f None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:35.508879 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756ef23-3c1c-4fe1-86de-bfff483e094f None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:35.509009 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756ef23-3c1c-4fe1-86de-bfff483e094f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:35.527877 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-5756ef23-3c1c-4fe1-86de-bfff483e094f None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:10:35.529141 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-5756ef23-3c1c-4fe1-86de-bfff483e094f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:10:35.595853 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1177/2368] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:10:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:10:35.660946 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f4113-c4da-4ea7-88bd-de21952987a1 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:35.661164 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f4113-c4da-4ea7-88bd-de21952987a1 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:35.661630 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f4113-c4da-4ea7-88bd-de21952987a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:35.681789 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-756f4113-c4da-4ea7-88bd-de21952987a1 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:10:35.683308 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-756f4113-c4da-4ea7-88bd-de21952987a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:10:35.692952 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1192/2369] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:10:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:10:35.697558 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756ef23-3c1c-4fe1-86de-bfff483e094f None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:10:35.707425 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756ef23-3c1c-4fe1-86de-bfff483e094f None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:10:35.712199 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97dc785-496e-4283-9934-aa880d19b8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:10:35.713699 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97dc785-496e-4283-9934-aa880d19b8d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:35.713992 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97dc785-496e-4283-9934-aa880d19b8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:35.714278 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97dc785-496e-4283-9934-aa880d19b8d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:35.715205 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97dc785-496e-4283-9934-aa880d19b8d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:10:35.715529 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97dc785-496e-4283-9934-aa880d19b8d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:10:35.717161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97dc785-496e-4283-9934-aa880d19b8d4 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:10:35.730166 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1178/2370] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:10:35.734534 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f4113-c4da-4ea7-88bd-de21952987a1 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:10:35.744771 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f4113-c4da-4ea7-88bd-de21952987a1 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:10:35.749566 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324fc32-6f61-4a3e-9bfb-514b02e1c0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:10:35.750236 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324fc32-6f61-4a3e-9bfb-514b02e1c0fe admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:35.750528 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324fc32-6f61-4a3e-9bfb-514b02e1c0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:35.750825 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324fc32-6f61-4a3e-9bfb-514b02e1c0fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:35.751518 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324fc32-6f61-4a3e-9bfb-514b02e1c0fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:10:35.753480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324fc32-6f61-4a3e-9bfb-514b02e1c0fe admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:10:35.853004 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1193/2371] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:10:35 2022] POST /identity/v3/projects => generated 363 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:10:35.857468 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97dc785-496e-4283-9934-aa880d19b8d4 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:10:35.867769 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97dc785-496e-4283-9934-aa880d19b8d4 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:10:35.926977 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824f98e-0d9a-4de3-98bb-2f27952ffefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:10:35.927575 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824f98e-0d9a-4de3-98bb-2f27952ffefa admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:35.927865 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824f98e-0d9a-4de3-98bb-2f27952ffefa admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:35.928180 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824f98e-0d9a-4de3-98bb-2f27952ffefa admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:35.928892 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4824f98e-0d9a-4de3-98bb-2f27952ffefa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:10:35.930823 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4824f98e-0d9a-4de3-98bb-2f27952ffefa admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:10:36.032690 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1179/2372] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:10:35 2022] POST /identity/v3/users => generated 282 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:10:36.036761 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324fc32-6f61-4a3e-9bfb-514b02e1c0fe admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:10:36.048162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324fc32-6f61-4a3e-9bfb-514b02e1c0fe admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:10:36.052865 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6063ed-1afa-43c7-869a-0665f222d6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:10:36.053598 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6063ed-1afa-43c7-869a-0665f222d6cf admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:36.053892 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6063ed-1afa-43c7-869a-0665f222d6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:36.054180 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6063ed-1afa-43c7-869a-0665f222d6cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:36.054960 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6063ed-1afa-43c7-869a-0665f222d6cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:10:36.056791 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6063ed-1afa-43c7-869a-0665f222d6cf admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:10:36.067399 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1194/2373] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:10:36.071636 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824f98e-0d9a-4de3-98bb-2f27952ffefa admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:10:36.082154 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824f98e-0d9a-4de3-98bb-2f27952ffefa admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:10:36.087745 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36dccd7-5230-4eda-87b7-5cd7c82a3734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:10:36.088639 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36dccd7-5230-4eda-87b7-5cd7c82a3734 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:36.088932 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36dccd7-5230-4eda-87b7-5cd7c82a3734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:36.089230 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36dccd7-5230-4eda-87b7-5cd7c82a3734 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:36.089953 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36dccd7-5230-4eda-87b7-5cd7c82a3734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:10:36.091587 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36dccd7-5230-4eda-87b7-5cd7c82a3734 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:10:36.097514 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:10:36.104118 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1180/2374] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:10:36.108413 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6063ed-1afa-43c7-869a-0665f222d6cf admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:10:36.118630 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6063ed-1afa-43c7-869a-0665f222d6cf admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:10:36.123375 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6fce87-910a-4e30-9452-f17b0e0c166c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:10:36.124307 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6fce87-910a-4e30-9452-f17b0e0c166c admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:36.124591 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6fce87-910a-4e30-9452-f17b0e0c166c admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:36.124870 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6fce87-910a-4e30-9452-f17b0e0c166c admin admin] PATH_INFO: `/v3/projects/4bb9d5dd24e64522885c162514f4d5f6/users/33bd343c753f41a484faf64d17c133df/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:36.140320 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6fce87-910a-4e30-9452-f17b0e0c166c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bb9d5dd24e64522885c162514f4d5f6, user_id=33bd343c753f41a484faf64d17c133df, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:10:36.143005 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6fce87-910a-4e30-9452-f17b0e0c166c admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:10:36.250221 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1195/2375] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:10:36 2022] PUT /identity/v3/projects/4bb9d5dd24e64522885c162514f4d5f6/users/33bd343c753f41a484faf64d17c133df/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:10:36.260959 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54999f-1f11-42a3-bfd3-c3add6596f4a None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:36.261286 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54999f-1f11-42a3-bfd3-c3add6596f4a None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:36.261570 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54999f-1f11-42a3-bfd3-c3add6596f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:36.288932 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-ff54999f-1f11-42a3-bfd3-c3add6596f4a None None] MFA Rules not processed for user `33bd343c753f41a484faf64d17c133df`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:10:36.290193 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-ff54999f-1f11-42a3-bfd3-c3add6596f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:10:36.359282 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1181/2376] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:10:36 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:10:36.371525 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6fce87-910a-4e30-9452-f17b0e0c166c admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:10:36.373285 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-7e6fce87-910a-4e30-9452-f17b0e0c166c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:10:36.436153 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:10:36.441303 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6fce87-910a-4e30-9452-f17b0e0c166c admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:10:36.445724 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29666de2-73dd-4033-8899-1c58ed3efdb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:10:36.446418 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29666de2-73dd-4033-8899-1c58ed3efdb1 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:36.446706 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29666de2-73dd-4033-8899-1c58ed3efdb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:36.453324 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29666de2-73dd-4033-8899-1c58ed3efdb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:36.455730 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29666de2-73dd-4033-8899-1c58ed3efdb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:10:36.457220 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29666de2-73dd-4033-8899-1c58ed3efdb1 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:10:36.466733 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1196/2377] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:10:36 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:10:46.356110 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=32 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:10:46.528663 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=5 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:10:48.521913 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822bfac1-9674-4e94-9b06-191aeef331ed None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:48.522416 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822bfac1-9674-4e94-9b06-191aeef331ed None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:48.522522 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822bfac1-9674-4e94-9b06-191aeef331ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:48.540575 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-822bfac1-9674-4e94-9b06-191aeef331ed None None] MFA Rules not processed for user `90ea5d52fd6d4068b7837d363eebb94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:10:48.541787 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-822bfac1-9674-4e94-9b06-191aeef331ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:10:48.598284 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1182/2378] 10.222.0.40 () {58 vars in 967 bytes} [Mon Jul 11 21:10:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:10:48.712974 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29666de2-73dd-4033-8899-1c58ed3efdb1 service cinder] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:10:48.714466 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-29666de2-73dd-4033-8899-1c58ed3efdb1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:10:48.787454 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29666de2-73dd-4033-8899-1c58ed3efdb1 service cinder] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:10:48.796888 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceb86e5-c747-4268-bc75-daf0bba6a0c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc950dfb1d3b4308a33f3d430fe34c1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:10:48.797563 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb86e5-c747-4268-bc75-daf0bba6a0c0 service swift] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:48.797855 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb86e5-c747-4268-bc75-daf0bba6a0c0 service swift] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:48.798140 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb86e5-c747-4268-bc75-daf0bba6a0c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:48.807749 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceb86e5-c747-4268-bc75-daf0bba6a0c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:10:48.809382 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceb86e5-c747-4268-bc75-daf0bba6a0c0 service swift] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:10:48.817635 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1197/2379] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jul 11 21:10:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 21:10:58.591288 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=25 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:10:58.818339 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=32 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:10:59.456278 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822bfac1-9674-4e94-9b06-191aeef331ed None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:10:59.458309 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-822bfac1-9674-4e94-9b06-191aeef331ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:10:59.534874 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822bfac1-9674-4e94-9b06-191aeef331ed None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:10:59.541791 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e88c97-10f5-4944-bfd6-426c0cfc9c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:10:59.542512 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e88c97-10f5-4944-bfd6-426c0cfc9c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:10:59.543028 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e88c97-10f5-4944-bfd6-426c0cfc9c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:10:59.543497 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e88c97-10f5-4944-bfd6-426c0cfc9c77 admin admin] PATH_INFO: `/v3/users/34f3f599bae64665af3b77c52f03ea3b` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:10:59.544892 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e88c97-10f5-4944-bfd6-426c0cfc9c77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34f3f599bae64665af3b77c52f03ea3b)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:10:59.546841 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e88c97-10f5-4944-bfd6-426c0cfc9c77 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:10:59.698437 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d4e88c97-10f5-4944-bfd6-426c0cfc9c77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34f3f599bae64665af3b77c52f03ea3b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:10:59.706544 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d4e88c97-10f5-4944-bfd6-426c0cfc9c77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34f3f599bae64665af3b77c52f03ea3b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:10:59.707341 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d4e88c97-10f5-4944-bfd6-426c0cfc9c77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34f3f599bae64665af3b77c52f03ea3b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:10:59.708027 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d4e88c97-10f5-4944-bfd6-426c0cfc9c77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34f3f599bae64665af3b77c52f03ea3b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:10:59.774818 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d4e88c97-10f5-4944-bfd6-426c0cfc9c77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34f3f599bae64665af3b77c52f03ea3b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:10:59.815592 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1183/2380] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:10:59 2022] DELETE /identity/v3/users/34f3f599bae64665af3b77c52f03ea3b => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:11:00.062508 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceb86e5-c747-4268-bc75-daf0bba6a0c0 service swift] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:11:00.073922 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceb86e5-c747-4268-bc75-daf0bba6a0c0 service swift] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:11:00.132412 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abcd857-bffb-4dc3-bc2c-4520063269f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:11:00.133288 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abcd857-bffb-4dc3-bc2c-4520063269f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:00.133570 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abcd857-bffb-4dc3-bc2c-4520063269f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:00.133892 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abcd857-bffb-4dc3-bc2c-4520063269f1 admin admin] PATH_INFO: `/v3/projects/21cdad1425d04178bfe8009ccf6c8137` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:00.135071 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abcd857-bffb-4dc3-bc2c-4520063269f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21cdad1425d04178bfe8009ccf6c8137)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:11:00.137018 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abcd857-bffb-4dc3-bc2c-4520063269f1 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:11:00.253645 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-9abcd857-bffb-4dc3-bc2c-4520063269f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21cdad1425d04178bfe8009ccf6c8137', 'request_id': 'req-9abcd857-bffb-4dc3-bc2c-4520063269f1'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:11:00.260391 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-9abcd857-bffb-4dc3-bc2c-4520063269f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21cdad1425d04178bfe8009ccf6c8137', 'request_id': 'req-9abcd857-bffb-4dc3-bc2c-4520063269f1'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:11:00.266014 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-9abcd857-bffb-4dc3-bc2c-4520063269f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21cdad1425d04178bfe8009ccf6c8137', 'request_id': 'req-9abcd857-bffb-4dc3-bc2c-4520063269f1'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:11:00.362802 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-9abcd857-bffb-4dc3-bc2c-4520063269f1 admin admin] The token cache is being invalidate because project 21cdad1425d04178bfe8009ccf6c8137 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:11:00.363026 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-9abcd857-bffb-4dc3-bc2c-4520063269f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:11:00.363654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-9abcd857-bffb-4dc3-bc2c-4520063269f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:11:00.365218 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1198/2381] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:11:00 2022] DELETE /identity/v3/projects/21cdad1425d04178bfe8009ccf6c8137 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:11:00.370045 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e88c97-10f5-4944-bfd6-426c0cfc9c77 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:11:00.371508 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d4e88c97-10f5-4944-bfd6-426c0cfc9c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:11:00.384609 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e88c97-10f5-4944-bfd6-426c0cfc9c77 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:11:00.449206 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b412c8-400a-4ccc-b0a5-a2ff742e241f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:11:00.450084 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b412c8-400a-4ccc-b0a5-a2ff742e241f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:00.450370 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b412c8-400a-4ccc-b0a5-a2ff742e241f admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:00.450667 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b412c8-400a-4ccc-b0a5-a2ff742e241f admin admin] PATH_INFO: `/v3/users/9e8a8a9f80f94391a4f3ebf13fd1abd3` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:00.452016 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b412c8-400a-4ccc-b0a5-a2ff742e241f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e8a8a9f80f94391a4f3ebf13fd1abd3)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:11:00.454032 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b412c8-400a-4ccc-b0a5-a2ff742e241f admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:11:00.476461 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:11:00.660224 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-49b412c8-400a-4ccc-b0a5-a2ff742e241f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e8a8a9f80f94391a4f3ebf13fd1abd3'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:11:00.668996 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-49b412c8-400a-4ccc-b0a5-a2ff742e241f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e8a8a9f80f94391a4f3ebf13fd1abd3'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:11:00.669798 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-49b412c8-400a-4ccc-b0a5-a2ff742e241f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e8a8a9f80f94391a4f3ebf13fd1abd3'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:11:00.670548 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-49b412c8-400a-4ccc-b0a5-a2ff742e241f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e8a8a9f80f94391a4f3ebf13fd1abd3'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:11:00.746476 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-49b412c8-400a-4ccc-b0a5-a2ff742e241f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e8a8a9f80f94391a4f3ebf13fd1abd3'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:11:00.765392 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1184/2382] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:11:00 2022] DELETE /identity/v3/users/9e8a8a9f80f94391a4f3ebf13fd1abd3 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:11:01.011515 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abcd857-bffb-4dc3-bc2c-4520063269f1 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:11:01.022033 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-9abcd857-bffb-4dc3-bc2c-4520063269f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:11:01.038106 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abcd857-bffb-4dc3-bc2c-4520063269f1 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:11:01.099260 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698cc26e-ec18-4fc3-9bf1-e212cb6817be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:11:01.100286 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698cc26e-ec18-4fc3-9bf1-e212cb6817be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:01.100627 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698cc26e-ec18-4fc3-9bf1-e212cb6817be admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:01.104493 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698cc26e-ec18-4fc3-9bf1-e212cb6817be admin admin] PATH_INFO: `/v3/projects/64666605a4e44f82bd981930ab8c3fc5` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:01.104493 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698cc26e-ec18-4fc3-9bf1-e212cb6817be admin admin] RBAC: Authorizing `identity:delete_project(project_id=64666605a4e44f82bd981930ab8c3fc5)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:11:01.104792 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698cc26e-ec18-4fc3-9bf1-e212cb6817be admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:11:01.263815 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:11:01.276909 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-698cc26e-ec18-4fc3-9bf1-e212cb6817be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64666605a4e44f82bd981930ab8c3fc5', 'request_id': 'req-698cc26e-ec18-4fc3-9bf1-e212cb6817be'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:11:01.283159 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-698cc26e-ec18-4fc3-9bf1-e212cb6817be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64666605a4e44f82bd981930ab8c3fc5', 'request_id': 'req-698cc26e-ec18-4fc3-9bf1-e212cb6817be'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:11:01.288688 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-698cc26e-ec18-4fc3-9bf1-e212cb6817be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64666605a4e44f82bd981930ab8c3fc5', 'request_id': 'req-698cc26e-ec18-4fc3-9bf1-e212cb6817be'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:11:01.391910 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-698cc26e-ec18-4fc3-9bf1-e212cb6817be admin admin] The token cache is being invalidate because project 64666605a4e44f82bd981930ab8c3fc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:11:01.392303 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-698cc26e-ec18-4fc3-9bf1-e212cb6817be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:11:01.392930 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-698cc26e-ec18-4fc3-9bf1-e212cb6817be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:11:01.394817 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1199/2383] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:11:01 2022] DELETE /identity/v3/projects/64666605a4e44f82bd981930ab8c3fc5 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:11:08.236317 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9237a-650a-450c-843e-5c16c02d7be3 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:08.236815 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9237a-650a-450c-843e-5c16c02d7be3 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:08.237002 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9237a-650a-450c-843e-5c16c02d7be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:08.258057 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-23f9237a-650a-450c-843e-5c16c02d7be3 None None] MFA Rules not processed for user `6b67d92f0f644bc0861995318d10441c`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:11:08.260887 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-23f9237a-650a-450c-843e-5c16c02d7be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:11:08.335732 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1185/2384] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:11:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:11:10.811081 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698cc26e-ec18-4fc3-9bf1-e212cb6817be admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:11:10.812524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-698cc26e-ec18-4fc3-9bf1-e212cb6817be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:11:10.869416 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698cc26e-ec18-4fc3-9bf1-e212cb6817be admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:11:10.873162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8817ff-0134-45fe-a7ba-255e6cd53c71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:11:10.873824 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8817ff-0134-45fe-a7ba-255e6cd53c71 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:10.874116 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8817ff-0134-45fe-a7ba-255e6cd53c71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:10.874402 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8817ff-0134-45fe-a7ba-255e6cd53c71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:10.876212 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-ec8817ff-0134-45fe-a7ba-255e6cd53c71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:11:10.948263 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8817ff-0134-45fe-a7ba-255e6cd53c71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:11:10.949743 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8817ff-0134-45fe-a7ba-255e6cd53c71 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:11:10.960206 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1200/2385] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:11:10 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:11:11.712963 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9237a-650a-450c-843e-5c16c02d7be3 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:11:11.714642 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-23f9237a-650a-450c-843e-5c16c02d7be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:11:11.785003 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9237a-650a-450c-843e-5c16c02d7be3 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:11:11.789851 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093389ac-6ae3-4167-b6fb-7e6efc2ab326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:11:11.790796 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093389ac-6ae3-4167-b6fb-7e6efc2ab326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:11.791059 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093389ac-6ae3-4167-b6fb-7e6efc2ab326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:11.791338 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093389ac-6ae3-4167-b6fb-7e6efc2ab326 admin admin] PATH_INFO: `/v3/users/33bd343c753f41a484faf64d17c133df` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:11.792736 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093389ac-6ae3-4167-b6fb-7e6efc2ab326 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33bd343c753f41a484faf64d17c133df)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:11:11.794796 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093389ac-6ae3-4167-b6fb-7e6efc2ab326 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:11:11.986893 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:11:11.988477 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-093389ac-6ae3-4167-b6fb-7e6efc2ab326 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33bd343c753f41a484faf64d17c133df'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:11:11.995845 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-093389ac-6ae3-4167-b6fb-7e6efc2ab326 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33bd343c753f41a484faf64d17c133df'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:11:11.996548 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-093389ac-6ae3-4167-b6fb-7e6efc2ab326 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33bd343c753f41a484faf64d17c133df'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:11:11.997184 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-093389ac-6ae3-4167-b6fb-7e6efc2ab326 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33bd343c753f41a484faf64d17c133df'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:11:12.083124 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-093389ac-6ae3-4167-b6fb-7e6efc2ab326 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33bd343c753f41a484faf64d17c133df'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:11:12.101799 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1186/2386] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:11:11 2022] DELETE /identity/v3/users/33bd343c753f41a484faf64d17c133df => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:11:12.107229 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064dbf0a-6c6e-464d-9f0b-9160b8221445 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:12.107705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064dbf0a-6c6e-464d-9f0b-9160b8221445 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:12.107875 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064dbf0a-6c6e-464d-9f0b-9160b8221445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:12.126732 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-064dbf0a-6c6e-464d-9f0b-9160b8221445 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:11:12.132762 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-064dbf0a-6c6e-464d-9f0b-9160b8221445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:11:12.198242 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1201/2387] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:11:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:11:12.207892 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093389ac-6ae3-4167-b6fb-7e6efc2ab326 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:11:12.209368 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-093389ac-6ae3-4167-b6fb-7e6efc2ab326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:11:12.270036 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093389ac-6ae3-4167-b6fb-7e6efc2ab326 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:11:12.273721 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5aa3f5-2b3e-4809-8278-5216a50de034 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:11:12.274376 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5aa3f5-2b3e-4809-8278-5216a50de034 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:12.274664 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5aa3f5-2b3e-4809-8278-5216a50de034 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:12.274943 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5aa3f5-2b3e-4809-8278-5216a50de034 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:12.286432 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5aa3f5-2b3e-4809-8278-5216a50de034 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:11:12.287818 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5aa3f5-2b3e-4809-8278-5216a50de034 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:11:12.299123 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1187/2388] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:11:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:11:12.393407 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064dbf0a-6c6e-464d-9f0b-9160b8221445 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:11:12.395357 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-064dbf0a-6c6e-464d-9f0b-9160b8221445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:11:12.407567 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064dbf0a-6c6e-464d-9f0b-9160b8221445 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:11:12.411277 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9a1da-8dcd-42cd-a563-1f7c5e4f5024 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:11:12.411933 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9a1da-8dcd-42cd-a563-1f7c5e4f5024 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:12.412247 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9a1da-8dcd-42cd-a563-1f7c5e4f5024 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:12.412528 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9a1da-8dcd-42cd-a563-1f7c5e4f5024 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:12.414360 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-04a9a1da-8dcd-42cd-a563-1f7c5e4f5024 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:11:12.423773 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:11:12.486537 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a9a1da-8dcd-42cd-a563-1f7c5e4f5024 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:11:12.488006 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a9a1da-8dcd-42cd-a563-1f7c5e4f5024 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:11:12.500282 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1202/2389] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:11:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:11:13.227829 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5aa3f5-2b3e-4809-8278-5216a50de034 service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:11:13.231046 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-3d5aa3f5-2b3e-4809-8278-5216a50de034 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:11:13.254219 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5aa3f5-2b3e-4809-8278-5216a50de034 service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:11:13.299957 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6fa367-03c0-40f0-96e4-896fac5594e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:11:13.301195 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fa367-03c0-40f0-96e4-896fac5594e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:13.301673 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fa367-03c0-40f0-96e4-896fac5594e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:13.302139 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fa367-03c0-40f0-96e4-896fac5594e6 admin admin] PATH_INFO: `/v3/projects/4bb9d5dd24e64522885c162514f4d5f6` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:13.305253 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6fa367-03c0-40f0-96e4-896fac5594e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bb9d5dd24e64522885c162514f4d5f6)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:11:13.309472 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6fa367-03c0-40f0-96e4-896fac5594e6 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:11:13.482062 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-3d6fa367-03c0-40f0-96e4-896fac5594e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bb9d5dd24e64522885c162514f4d5f6', 'request_id': 'req-3d6fa367-03c0-40f0-96e4-896fac5594e6'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:11:13.496723 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-3d6fa367-03c0-40f0-96e4-896fac5594e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bb9d5dd24e64522885c162514f4d5f6', 'request_id': 'req-3d6fa367-03c0-40f0-96e4-896fac5594e6'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:11:13.507719 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-3d6fa367-03c0-40f0-96e4-896fac5594e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bb9d5dd24e64522885c162514f4d5f6', 'request_id': 'req-3d6fa367-03c0-40f0-96e4-896fac5594e6'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:11:13.610095 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-3d6fa367-03c0-40f0-96e4-896fac5594e6 admin admin] The token cache is being invalidate because project 4bb9d5dd24e64522885c162514f4d5f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:11:13.610352 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-3d6fa367-03c0-40f0-96e4-896fac5594e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:11:13.612324 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-3d6fa367-03c0-40f0-96e4-896fac5594e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:11:13.621006 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1188/2390] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:11:13 2022] DELETE /identity/v3/projects/4bb9d5dd24e64522885c162514f4d5f6 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:11:13.843466 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9a1da-8dcd-42cd-a563-1f7c5e4f5024 service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:11:13.853859 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9a1da-8dcd-42cd-a563-1f7c5e4f5024 service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:11:13.931989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9bf1f8-2798-47c6-beeb-8ad9f86cea3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:11:13.932865 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9bf1f8-2798-47c6-beeb-8ad9f86cea3b service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:13.933236 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9bf1f8-2798-47c6-beeb-8ad9f86cea3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:13.933802 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9bf1f8-2798-47c6-beeb-8ad9f86cea3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:13.935775 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-df9bf1f8-2798-47c6-beeb-8ad9f86cea3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:11:14.042294 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9bf1f8-2798-47c6-beeb-8ad9f86cea3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:11:14.044831 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9bf1f8-2798-47c6-beeb-8ad9f86cea3b service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:11:14.064950 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1203/2391] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:11:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:11:22.550545 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6fa367-03c0-40f0-96e4-896fac5594e6 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:11:22.551923 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-3d6fa367-03c0-40f0-96e4-896fac5594e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:11:22.564822 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6fa367-03c0-40f0-96e4-896fac5594e6 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:11:22.568371 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebc6c2-88f8-44bf-adf3-f127671aa2aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:11:22.569017 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebc6c2-88f8-44bf-adf3-f127671aa2aa service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:22.569303 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebc6c2-88f8-44bf-adf3-f127671aa2aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:22.569588 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebc6c2-88f8-44bf-adf3-f127671aa2aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:22.571317 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-21ebc6c2-88f8-44bf-adf3-f127671aa2aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:11:22.616238 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:11:22.633837 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ebc6c2-88f8-44bf-adf3-f127671aa2aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:11:22.635278 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ebc6c2-88f8-44bf-adf3-f127671aa2aa service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:11:22.645699 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1189/2392] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:11:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:11:24.055696 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=83 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:11:24.874236 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9bf1f8-2798-47c6-beeb-8ad9f86cea3b service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:11:24.876193 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-df9bf1f8-2798-47c6-beeb-8ad9f86cea3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:11:24.959934 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9bf1f8-2798-47c6-beeb-8ad9f86cea3b service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:11:24.965784 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296d1b5-8284-431d-9153-f5d23fadcefd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:11:24.966490 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296d1b5-8284-431d-9153-f5d23fadcefd service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:24.966775 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296d1b5-8284-431d-9153-f5d23fadcefd service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:24.967055 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296d1b5-8284-431d-9153-f5d23fadcefd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:24.969031 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-1296d1b5-8284-431d-9153-f5d23fadcefd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:11:25.027468 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebc6c2-88f8-44bf-adf3-f127671aa2aa service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:11:25.027468 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-21ebc6c2-88f8-44bf-adf3-f127671aa2aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:11:25.044341 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebc6c2-88f8-44bf-adf3-f127671aa2aa service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:11:25.048357 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e1d2a-557e-4d5f-b274-7348d348847d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:11:25.049201 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e1d2a-557e-4d5f-b274-7348d348847d service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:25.049683 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e1d2a-557e-4d5f-b274-7348d348847d service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:25.056090 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e1d2a-557e-4d5f-b274-7348d348847d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:25.060099 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1296d1b5-8284-431d-9153-f5d23fadcefd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:11:25.061639 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1296d1b5-8284-431d-9153-f5d23fadcefd service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:11:25.061909 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3e1d2a-557e-4d5f-b274-7348d348847d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:11:25.063439 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3e1d2a-557e-4d5f-b274-7348d348847d service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:11:25.072252 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1204/2393] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:11:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:11:25.078297 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1190/2394] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:11:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:11:26.564252 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296d1b5-8284-431d-9153-f5d23fadcefd service cinder] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:11:26.565662 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-1296d1b5-8284-431d-9153-f5d23fadcefd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:11:26.645517 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296d1b5-8284-431d-9153-f5d23fadcefd service cinder] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:11:26.650509 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9afe229-2fe7-450f-b143-7e8bad1246fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '177a912380ad43b6a5e31b787a07ce7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:11:26.653687 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afe229-2fe7-450f-b143-7e8bad1246fa service placement] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:26.653687 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afe229-2fe7-450f-b143-7e8bad1246fa service placement] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:26.653687 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afe229-2fe7-450f-b143-7e8bad1246fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:26.657787 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a9afe229-2fe7-450f-b143-7e8bad1246fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:11:26.669992 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9afe229-2fe7-450f-b143-7e8bad1246fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:11:26.671596 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9afe229-2fe7-450f-b143-7e8bad1246fa service placement] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:11:26.681579 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1205/2395] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:11:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:11:26.723829 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e1d2a-557e-4d5f-b274-7348d348847d service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:11:26.725328 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-aa3e1d2a-557e-4d5f-b274-7348d348847d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:11:26.739656 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e1d2a-557e-4d5f-b274-7348d348847d service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:11:26.744287 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db098a9c-20df-416b-9ab9-b5f686e7146d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:11:26.745911 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db098a9c-20df-416b-9ab9-b5f686e7146d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:26.746203 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db098a9c-20df-416b-9ab9-b5f686e7146d admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:26.746484 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db098a9c-20df-416b-9ab9-b5f686e7146d admin admin] PATH_INFO: `/v3/users/01541b7e5e984884bf87ef6d31b9480c` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:26.747686 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db098a9c-20df-416b-9ab9-b5f686e7146d admin admin] RBAC: Authorizing `identity:delete_user(user_id=01541b7e5e984884bf87ef6d31b9480c)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:11:26.749650 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db098a9c-20df-416b-9ab9-b5f686e7146d admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:11:26.880574 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-db098a9c-20df-416b-9ab9-b5f686e7146d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01541b7e5e984884bf87ef6d31b9480c'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:11:26.889407 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-db098a9c-20df-416b-9ab9-b5f686e7146d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01541b7e5e984884bf87ef6d31b9480c'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:11:26.890096 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-db098a9c-20df-416b-9ab9-b5f686e7146d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01541b7e5e984884bf87ef6d31b9480c'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:11:26.890694 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-db098a9c-20df-416b-9ab9-b5f686e7146d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01541b7e5e984884bf87ef6d31b9480c'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:11:26.974807 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-db098a9c-20df-416b-9ab9-b5f686e7146d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01541b7e5e984884bf87ef6d31b9480c'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:11:26.994533 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1191/2396] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:11:26 2022] DELETE /identity/v3/users/01541b7e5e984884bf87ef6d31b9480c => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:11:27.308865 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9afe229-2fe7-450f-b143-7e8bad1246fa service placement] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:11:27.321818 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9afe229-2fe7-450f-b143-7e8bad1246fa service placement] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:11:27.377645 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:11:27.393192 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9edf24-ad34-4a26-9f6c-ec303bdc7ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:11:27.394106 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9edf24-ad34-4a26-9f6c-ec303bdc7ccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:27.395250 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9edf24-ad34-4a26-9f6c-ec303bdc7ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:27.395544 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9edf24-ad34-4a26-9f6c-ec303bdc7ccb admin admin] PATH_INFO: `/v3/projects/79eb7f97891749029266ad3b96d75866` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:27.396817 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9edf24-ad34-4a26-9f6c-ec303bdc7ccb admin admin] RBAC: Authorizing `identity:delete_project(project_id=79eb7f97891749029266ad3b96d75866)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:11:27.398744 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9edf24-ad34-4a26-9f6c-ec303bdc7ccb admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:11:27.499032 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3b9edf24-ad34-4a26-9f6c-ec303bdc7ccb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79eb7f97891749029266ad3b96d75866', 'request_id': 'req-3b9edf24-ad34-4a26-9f6c-ec303bdc7ccb'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:11:27.506676 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3b9edf24-ad34-4a26-9f6c-ec303bdc7ccb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79eb7f97891749029266ad3b96d75866', 'request_id': 'req-3b9edf24-ad34-4a26-9f6c-ec303bdc7ccb'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:11:27.514218 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3b9edf24-ad34-4a26-9f6c-ec303bdc7ccb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79eb7f97891749029266ad3b96d75866', 'request_id': 'req-3b9edf24-ad34-4a26-9f6c-ec303bdc7ccb'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:11:27.585238 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3b9edf24-ad34-4a26-9f6c-ec303bdc7ccb admin admin] The token cache is being invalidate because project 79eb7f97891749029266ad3b96d75866 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:11:27.585951 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3b9edf24-ad34-4a26-9f6c-ec303bdc7ccb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:11:27.586504 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3b9edf24-ad34-4a26-9f6c-ec303bdc7ccb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:11:27.588452 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1206/2397] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:11:27 2022] DELETE /identity/v3/projects/79eb7f97891749029266ad3b96d75866 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:11:27.593733 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7fafa9-ae9c-4749-9188-c42022e5e851 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:27.594035 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7fafa9-ae9c-4749-9188-c42022e5e851 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:27.594318 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7fafa9-ae9c-4749-9188-c42022e5e851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:27.612602 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-6a7fafa9-ae9c-4749-9188-c42022e5e851 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:11:27.614047 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-6a7fafa9-ae9c-4749-9188-c42022e5e851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:11:27.688479 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1192/2398] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:11:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:11:27.696067 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b70c0-c3eb-46db-a966-6492f4dbc77a None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:27.696364 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b70c0-c3eb-46db-a966-6492f4dbc77a None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:27.696651 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b70c0-c3eb-46db-a966-6492f4dbc77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:27.716208 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-b57b70c0-c3eb-46db-a966-6492f4dbc77a None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:11:27.717421 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-b57b70c0-c3eb-46db-a966-6492f4dbc77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:11:27.725708 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1207/2399] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:11:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:11:27.730055 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7fafa9-ae9c-4749-9188-c42022e5e851 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:11:27.745136 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7fafa9-ae9c-4749-9188-c42022e5e851 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:11:27.749528 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11167e1f-1d98-40ac-90dd-ebba0f315623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:11:27.750213 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11167e1f-1d98-40ac-90dd-ebba0f315623 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:27.750534 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11167e1f-1d98-40ac-90dd-ebba0f315623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:27.750824 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11167e1f-1d98-40ac-90dd-ebba0f315623 admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:27.751524 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11167e1f-1d98-40ac-90dd-ebba0f315623 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:11:27.751838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11167e1f-1d98-40ac-90dd-ebba0f315623 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:11:27.753478 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11167e1f-1d98-40ac-90dd-ebba0f315623 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:11:27.766170 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1193/2400] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 21:11:27.771077 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b70c0-c3eb-46db-a966-6492f4dbc77a None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:11:27.781580 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b70c0-c3eb-46db-a966-6492f4dbc77a None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:11:27.786326 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a9336-1072-41fc-a6f8-39cbe8370090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:11:27.787003 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a9336-1072-41fc-a6f8-39cbe8370090 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:27.787296 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a9336-1072-41fc-a6f8-39cbe8370090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:27.787581 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a9336-1072-41fc-a6f8-39cbe8370090 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:27.788389 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a9336-1072-41fc-a6f8-39cbe8370090 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:11:27.790282 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a9336-1072-41fc-a6f8-39cbe8370090 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:11:27.897344 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1208/2401] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:11:27 2022] POST /identity/v3/projects => generated 389 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:11:27.901322 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11167e1f-1d98-40ac-90dd-ebba0f315623 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:11:27.911703 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11167e1f-1d98-40ac-90dd-ebba0f315623 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:11:27.939432 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:11:27.978353 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34c64e-7a4d-4ea9-a631-3c586ca8d785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:11:27.979310 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34c64e-7a4d-4ea9-a631-3c586ca8d785 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:27.979688 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34c64e-7a4d-4ea9-a631-3c586ca8d785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:27.980174 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34c64e-7a4d-4ea9-a631-3c586ca8d785 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:27.981802 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d34c64e-7a4d-4ea9-a631-3c586ca8d785 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:11:27.983988 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d34c64e-7a4d-4ea9-a631-3c586ca8d785 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:11:28.078286 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1194/2402] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:11:27 2022] POST /identity/v3/users => generated 295 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 21:11:28.082380 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a9336-1072-41fc-a6f8-39cbe8370090 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:11:28.093202 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a9336-1072-41fc-a6f8-39cbe8370090 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:11:28.097974 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd4905-7a52-40ca-bcbf-2e19ac12bd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:11:28.100944 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd4905-7a52-40ca-bcbf-2e19ac12bd9b admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:28.100944 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd4905-7a52-40ca-bcbf-2e19ac12bd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:28.100944 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd4905-7a52-40ca-bcbf-2e19ac12bd9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:28.100944 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd4905-7a52-40ca-bcbf-2e19ac12bd9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:11:28.101559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd4905-7a52-40ca-bcbf-2e19ac12bd9b admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:11:28.113403 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1209/2403] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:11:28.117535 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34c64e-7a4d-4ea9-a631-3c586ca8d785 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:11:28.128403 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34c64e-7a4d-4ea9-a631-3c586ca8d785 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:11:28.133939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a557f-afc3-4a80-8be9-e4de58b07007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:11:28.134611 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a557f-afc3-4a80-8be9-e4de58b07007 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:28.134901 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a557f-afc3-4a80-8be9-e4de58b07007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:28.135183 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a557f-afc3-4a80-8be9-e4de58b07007 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:28.135910 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a557f-afc3-4a80-8be9-e4de58b07007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:11:28.137993 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a557f-afc3-4a80-8be9-e4de58b07007 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:11:28.149088 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1195/2404] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:11:28.153479 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd4905-7a52-40ca-bcbf-2e19ac12bd9b admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:11:28.165196 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd4905-7a52-40ca-bcbf-2e19ac12bd9b admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:11:28.171840 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca08134-1be2-4134-843e-f7600e2ee534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:11:28.175575 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca08134-1be2-4134-843e-f7600e2ee534 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:28.175900 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca08134-1be2-4134-843e-f7600e2ee534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:28.176210 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca08134-1be2-4134-843e-f7600e2ee534 admin admin] PATH_INFO: `/v3/projects/e21816ca02bb4663af970879e4d1044e/users/12a5d06d3eeb4dde9bd96df742dc719c/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:28.195873 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca08134-1be2-4134-843e-f7600e2ee534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e21816ca02bb4663af970879e4d1044e, user_id=12a5d06d3eeb4dde9bd96df742dc719c, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:11:28.198750 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca08134-1be2-4134-843e-f7600e2ee534 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:11:28.298626 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1210/2405] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:11:28 2022] PUT /identity/v3/projects/e21816ca02bb4663af970879e4d1044e/users/12a5d06d3eeb4dde9bd96df742dc719c/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:11:28.302210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069d63a-0b48-41eb-bbe2-e5e515ddf6a9 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:28.302514 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069d63a-0b48-41eb-bbe2-e5e515ddf6a9 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:28.302801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069d63a-0b48-41eb-bbe2-e5e515ddf6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:28.324508 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-1069d63a-0b48-41eb-bbe2-e5e515ddf6a9 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:11:28.325915 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-1069d63a-0b48-41eb-bbe2-e5e515ddf6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:11:28.404868 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1196/2406] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:11:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:11:28.414723 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca08134-1be2-4134-843e-f7600e2ee534 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:11:28.420838 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-4ca08134-1be2-4134-843e-f7600e2ee534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:11:28.480207 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca08134-1be2-4134-843e-f7600e2ee534 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:11:28.485124 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853b53a-3e64-4e7b-98e1-0436ef88cefe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:11:28.486004 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853b53a-3e64-4e7b-98e1-0436ef88cefe service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:28.486301 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853b53a-3e64-4e7b-98e1-0436ef88cefe service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:28.486587 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853b53a-3e64-4e7b-98e1-0436ef88cefe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:28.498133 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853b53a-3e64-4e7b-98e1-0436ef88cefe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:11:28.499765 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853b53a-3e64-4e7b-98e1-0436ef88cefe service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:11:28.510950 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1211/2407] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:11:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:11:33.858355 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9489756-2a84-4273-a332-b9639f2c44be None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:33.858784 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9489756-2a84-4273-a332-b9639f2c44be None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:33.858864 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9489756-2a84-4273-a332-b9639f2c44be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:33.889226 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-e9489756-2a84-4273-a332-b9639f2c44be None None] MFA Rules not processed for user `12a5d06d3eeb4dde9bd96df742dc719c`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:11:33.890476 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-e9489756-2a84-4273-a332-b9639f2c44be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:11:33.968728 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1197/2408] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:11:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:11:33.983535 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853b53a-3e64-4e7b-98e1-0436ef88cefe service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:11:33.985196 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-9853b53a-3e64-4e7b-98e1-0436ef88cefe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:11:34.000985 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:11:34.068704 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853b53a-3e64-4e7b-98e1-0436ef88cefe service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:11:34.072833 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246167ac-832f-4a4c-b66f-ef8939415e9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:11:34.073526 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246167ac-832f-4a4c-b66f-ef8939415e9f service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:34.073817 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246167ac-832f-4a4c-b66f-ef8939415e9f service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:34.074250 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246167ac-832f-4a4c-b66f-ef8939415e9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:34.085670 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246167ac-832f-4a4c-b66f-ef8939415e9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:11:34.087345 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246167ac-832f-4a4c-b66f-ef8939415e9f service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:11:34.102411 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1212/2409] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:11:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:11:36.549859 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a189ab0-fe18-4f79-84df-911c2e0bd75e None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:36.550526 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a189ab0-fe18-4f79-84df-911c2e0bd75e None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:36.550526 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a189ab0-fe18-4f79-84df-911c2e0bd75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:36.577559 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-6a189ab0-fe18-4f79-84df-911c2e0bd75e None None] MFA Rules not processed for user `12a5d06d3eeb4dde9bd96df742dc719c`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:11:36.579126 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-6a189ab0-fe18-4f79-84df-911c2e0bd75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:11:36.587419 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1198/2410] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:11:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:11:36.960597 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246167ac-832f-4a4c-b66f-ef8939415e9f service nova] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:11:36.962735 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-246167ac-832f-4a4c-b66f-ef8939415e9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:11:36.975486 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246167ac-832f-4a4c-b66f-ef8939415e9f service nova] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:11:36.979346 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b11b68f-31fd-45e3-8b81-e2cb6f2345ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:11:36.980858 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11b68f-31fd-45e3-8b81-e2cb6f2345ec service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:36.981361 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11b68f-31fd-45e3-8b81-e2cb6f2345ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:36.982004 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11b68f-31fd-45e3-8b81-e2cb6f2345ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:36.983913 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-1b11b68f-31fd-45e3-8b81-e2cb6f2345ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:11:36.997390 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b11b68f-31fd-45e3-8b81-e2cb6f2345ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:11:36.998877 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b11b68f-31fd-45e3-8b81-e2cb6f2345ec service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:11:37.010471 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1213/2411] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:11:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:11:37.420645 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a189ab0-fe18-4f79-84df-911c2e0bd75e None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:11:37.422125 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-6a189ab0-fe18-4f79-84df-911c2e0bd75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:11:37.465129 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:11:37.515065 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a189ab0-fe18-4f79-84df-911c2e0bd75e None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:11:37.520319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b89a7-3400-43ae-a748-fdd6bb79644d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '177a912380ad43b6a5e31b787a07ce7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:11:37.521005 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b89a7-3400-43ae-a748-fdd6bb79644d service placement] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:37.521294 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b89a7-3400-43ae-a748-fdd6bb79644d service placement] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:37.521576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b89a7-3400-43ae-a748-fdd6bb79644d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:37.523334 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-0c5b89a7-3400-43ae-a748-fdd6bb79644d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:11:37.536520 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b89a7-3400-43ae-a748-fdd6bb79644d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:11:37.538123 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b89a7-3400-43ae-a748-fdd6bb79644d service placement] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:11:37.550139 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1199/2412] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:11:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:11:40.764976 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b11b68f-31fd-45e3-8b81-e2cb6f2345ec service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:11:40.775224 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b11b68f-31fd-45e3-8b81-e2cb6f2345ec service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:11:40.779432 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70f6dd-68f4-4066-83e9-13a5aac34651 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:11:40.780161 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70f6dd-68f4-4066-83e9-13a5aac34651 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:40.780528 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70f6dd-68f4-4066-83e9-13a5aac34651 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:40.780821 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70f6dd-68f4-4066-83e9-13a5aac34651 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:40.782921 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-aa70f6dd-68f4-4066-83e9-13a5aac34651 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:11:40.794382 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa70f6dd-68f4-4066-83e9-13a5aac34651 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:11:40.796001 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa70f6dd-68f4-4066-83e9-13a5aac34651 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:11:40.806649 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1214/2413] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:11:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 21:11:46.152542 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b89a7-3400-43ae-a748-fdd6bb79644d service placement] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:11:46.162387 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b89a7-3400-43ae-a748-fdd6bb79644d service placement] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:11:46.165905 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc501d-76dc-49d4-aa40-ea041b2adba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:11:46.166916 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc501d-76dc-49d4-aa40-ea041b2adba2 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:46.166916 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc501d-76dc-49d4-aa40-ea041b2adba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:46.167134 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc501d-76dc-49d4-aa40-ea041b2adba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:46.169453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c3fc501d-76dc-49d4-aa40-ea041b2adba2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:11:46.181298 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc501d-76dc-49d4-aa40-ea041b2adba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:11:46.182908 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc501d-76dc-49d4-aa40-ea041b2adba2 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:11:46.192682 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1200/2414] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:11:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:11:49.632374 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70f6dd-68f4-4066-83e9-13a5aac34651 service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:11:49.633934 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-aa70f6dd-68f4-4066-83e9-13a5aac34651 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:11:49.650151 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70f6dd-68f4-4066-83e9-13a5aac34651 service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:11:49.656950 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a10aaf-7893-4f48-a278-1196ffbbe66d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '177a912380ad43b6a5e31b787a07ce7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:11:49.658332 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a10aaf-7893-4f48-a278-1196ffbbe66d service placement] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:49.658332 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a10aaf-7893-4f48-a278-1196ffbbe66d service placement] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:49.658332 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a10aaf-7893-4f48-a278-1196ffbbe66d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:49.660063 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-c4a10aaf-7893-4f48-a278-1196ffbbe66d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:11:49.673579 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a10aaf-7893-4f48-a278-1196ffbbe66d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:11:49.675121 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a10aaf-7893-4f48-a278-1196ffbbe66d service placement] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:11:49.686755 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1215/2415] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:11:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:11:49.763929 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc501d-76dc-49d4-aa40-ea041b2adba2 service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:11:49.765611 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c3fc501d-76dc-49d4-aa40-ea041b2adba2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:11:49.780146 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc501d-76dc-49d4-aa40-ea041b2adba2 service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:11:49.784855 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cfe901-ae22-4cc3-b3e1-813d163a269f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:11:49.785920 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cfe901-ae22-4cc3-b3e1-813d163a269f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:49.786241 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cfe901-ae22-4cc3-b3e1-813d163a269f admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:49.786524 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cfe901-ae22-4cc3-b3e1-813d163a269f admin admin] PATH_INFO: `/v3/users/1c19d61152474a0bb1e373a9ce0310bc` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:49.788108 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cfe901-ae22-4cc3-b3e1-813d163a269f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c19d61152474a0bb1e373a9ce0310bc)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:11:49.790167 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cfe901-ae22-4cc3-b3e1-813d163a269f admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:11:49.952550 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e0cfe901-ae22-4cc3-b3e1-813d163a269f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c19d61152474a0bb1e373a9ce0310bc'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:11:49.959280 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e0cfe901-ae22-4cc3-b3e1-813d163a269f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c19d61152474a0bb1e373a9ce0310bc'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:11:49.959986 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e0cfe901-ae22-4cc3-b3e1-813d163a269f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c19d61152474a0bb1e373a9ce0310bc'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:11:49.960606 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e0cfe901-ae22-4cc3-b3e1-813d163a269f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c19d61152474a0bb1e373a9ce0310bc'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:11:50.018468 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e0cfe901-ae22-4cc3-b3e1-813d163a269f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c19d61152474a0bb1e373a9ce0310bc'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:11:50.036799 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1201/2416] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:11:49 2022] DELETE /identity/v3/users/1c19d61152474a0bb1e373a9ce0310bc => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:11:50.272481 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a10aaf-7893-4f48-a278-1196ffbbe66d service placement] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:11:50.285214 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a10aaf-7893-4f48-a278-1196ffbbe66d service placement] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:11:50.348380 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1187a8-00bc-432d-b646-a2ee5e736d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:11:50.349252 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1187a8-00bc-432d-b646-a2ee5e736d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:50.349544 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1187a8-00bc-432d-b646-a2ee5e736d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:50.349830 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1187a8-00bc-432d-b646-a2ee5e736d6d admin admin] PATH_INFO: `/v3/projects/0d64562344e44802a06d533da2c765fd` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:50.351019 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1187a8-00bc-432d-b646-a2ee5e736d6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d64562344e44802a06d533da2c765fd)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:11:50.352981 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1187a8-00bc-432d-b646-a2ee5e736d6d admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:11:50.483374 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-dc1187a8-00bc-432d-b646-a2ee5e736d6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d64562344e44802a06d533da2c765fd', 'request_id': 'req-dc1187a8-00bc-432d-b646-a2ee5e736d6d'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:11:50.491314 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-dc1187a8-00bc-432d-b646-a2ee5e736d6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d64562344e44802a06d533da2c765fd', 'request_id': 'req-dc1187a8-00bc-432d-b646-a2ee5e736d6d'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:11:50.496179 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:11:50.502000 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-dc1187a8-00bc-432d-b646-a2ee5e736d6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d64562344e44802a06d533da2c765fd', 'request_id': 'req-dc1187a8-00bc-432d-b646-a2ee5e736d6d'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:11:50.602728 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-dc1187a8-00bc-432d-b646-a2ee5e736d6d admin admin] The token cache is being invalidate because project 0d64562344e44802a06d533da2c765fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:11:50.603399 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-dc1187a8-00bc-432d-b646-a2ee5e736d6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:11:50.604565 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-dc1187a8-00bc-432d-b646-a2ee5e736d6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:11:50.606541 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1216/2417] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:11:50 2022] DELETE /identity/v3/projects/0d64562344e44802a06d533da2c765fd => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:11:50.612137 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fd606-8665-4891-9d0a-bc3601a39f7f None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:50.612137 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fd606-8665-4891-9d0a-bc3601a39f7f None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:50.612137 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fd606-8665-4891-9d0a-bc3601a39f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:50.630695 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-545fd606-8665-4891-9d0a-bc3601a39f7f None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:11:50.631982 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-545fd606-8665-4891-9d0a-bc3601a39f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:11:50.701728 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1202/2418] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:11:50.710439 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780c96f-c580-4f4e-8925-84dfc7c6d10d None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:50.711004 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780c96f-c580-4f4e-8925-84dfc7c6d10d None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:50.711249 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780c96f-c580-4f4e-8925-84dfc7c6d10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:50.731009 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-1780c96f-c580-4f4e-8925-84dfc7c6d10d None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:11:50.732401 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-1780c96f-c580-4f4e-8925-84dfc7c6d10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:11:50.740540 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1217/2419] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:11:50.744913 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fd606-8665-4891-9d0a-bc3601a39f7f None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:11:50.755450 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fd606-8665-4891-9d0a-bc3601a39f7f None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:11:50.760058 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e706d32-1e70-485f-abdd-5dca8e2fbb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:11:50.760754 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e706d32-1e70-485f-abdd-5dca8e2fbb32 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:50.761040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e706d32-1e70-485f-abdd-5dca8e2fbb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:50.761317 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e706d32-1e70-485f-abdd-5dca8e2fbb32 admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:50.762073 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e706d32-1e70-485f-abdd-5dca8e2fbb32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:11:50.762400 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e706d32-1e70-485f-abdd-5dca8e2fbb32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:11:50.764649 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e706d32-1e70-485f-abdd-5dca8e2fbb32 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:11:50.780491 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1203/2420] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:11:50.781729 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780c96f-c580-4f4e-8925-84dfc7c6d10d None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:11:50.791679 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780c96f-c580-4f4e-8925-84dfc7c6d10d None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:11:50.796649 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe377be-3f4a-4819-b291-14969ef2a583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:11:50.797460 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe377be-3f4a-4819-b291-14969ef2a583 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:50.797754 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe377be-3f4a-4819-b291-14969ef2a583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:50.798177 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe377be-3f4a-4819-b291-14969ef2a583 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:50.798886 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe377be-3f4a-4819-b291-14969ef2a583 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:11:50.800992 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe377be-3f4a-4819-b291-14969ef2a583 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:11:50.883148 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1218/2421] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:11:50 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:11:50.884405 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e706d32-1e70-485f-abdd-5dca8e2fbb32 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:11:50.898187 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e706d32-1e70-485f-abdd-5dca8e2fbb32 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:11:50.905557 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:11:50.968684 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ada3f9-eda6-4d42-8cf3-beffc04fa4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:11:50.969384 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ada3f9-eda6-4d42-8cf3-beffc04fa4d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:50.969677 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ada3f9-eda6-4d42-8cf3-beffc04fa4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:50.969962 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ada3f9-eda6-4d42-8cf3-beffc04fa4d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:50.970669 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ada3f9-eda6-4d42-8cf3-beffc04fa4d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:11:50.972638 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ada3f9-eda6-4d42-8cf3-beffc04fa4d7 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:11:51.081362 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1204/2422] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:11:50 2022] POST /identity/v3/users => generated 287 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:11:51.082630 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe377be-3f4a-4819-b291-14969ef2a583 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:11:51.094635 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe377be-3f4a-4819-b291-14969ef2a583 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:11:51.099797 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9fc44-2d75-41ea-ad06-80bfdac6b2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:11:51.100553 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9fc44-2d75-41ea-ad06-80bfdac6b2b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:51.100846 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9fc44-2d75-41ea-ad06-80bfdac6b2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:51.101129 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9fc44-2d75-41ea-ad06-80bfdac6b2b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:51.101873 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9fc44-2d75-41ea-ad06-80bfdac6b2b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:11:51.103588 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9fc44-2d75-41ea-ad06-80bfdac6b2b3 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:11:51.116035 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1219/2423] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 21:11:51.121441 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ada3f9-eda6-4d42-8cf3-beffc04fa4d7 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:11:51.132394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ada3f9-eda6-4d42-8cf3-beffc04fa4d7 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:11:51.138034 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7669e48-84f1-41dd-98b7-72562dfa24af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:11:51.138861 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7669e48-84f1-41dd-98b7-72562dfa24af admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:51.139033 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7669e48-84f1-41dd-98b7-72562dfa24af admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:51.139313 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7669e48-84f1-41dd-98b7-72562dfa24af admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:51.140083 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7669e48-84f1-41dd-98b7-72562dfa24af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:11:51.141689 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7669e48-84f1-41dd-98b7-72562dfa24af admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:11:51.152963 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1205/2424] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:11:51.158138 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9fc44-2d75-41ea-ad06-80bfdac6b2b3 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:11:51.168836 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9fc44-2d75-41ea-ad06-80bfdac6b2b3 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:11:51.173342 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6fd87-0b6e-4797-8c71-c6ed0230c358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:11:51.174243 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6fd87-0b6e-4797-8c71-c6ed0230c358 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:51.174530 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6fd87-0b6e-4797-8c71-c6ed0230c358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:51.174808 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6fd87-0b6e-4797-8c71-c6ed0230c358 admin admin] PATH_INFO: `/v3/projects/061182d0b77f466799346898635630ac/users/333515b7b5e340f6b4fac30efa630a0e/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:51.196143 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6fd87-0b6e-4797-8c71-c6ed0230c358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=061182d0b77f466799346898635630ac, user_id=333515b7b5e340f6b4fac30efa630a0e, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:11:51.200966 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6fd87-0b6e-4797-8c71-c6ed0230c358 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:11:51.273064 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1220/2425] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:11:51 2022] PUT /identity/v3/projects/061182d0b77f466799346898635630ac/users/333515b7b5e340f6b4fac30efa630a0e/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:11:51.283816 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e321be-af2d-4222-8dc6-aa069d13e846 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:51.284150 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e321be-af2d-4222-8dc6-aa069d13e846 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:51.284439 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e321be-af2d-4222-8dc6-aa069d13e846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:51.318405 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-a9e321be-af2d-4222-8dc6-aa069d13e846 None None] MFA Rules not processed for user `333515b7b5e340f6b4fac30efa630a0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:11:51.320362 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-a9e321be-af2d-4222-8dc6-aa069d13e846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:11:51.406413 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6fd87-0b6e-4797-8c71-c6ed0230c358 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:11:51.406956 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1206/2426] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:11:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:11:51.474854 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6fd87-0b6e-4797-8c71-c6ed0230c358 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:11:51.480266 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd8bc4-642d-4e08-85eb-06374cecff97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:11:51.481018 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd8bc4-642d-4e08-85eb-06374cecff97 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:51.481407 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd8bc4-642d-4e08-85eb-06374cecff97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:51.481760 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd8bc4-642d-4e08-85eb-06374cecff97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:51.482865 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd8bc4-642d-4e08-85eb-06374cecff97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:11:51.484825 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd8bc4-642d-4e08-85eb-06374cecff97 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:11:51.565330 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1221/2427] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:11:51 2022] POST /identity/v3/projects => generated 373 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:11:51.569425 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e321be-af2d-4222-8dc6-aa069d13e846 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:11:51.581225 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e321be-af2d-4222-8dc6-aa069d13e846 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:11:51.642598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3332ed-1dba-48b5-b599-2bdbb0a643a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:11:51.643212 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3332ed-1dba-48b5-b599-2bdbb0a643a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:51.643496 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3332ed-1dba-48b5-b599-2bdbb0a643a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:51.643769 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3332ed-1dba-48b5-b599-2bdbb0a643a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:51.644499 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3332ed-1dba-48b5-b599-2bdbb0a643a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:11:51.646687 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3332ed-1dba-48b5-b599-2bdbb0a643a5 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:11:51.720798 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1207/2428] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:11:51 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:11:51.722693 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd8bc4-642d-4e08-85eb-06374cecff97 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:11:51.733980 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd8bc4-642d-4e08-85eb-06374cecff97 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:11:51.738607 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a62e6-54eb-47d8-a12c-2e7c9e78fe2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:11:51.739309 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a62e6-54eb-47d8-a12c-2e7c9e78fe2f admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:51.739596 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a62e6-54eb-47d8-a12c-2e7c9e78fe2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:51.739875 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a62e6-54eb-47d8-a12c-2e7c9e78fe2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:51.740636 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a62e6-54eb-47d8-a12c-2e7c9e78fe2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:11:51.742225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a62e6-54eb-47d8-a12c-2e7c9e78fe2f admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:11:51.753782 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1222/2429] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:11:51.757903 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3332ed-1dba-48b5-b599-2bdbb0a643a5 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:11:51.764945 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:11:51.769686 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3332ed-1dba-48b5-b599-2bdbb0a643a5 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:11:51.776483 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c0085-3870-467b-8670-c0598bff5cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:11:51.777402 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c0085-3870-467b-8670-c0598bff5cf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:51.777700 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c0085-3870-467b-8670-c0598bff5cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:51.778022 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c0085-3870-467b-8670-c0598bff5cf9 admin admin] PATH_INFO: `/v3/projects/bbb7e65f2f424bdb86654185fa12095a/users/8f42dafc9749459e8dc58ef56d6ae988/roles/86273ff072f3438d822e870272491768` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:51.796605 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c0085-3870-467b-8670-c0598bff5cf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbb7e65f2f424bdb86654185fa12095a, user_id=8f42dafc9749459e8dc58ef56d6ae988, role_id=86273ff072f3438d822e870272491768)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:11:51.799344 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c0085-3870-467b-8670-c0598bff5cf9 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:11:51.861801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1208/2430] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:11:51 2022] PUT /identity/v3/projects/bbb7e65f2f424bdb86654185fa12095a/users/8f42dafc9749459e8dc58ef56d6ae988/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:11:51.866044 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a62e6-54eb-47d8-a12c-2e7c9e78fe2f admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:11:51.876904 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a62e6-54eb-47d8-a12c-2e7c9e78fe2f admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:11:51.934150 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af854a97-9f55-40d9-901e-39f9937c01f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:11:51.935553 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af854a97-9f55-40d9-901e-39f9937c01f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:51.935923 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af854a97-9f55-40d9-901e-39f9937c01f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:51.940567 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af854a97-9f55-40d9-901e-39f9937c01f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:51.940567 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af854a97-9f55-40d9-901e-39f9937c01f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:11:51.940567 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af854a97-9f55-40d9-901e-39f9937c01f5 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:11:51.940567 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:11:51.949919 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1223/2431] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:11:51.954411 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c0085-3870-467b-8670-c0598bff5cf9 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:11:51.964905 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c0085-3870-467b-8670-c0598bff5cf9 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:11:51.969650 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f981f-d1bf-44fc-8339-1d629f77e828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:11:51.970542 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f981f-d1bf-44fc-8339-1d629f77e828 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:51.971116 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f981f-d1bf-44fc-8339-1d629f77e828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:51.971600 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f981f-d1bf-44fc-8339-1d629f77e828 admin admin] PATH_INFO: `/v3/projects/bbb7e65f2f424bdb86654185fa12095a/users/8f42dafc9749459e8dc58ef56d6ae988/roles/86273ff072f3438d822e870272491768` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:51.973980 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f981f-d1bf-44fc-8339-1d629f77e828 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbb7e65f2f424bdb86654185fa12095a, user_id=8f42dafc9749459e8dc58ef56d6ae988, role_id=86273ff072f3438d822e870272491768)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:11:51.976632 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f981f-d1bf-44fc-8339-1d629f77e828 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:11:51.987740 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1209/2432] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:11:51 2022] PUT /identity/v3/projects/bbb7e65f2f424bdb86654185fa12095a/users/8f42dafc9749459e8dc58ef56d6ae988/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:11:51.998802 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d75ae-8b9e-4645-aa8c-7fbb1769b7c2 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:51.999142 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d75ae-8b9e-4645-aa8c-7fbb1769b7c2 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:51.999386 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d75ae-8b9e-4645-aa8c-7fbb1769b7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:52.030831 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-b26d75ae-8b9e-4645-aa8c-7fbb1769b7c2 None None] MFA Rules not processed for user `8f42dafc9749459e8dc58ef56d6ae988`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:11:52.032147 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-b26d75ae-8b9e-4645-aa8c-7fbb1769b7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:11:52.051292 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f981f-d1bf-44fc-8339-1d629f77e828 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:11:52.055351 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-f14f981f-d1bf-44fc-8339-1d629f77e828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:11:52.113330 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1224/2433] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:11:51 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:11:52.125605 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d75ae-8b9e-4645-aa8c-7fbb1769b7c2 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:11:52.127025 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-b26d75ae-8b9e-4645-aa8c-7fbb1769b7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:11:52.150118 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f981f-d1bf-44fc-8339-1d629f77e828 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:11:52.157651 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155568ed-7f13-4e0a-8399-6f2edde2cb05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:11:52.158963 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155568ed-7f13-4e0a-8399-6f2edde2cb05 service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:52.159258 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155568ed-7f13-4e0a-8399-6f2edde2cb05 service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:52.159540 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155568ed-7f13-4e0a-8399-6f2edde2cb05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:52.162000 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-155568ed-7f13-4e0a-8399-6f2edde2cb05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:11:52.175609 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155568ed-7f13-4e0a-8399-6f2edde2cb05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:11:52.177416 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155568ed-7f13-4e0a-8399-6f2edde2cb05 service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:11:52.189713 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1210/2434] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:11:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 21:11:52.192566 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d75ae-8b9e-4645-aa8c-7fbb1769b7c2 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:11:52.196623 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85322e75-9e31-4873-b62a-6ff159555191 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:11:52.197389 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85322e75-9e31-4873-b62a-6ff159555191 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:52.197785 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85322e75-9e31-4873-b62a-6ff159555191 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:52.198172 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85322e75-9e31-4873-b62a-6ff159555191 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:52.213026 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85322e75-9e31-4873-b62a-6ff159555191 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:11:52.214482 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85322e75-9e31-4873-b62a-6ff159555191 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:11:52.227009 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1225/2435] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:11:52 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 21:11:52.392733 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155568ed-7f13-4e0a-8399-6f2edde2cb05 service nova] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:11:52.403913 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155568ed-7f13-4e0a-8399-6f2edde2cb05 service nova] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:11:52.407193 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d09e2-2970-42d6-9c54-b1419779d4d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:11:52.407848 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d09e2-2970-42d6-9c54-b1419779d4d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:11:52.408176 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d09e2-2970-42d6-9c54-b1419779d4d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:11:52.408458 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d09e2-2970-42d6-9c54-b1419779d4d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:11:52.473550 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d09e2-2970-42d6-9c54-b1419779d4d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:11:52.475053 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d09e2-2970-42d6-9c54-b1419779d4d6 service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:11:52.486593 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1211/2436] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:11:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 21:12:02.221020 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=62 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:12:02.480777 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=75,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:12:04.496777 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85322e75-9e31-4873-b62a-6ff159555191 service cinder] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:04.498163 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-85322e75-9e31-4873-b62a-6ff159555191 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:04.513998 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85322e75-9e31-4873-b62a-6ff159555191 service cinder] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:04.519841 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de244e-f694-403a-a8ee-1dbb4d660ecf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:04.520795 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de244e-f694-403a-a8ee-1dbb4d660ecf service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:04.530031 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de244e-f694-403a-a8ee-1dbb4d660ecf service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:04.530031 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de244e-f694-403a-a8ee-1dbb4d660ecf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:04.530031 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a7de244e-f694-403a-a8ee-1dbb4d660ecf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:04.580952 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de244e-f694-403a-a8ee-1dbb4d660ecf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:04.582472 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de244e-f694-403a-a8ee-1dbb4d660ecf service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:04.592339 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1226/2437] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:12:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:12:14.587357 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=28 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:12:20.793852 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d09e2-2970-42d6-9c54-b1419779d4d6 service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:20.795235 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-5d0d09e2-2970-42d6-9c54-b1419779d4d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:20.863438 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d09e2-2970-42d6-9c54-b1419779d4d6 service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:20.867089 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb5771-7d8a-4a5f-8063-72922814e9e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:20.867778 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb5771-7d8a-4a5f-8063-72922814e9e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:20.868116 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb5771-7d8a-4a5f-8063-72922814e9e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:20.873029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb5771-7d8a-4a5f-8063-72922814e9e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:20.873029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d2cb5771-7d8a-4a5f-8063-72922814e9e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:20.933166 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cb5771-7d8a-4a5f-8063-72922814e9e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:20.934602 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cb5771-7d8a-4a5f-8063-72922814e9e6 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:20.945281 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1212/2438] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:12:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:12:24.381332 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de244e-f694-403a-a8ee-1dbb4d660ecf service nova] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:24.382878 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a7de244e-f694-403a-a8ee-1dbb4d660ecf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:24.397183 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de244e-f694-403a-a8ee-1dbb4d660ecf service nova] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:24.401691 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b719d6-3a34-4661-b5d5-bfa6978227be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:24.402563 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b719d6-3a34-4661-b5d5-bfa6978227be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:24.404715 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b719d6-3a34-4661-b5d5-bfa6978227be admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:24.404715 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b719d6-3a34-4661-b5d5-bfa6978227be admin admin] PATH_INFO: `/v3/users/6b67d92f0f644bc0861995318d10441c` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:24.404715 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b719d6-3a34-4661-b5d5-bfa6978227be admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b67d92f0f644bc0861995318d10441c)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:24.406482 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b719d6-3a34-4661-b5d5-bfa6978227be admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:24.620641 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b4b719d6-3a34-4661-b5d5-bfa6978227be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b67d92f0f644bc0861995318d10441c'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:24.627784 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b4b719d6-3a34-4661-b5d5-bfa6978227be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b67d92f0f644bc0861995318d10441c'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:24.628490 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b4b719d6-3a34-4661-b5d5-bfa6978227be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b67d92f0f644bc0861995318d10441c'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:24.629133 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b4b719d6-3a34-4661-b5d5-bfa6978227be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b67d92f0f644bc0861995318d10441c'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:24.694244 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b4b719d6-3a34-4661-b5d5-bfa6978227be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b67d92f0f644bc0861995318d10441c'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:24.712922 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1227/2439] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:12:24 2022] DELETE /identity/v3/users/6b67d92f0f644bc0861995318d10441c => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:12:24.998897 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb5771-7d8a-4a5f-8063-72922814e9e6 service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:25.052408 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb5771-7d8a-4a5f-8063-72922814e9e6 service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:25.112480 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2130257-49fb-4434-bdcb-1fe60d3ab846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:25.113393 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2130257-49fb-4434-bdcb-1fe60d3ab846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:25.113686 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2130257-49fb-4434-bdcb-1fe60d3ab846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:25.113969 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2130257-49fb-4434-bdcb-1fe60d3ab846 admin admin] PATH_INFO: `/v3/projects/2625cd522bf34842b5be2fac16d8dbff` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:25.115198 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2130257-49fb-4434-bdcb-1fe60d3ab846 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2625cd522bf34842b5be2fac16d8dbff)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:25.117293 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2130257-49fb-4434-bdcb-1fe60d3ab846 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:25.130376 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:12:25.251008 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b2130257-49fb-4434-bdcb-1fe60d3ab846 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2625cd522bf34842b5be2fac16d8dbff', 'request_id': 'req-b2130257-49fb-4434-bdcb-1fe60d3ab846'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:25.257179 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b2130257-49fb-4434-bdcb-1fe60d3ab846 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2625cd522bf34842b5be2fac16d8dbff', 'request_id': 'req-b2130257-49fb-4434-bdcb-1fe60d3ab846'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:25.262995 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b2130257-49fb-4434-bdcb-1fe60d3ab846 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2625cd522bf34842b5be2fac16d8dbff', 'request_id': 'req-b2130257-49fb-4434-bdcb-1fe60d3ab846'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:25.364531 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b2130257-49fb-4434-bdcb-1fe60d3ab846 admin admin] The token cache is being invalidate because project 2625cd522bf34842b5be2fac16d8dbff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:12:25.364824 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b2130257-49fb-4434-bdcb-1fe60d3ab846 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:25.365453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b2130257-49fb-4434-bdcb-1fe60d3ab846 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:25.367002 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1213/2440] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:12:24 2022] DELETE /identity/v3/projects/2625cd522bf34842b5be2fac16d8dbff => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:12:25.371956 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e729a52-6524-4692-a5f8-5ddebd66ae54 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:25.372276 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e729a52-6524-4692-a5f8-5ddebd66ae54 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:25.372559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e729a52-6524-4692-a5f8-5ddebd66ae54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:25.438127 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-6e729a52-6524-4692-a5f8-5ddebd66ae54 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:12:25.439356 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-6e729a52-6524-4692-a5f8-5ddebd66ae54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:25.510962 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1228/2441] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:12:25.517291 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2320cb6-628a-4514-a19f-34ca7b160736 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:25.517656 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2320cb6-628a-4514-a19f-34ca7b160736 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:25.517947 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2320cb6-628a-4514-a19f-34ca7b160736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:25.536612 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-b2320cb6-628a-4514-a19f-34ca7b160736 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:12:25.537836 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b2320cb6-628a-4514-a19f-34ca7b160736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:25.545876 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1214/2442] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:12:25.550652 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e729a52-6524-4692-a5f8-5ddebd66ae54 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:25.560231 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e729a52-6524-4692-a5f8-5ddebd66ae54 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:25.564749 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a1805e-80ef-498c-bd75-b2839f901abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:25.565405 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1805e-80ef-498c-bd75-b2839f901abb admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:25.565688 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1805e-80ef-498c-bd75-b2839f901abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:25.565963 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1805e-80ef-498c-bd75-b2839f901abb admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:25.566686 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a1805e-80ef-498c-bd75-b2839f901abb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:12:25.566995 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a1805e-80ef-498c-bd75-b2839f901abb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:25.568640 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a1805e-80ef-498c-bd75-b2839f901abb admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:25.580777 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1229/2443] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:12:25.585130 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2320cb6-628a-4514-a19f-34ca7b160736 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:25.595308 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2320cb6-628a-4514-a19f-34ca7b160736 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:25.602404 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f345d01c-80d0-4bb1-8c33-059305f52a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:25.602404 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f345d01c-80d0-4bb1-8c33-059305f52a82 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:25.602404 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f345d01c-80d0-4bb1-8c33-059305f52a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:25.602404 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f345d01c-80d0-4bb1-8c33-059305f52a82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:25.602783 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f345d01c-80d0-4bb1-8c33-059305f52a82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:25.603705 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f345d01c-80d0-4bb1-8c33-059305f52a82 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:25.720111 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1215/2444] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:12:25 2022] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:12:25.724218 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a1805e-80ef-498c-bd75-b2839f901abb admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:25.734324 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a1805e-80ef-498c-bd75-b2839f901abb admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:25.874351 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:12:25.914595 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05df9d-dc3f-49b9-83da-0a0b3343b923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:25.915276 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05df9d-dc3f-49b9-83da-0a0b3343b923 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:25.915571 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05df9d-dc3f-49b9-83da-0a0b3343b923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:25.915945 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05df9d-dc3f-49b9-83da-0a0b3343b923 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:25.916689 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e05df9d-dc3f-49b9-83da-0a0b3343b923 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:25.918603 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e05df9d-dc3f-49b9-83da-0a0b3343b923 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:25.992034 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1230/2445] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:12:25 2022] POST /identity/v3/users => generated 287 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:12:25.996248 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f345d01c-80d0-4bb1-8c33-059305f52a82 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:26.007247 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f345d01c-80d0-4bb1-8c33-059305f52a82 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:26.014979 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429805a-4cba-4c6b-bd47-ca220c312273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:26.014979 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429805a-4cba-4c6b-bd47-ca220c312273 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:26.014979 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429805a-4cba-4c6b-bd47-ca220c312273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:26.014979 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429805a-4cba-4c6b-bd47-ca220c312273 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:26.015416 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9429805a-4cba-4c6b-bd47-ca220c312273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:26.016040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9429805a-4cba-4c6b-bd47-ca220c312273 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:26.026211 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1216/2446] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:12:26.030192 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05df9d-dc3f-49b9-83da-0a0b3343b923 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:26.040185 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05df9d-dc3f-49b9-83da-0a0b3343b923 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:26.044810 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476fbc6-e459-419b-a7f7-4b8f1ed16df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:26.045409 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476fbc6-e459-419b-a7f7-4b8f1ed16df9 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:26.045723 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476fbc6-e459-419b-a7f7-4b8f1ed16df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:26.046001 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476fbc6-e459-419b-a7f7-4b8f1ed16df9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:26.046728 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8476fbc6-e459-419b-a7f7-4b8f1ed16df9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:26.048685 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8476fbc6-e459-419b-a7f7-4b8f1ed16df9 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:26.059021 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1231/2447] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:12:26.063692 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429805a-4cba-4c6b-bd47-ca220c312273 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:26.073717 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429805a-4cba-4c6b-bd47-ca220c312273 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:26.079136 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ef663-70d0-43bb-a179-7aa4cf734591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:26.080039 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ef663-70d0-43bb-a179-7aa4cf734591 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:26.080352 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ef663-70d0-43bb-a179-7aa4cf734591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:26.080632 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ef663-70d0-43bb-a179-7aa4cf734591 admin admin] PATH_INFO: `/v3/projects/6a66e5b840bb45e1b220ecb8fd72e68c/users/27b4c1229e1440458c0b45c5ff010132/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:26.095473 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ef663-70d0-43bb-a179-7aa4cf734591 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a66e5b840bb45e1b220ecb8fd72e68c, user_id=27b4c1229e1440458c0b45c5ff010132, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:26.098126 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ef663-70d0-43bb-a179-7aa4cf734591 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:26.203331 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1217/2448] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:12:26 2022] PUT /identity/v3/projects/6a66e5b840bb45e1b220ecb8fd72e68c/users/27b4c1229e1440458c0b45c5ff010132/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:12:26.213690 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767e5f9-98e8-4770-beac-4ead76d73888 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:26.216732 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767e5f9-98e8-4770-beac-4ead76d73888 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:26.216732 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767e5f9-98e8-4770-beac-4ead76d73888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:26.241775 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-7767e5f9-98e8-4770-beac-4ead76d73888 None None] MFA Rules not processed for user `27b4c1229e1440458c0b45c5ff010132`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:12:26.242982 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-7767e5f9-98e8-4770-beac-4ead76d73888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:26.308746 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1232/2449] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:12:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:12:26.320854 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ef663-70d0-43bb-a179-7aa4cf734591 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:26.322566 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-a25ef663-70d0-43bb-a179-7aa4cf734591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:26.398814 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:12:26.413688 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ef663-70d0-43bb-a179-7aa4cf734591 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:26.419282 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e65970-3686-4fef-9360-82ed5c99d5f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:26.420080 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e65970-3686-4fef-9360-82ed5c99d5f5 service nova] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:26.420373 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e65970-3686-4fef-9360-82ed5c99d5f5 service nova] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:26.421178 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e65970-3686-4fef-9360-82ed5c99d5f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:26.429077 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e65970-3686-4fef-9360-82ed5c99d5f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:26.430684 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e65970-3686-4fef-9360-82ed5c99d5f5 service nova] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:26.440231 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1218/2450] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:12:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:12:27.229480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767e5f9-98e8-4770-beac-4ead76d73888 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:27.230922 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-7767e5f9-98e8-4770-beac-4ead76d73888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:27.294942 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767e5f9-98e8-4770-beac-4ead76d73888 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:27.300471 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c6daa-6ca4-4fa0-8884-dd0184710642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:27.301342 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c6daa-6ca4-4fa0-8884-dd0184710642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:27.301659 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c6daa-6ca4-4fa0-8884-dd0184710642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:27.302341 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c6daa-6ca4-4fa0-8884-dd0184710642 admin admin] PATH_INFO: `/v3/users/333515b7b5e340f6b4fac30efa630a0e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:27.303157 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c6daa-6ca4-4fa0-8884-dd0184710642 admin admin] RBAC: Authorizing `identity:delete_user(user_id=333515b7b5e340f6b4fac30efa630a0e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:27.305084 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c6daa-6ca4-4fa0-8884-dd0184710642 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:27.466534 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:12:27.479818 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-579c6daa-6ca4-4fa0-8884-dd0184710642 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '333515b7b5e340f6b4fac30efa630a0e'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:27.487356 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-579c6daa-6ca4-4fa0-8884-dd0184710642 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '333515b7b5e340f6b4fac30efa630a0e'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:27.488054 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-579c6daa-6ca4-4fa0-8884-dd0184710642 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '333515b7b5e340f6b4fac30efa630a0e'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:27.488659 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-579c6daa-6ca4-4fa0-8884-dd0184710642 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '333515b7b5e340f6b4fac30efa630a0e'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:27.557205 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-579c6daa-6ca4-4fa0-8884-dd0184710642 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '333515b7b5e340f6b4fac30efa630a0e'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:27.574821 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1233/2451] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:12:27 2022] DELETE /identity/v3/users/333515b7b5e340f6b4fac30efa630a0e => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:12:27.579638 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c130960-3303-462e-b0a9-525dfd4cbbc5 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:27.580138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c130960-3303-462e-b0a9-525dfd4cbbc5 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:27.580285 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c130960-3303-462e-b0a9-525dfd4cbbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:27.599404 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-5c130960-3303-462e-b0a9-525dfd4cbbc5 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:12:27.600677 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-5c130960-3303-462e-b0a9-525dfd4cbbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:27.660252 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1219/2452] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:12:27.670000 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c6daa-6ca4-4fa0-8884-dd0184710642 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:27.672160 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-579c6daa-6ca4-4fa0-8884-dd0184710642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:27.750058 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c6daa-6ca4-4fa0-8884-dd0184710642 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:27.753662 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf54f4-9a2e-4181-b52c-71524a4da52d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:27.755558 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf54f4-9a2e-4181-b52c-71524a4da52d service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:27.755558 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf54f4-9a2e-4181-b52c-71524a4da52d service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:27.755558 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf54f4-9a2e-4181-b52c-71524a4da52d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:27.763791 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baf54f4-9a2e-4181-b52c-71524a4da52d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:27.765856 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baf54f4-9a2e-4181-b52c-71524a4da52d service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:27.775332 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1234/2453] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:12:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:12:28.188881 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c130960-3303-462e-b0a9-525dfd4cbbc5 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:28.190297 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-5c130960-3303-462e-b0a9-525dfd4cbbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:28.204560 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c130960-3303-462e-b0a9-525dfd4cbbc5 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:28.209306 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99f5d9-aa0d-4c42-bf1f-9ea05ad0c9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:28.210214 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99f5d9-aa0d-4c42-bf1f-9ea05ad0c9fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:28.210504 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99f5d9-aa0d-4c42-bf1f-9ea05ad0c9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:28.210782 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99f5d9-aa0d-4c42-bf1f-9ea05ad0c9fe admin admin] PATH_INFO: `/v3/projects/061182d0b77f466799346898635630ac` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:28.212511 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b99f5d9-aa0d-4c42-bf1f-9ea05ad0c9fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=061182d0b77f466799346898635630ac)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:28.214013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b99f5d9-aa0d-4c42-bf1f-9ea05ad0c9fe admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:28.355840 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-3b99f5d9-aa0d-4c42-bf1f-9ea05ad0c9fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '061182d0b77f466799346898635630ac', 'request_id': 'req-3b99f5d9-aa0d-4c42-bf1f-9ea05ad0c9fe'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:28.362633 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-3b99f5d9-aa0d-4c42-bf1f-9ea05ad0c9fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '061182d0b77f466799346898635630ac', 'request_id': 'req-3b99f5d9-aa0d-4c42-bf1f-9ea05ad0c9fe'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:28.368559 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-3b99f5d9-aa0d-4c42-bf1f-9ea05ad0c9fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '061182d0b77f466799346898635630ac', 'request_id': 'req-3b99f5d9-aa0d-4c42-bf1f-9ea05ad0c9fe'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:28.471485 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-3b99f5d9-aa0d-4c42-bf1f-9ea05ad0c9fe admin admin] The token cache is being invalidate because project 061182d0b77f466799346898635630ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:12:28.471795 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-3b99f5d9-aa0d-4c42-bf1f-9ea05ad0c9fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:28.472496 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-3b99f5d9-aa0d-4c42-bf1f-9ea05ad0c9fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:28.474191 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1220/2454] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:12:28 2022] DELETE /identity/v3/projects/061182d0b77f466799346898635630ac => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:12:28.478234 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf54f4-9a2e-4181-b52c-71524a4da52d service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:28.489215 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf54f4-9a2e-4181-b52c-71524a4da52d service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:28.557229 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b7f0d-8f8b-4d7b-b30f-34ba46c9dd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:28.557229 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b7f0d-8f8b-4d7b-b30f-34ba46c9dd73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:28.557229 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b7f0d-8f8b-4d7b-b30f-34ba46c9dd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:28.557229 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b7f0d-8f8b-4d7b-b30f-34ba46c9dd73 admin admin] PATH_INFO: `/v3/users/8f42dafc9749459e8dc58ef56d6ae988` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:28.557549 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b7f0d-8f8b-4d7b-b30f-34ba46c9dd73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f42dafc9749459e8dc58ef56d6ae988)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:28.559846 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b7f0d-8f8b-4d7b-b30f-34ba46c9dd73 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:28.742316 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:12:28.754640 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ec6b7f0d-8f8b-4d7b-b30f-34ba46c9dd73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f42dafc9749459e8dc58ef56d6ae988'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:28.761298 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ec6b7f0d-8f8b-4d7b-b30f-34ba46c9dd73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f42dafc9749459e8dc58ef56d6ae988'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:28.762079 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ec6b7f0d-8f8b-4d7b-b30f-34ba46c9dd73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f42dafc9749459e8dc58ef56d6ae988'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:28.762695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ec6b7f0d-8f8b-4d7b-b30f-34ba46c9dd73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f42dafc9749459e8dc58ef56d6ae988'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:28.843902 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ec6b7f0d-8f8b-4d7b-b30f-34ba46c9dd73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f42dafc9749459e8dc58ef56d6ae988'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:28.862499 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1235/2455] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:12:28 2022] DELETE /identity/v3/users/8f42dafc9749459e8dc58ef56d6ae988 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:12:29.307124 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99f5d9-aa0d-4c42-bf1f-9ea05ad0c9fe admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:29.307124 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-3b99f5d9-aa0d-4c42-bf1f-9ea05ad0c9fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:29.319443 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99f5d9-aa0d-4c42-bf1f-9ea05ad0c9fe admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:29.378075 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb7f82-a32f-4f74-a539-b1c49da75b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:29.378940 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb7f82-a32f-4f74-a539-b1c49da75b19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:29.379228 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb7f82-a32f-4f74-a539-b1c49da75b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:29.379506 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb7f82-a32f-4f74-a539-b1c49da75b19 admin admin] PATH_INFO: `/v3/projects/bbb7e65f2f424bdb86654185fa12095a` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:29.380687 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bb7f82-a32f-4f74-a539-b1c49da75b19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbb7e65f2f424bdb86654185fa12095a)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:29.382610 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bb7f82-a32f-4f74-a539-b1c49da75b19 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:29.394895 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:12:29.511805 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d2bb7f82-a32f-4f74-a539-b1c49da75b19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbb7e65f2f424bdb86654185fa12095a', 'request_id': 'req-d2bb7f82-a32f-4f74-a539-b1c49da75b19'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:29.518411 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d2bb7f82-a32f-4f74-a539-b1c49da75b19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbb7e65f2f424bdb86654185fa12095a', 'request_id': 'req-d2bb7f82-a32f-4f74-a539-b1c49da75b19'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:29.524032 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d2bb7f82-a32f-4f74-a539-b1c49da75b19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbb7e65f2f424bdb86654185fa12095a', 'request_id': 'req-d2bb7f82-a32f-4f74-a539-b1c49da75b19'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:29.625485 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d2bb7f82-a32f-4f74-a539-b1c49da75b19 admin admin] The token cache is being invalidate because project bbb7e65f2f424bdb86654185fa12095a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:12:29.625485 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d2bb7f82-a32f-4f74-a539-b1c49da75b19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:29.625485 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-d2bb7f82-a32f-4f74-a539-b1c49da75b19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:29.625485 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1221/2456] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:12:29 2022] DELETE /identity/v3/projects/bbb7e65f2f424bdb86654185fa12095a => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:12:29.627275 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c2312-5a36-43a9-a0ce-36025f61d381 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:29.627718 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c2312-5a36-43a9-a0ce-36025f61d381 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:29.628002 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c2312-5a36-43a9-a0ce-36025f61d381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:29.643751 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb7f82-a32f-4f74-a539-b1c49da75b19 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:29.643751 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-d2bb7f82-a32f-4f74-a539-b1c49da75b19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:29.648843 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-f20c2312-5a36-43a9-a0ce-36025f61d381 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:12:29.651190 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-f20c2312-5a36-43a9-a0ce-36025f61d381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:29.711879 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1236/2457] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:12:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:12:29.712236 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb7f82-a32f-4f74-a539-b1c49da75b19 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:29.716793 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7abed2d-ac05-4dc3-a049-5b71d11cdfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:29.717981 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abed2d-ac05-4dc3-a049-5b71d11cdfe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:29.718421 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abed2d-ac05-4dc3-a049-5b71d11cdfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:29.718706 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abed2d-ac05-4dc3-a049-5b71d11cdfe2 admin admin] PATH_INFO: `/v3/users/27b4c1229e1440458c0b45c5ff010132` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:29.719578 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a585167-6487-4aee-9fc9-f80f5625c3f0 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:29.719870 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a585167-6487-4aee-9fc9-f80f5625c3f0 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:29.720003 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7abed2d-ac05-4dc3-a049-5b71d11cdfe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27b4c1229e1440458c0b45c5ff010132)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:29.720185 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a585167-6487-4aee-9fc9-f80f5625c3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:29.721870 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7abed2d-ac05-4dc3-a049-5b71d11cdfe2 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:29.738778 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-7a585167-6487-4aee-9fc9-f80f5625c3f0 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:12:29.739990 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-7a585167-6487-4aee-9fc9-f80f5625c3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:29.748020 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1237/2458] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:12:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:12:29.752777 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a585167-6487-4aee-9fc9-f80f5625c3f0 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:29.761695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a585167-6487-4aee-9fc9-f80f5625c3f0 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:29.766963 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beecb3b1-55c8-4656-a650-f4a673aa3112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:29.767611 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecb3b1-55c8-4656-a650-f4a673aa3112 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:29.767899 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecb3b1-55c8-4656-a650-f4a673aa3112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:29.768217 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecb3b1-55c8-4656-a650-f4a673aa3112 admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:29.768945 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beecb3b1-55c8-4656-a650-f4a673aa3112 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:12:29.769257 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beecb3b1-55c8-4656-a650-f4a673aa3112 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:29.771109 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beecb3b1-55c8-4656-a650-f4a673aa3112 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:29.782651 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1238/2459] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 21:12:29.790214 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beecb3b1-55c8-4656-a650-f4a673aa3112 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:29.800382 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beecb3b1-55c8-4656-a650-f4a673aa3112 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:29.805022 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929f896-b9ee-453c-8874-77d369384f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:29.805685 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929f896-b9ee-453c-8874-77d369384f6f admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:29.805968 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929f896-b9ee-453c-8874-77d369384f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:29.806244 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929f896-b9ee-453c-8874-77d369384f6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:29.806955 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929f896-b9ee-453c-8874-77d369384f6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:29.809131 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929f896-b9ee-453c-8874-77d369384f6f admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:29.890147 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e7abed2d-ac05-4dc3-a049-5b71d11cdfe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27b4c1229e1440458c0b45c5ff010132'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:29.897624 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e7abed2d-ac05-4dc3-a049-5b71d11cdfe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27b4c1229e1440458c0b45c5ff010132'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:29.898312 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e7abed2d-ac05-4dc3-a049-5b71d11cdfe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27b4c1229e1440458c0b45c5ff010132'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:29.899089 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e7abed2d-ac05-4dc3-a049-5b71d11cdfe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27b4c1229e1440458c0b45c5ff010132'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:29.905394 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1239/2460] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:12:29 2022] POST /identity/v3/projects => generated 357 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 21:12:29.909542 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929f896-b9ee-453c-8874-77d369384f6f admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:29.911128 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-1929f896-b9ee-453c-8874-77d369384f6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:29.973235 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929f896-b9ee-453c-8874-77d369384f6f admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:29.977800 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990c306-cf3a-4c55-8735-09784e52d6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:29.978469 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990c306-cf3a-4c55-8735-09784e52d6b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:29.978790 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990c306-cf3a-4c55-8735-09784e52d6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:29.979074 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990c306-cf3a-4c55-8735-09784e52d6b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:29.979757 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7990c306-cf3a-4c55-8735-09784e52d6b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:29.981704 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7990c306-cf3a-4c55-8735-09784e52d6b3 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:29.985667 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e7abed2d-ac05-4dc3-a049-5b71d11cdfe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27b4c1229e1440458c0b45c5ff010132'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:30.004598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1222/2461] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:12:29 2022] DELETE /identity/v3/users/27b4c1229e1440458c0b45c5ff010132 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:12:30.008877 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d767e8-161b-41e6-b9b9-a97d6daf47f2 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:30.009169 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d767e8-161b-41e6-b9b9-a97d6daf47f2 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:30.009451 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d767e8-161b-41e6-b9b9-a97d6daf47f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:30.025922 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-07d767e8-161b-41e6-b9b9-a97d6daf47f2 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:12:30.027103 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-07d767e8-161b-41e6-b9b9-a97d6daf47f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:30.039317 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:12:30.055146 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:12:30.064976 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1240/2462] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:12:29 2022] POST /identity/v3/users => generated 279 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 21:12:30.066006 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990c306-cf3a-4c55-8735-09784e52d6b3 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:30.075583 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990c306-cf3a-4c55-8735-09784e52d6b3 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:30.086021 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1223/2463] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:12:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:12:30.097535 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d767e8-161b-41e6-b9b9-a97d6daf47f2 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:30.099429 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-07d767e8-161b-41e6-b9b9-a97d6daf47f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:30.143108 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2106b-7f6e-4ce4-adbc-c2940a4f6802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:30.143722 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2106b-7f6e-4ce4-adbc-c2940a4f6802 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:30.144031 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2106b-7f6e-4ce4-adbc-c2940a4f6802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:30.144311 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2106b-7f6e-4ce4-adbc-c2940a4f6802 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:30.145260 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2106b-7f6e-4ce4-adbc-c2940a4f6802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:30.147402 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2106b-7f6e-4ce4-adbc-c2940a4f6802 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:30.158169 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1241/2464] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 21:12:30.162637 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d767e8-161b-41e6-b9b9-a97d6daf47f2 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:30.165122 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e10eb-a0ff-454e-92a7-184abd7485ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:30.165269 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2106b-7f6e-4ce4-adbc-c2940a4f6802 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:30.165784 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e10eb-a0ff-454e-92a7-184abd7485ca service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:30.166074 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e10eb-a0ff-454e-92a7-184abd7485ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:30.166350 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e10eb-a0ff-454e-92a7-184abd7485ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:30.175611 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2106b-7f6e-4ce4-adbc-c2940a4f6802 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:30.176608 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e10eb-a0ff-454e-92a7-184abd7485ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:30.177984 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e10eb-a0ff-454e-92a7-184abd7485ca service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:30.180263 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da07306-3256-409c-9a24-bb56a73522b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:30.180922 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da07306-3256-409c-9a24-bb56a73522b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:30.181209 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da07306-3256-409c-9a24-bb56a73522b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:30.181493 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da07306-3256-409c-9a24-bb56a73522b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:30.182211 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da07306-3256-409c-9a24-bb56a73522b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:30.183788 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da07306-3256-409c-9a24-bb56a73522b2 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:30.187830 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1224/2465] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:12:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:12:30.194426 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1242/2466] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 21:12:30.199909 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e10eb-a0ff-454e-92a7-184abd7485ca service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:30.210515 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e10eb-a0ff-454e-92a7-184abd7485ca service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:30.218146 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765253c-d333-4ec7-a8c1-caa4f42ece76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:30.219041 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765253c-d333-4ec7-a8c1-caa4f42ece76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:30.219328 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765253c-d333-4ec7-a8c1-caa4f42ece76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:30.224123 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765253c-d333-4ec7-a8c1-caa4f42ece76 admin admin] PATH_INFO: `/v3/projects/3695aab9b7554b3188d6f9b1ddb0bd88/users/e6c938b42ff043b992aa928adc9038c1/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:30.236452 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765253c-d333-4ec7-a8c1-caa4f42ece76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3695aab9b7554b3188d6f9b1ddb0bd88, user_id=e6c938b42ff043b992aa928adc9038c1, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:30.239107 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765253c-d333-4ec7-a8c1-caa4f42ece76 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:30.347184 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1225/2467] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:12:30 2022] PUT /identity/v3/projects/3695aab9b7554b3188d6f9b1ddb0bd88/users/e6c938b42ff043b992aa928adc9038c1/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:12:30.357502 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e8731-4062-461f-bf50-2140b8eab7a5 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:30.357926 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e8731-4062-461f-bf50-2140b8eab7a5 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:30.358783 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e8731-4062-461f-bf50-2140b8eab7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:30.385910 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-b41e8731-4062-461f-bf50-2140b8eab7a5 None None] MFA Rules not processed for user `e6c938b42ff043b992aa928adc9038c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:12:30.387073 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-b41e8731-4062-461f-bf50-2140b8eab7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:30.464229 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1243/2468] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:12:30 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:12:30.469751 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765253c-d333-4ec7-a8c1-caa4f42ece76 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:30.541503 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765253c-d333-4ec7-a8c1-caa4f42ece76 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:30.549975 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16fa50-dc7b-4cb2-99e6-1f6e46dfb6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:30.551082 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16fa50-dc7b-4cb2-99e6-1f6e46dfb6b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:30.551244 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16fa50-dc7b-4cb2-99e6-1f6e46dfb6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:30.551445 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16fa50-dc7b-4cb2-99e6-1f6e46dfb6b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:30.552202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c16fa50-dc7b-4cb2-99e6-1f6e46dfb6b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:30.554143 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c16fa50-dc7b-4cb2-99e6-1f6e46dfb6b9 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:30.686869 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1226/2469] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:12:30 2022] POST /identity/v3/projects => generated 357 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 21:12:30.856965 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e8731-4062-461f-bf50-2140b8eab7a5 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:30.856965 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e8731-4062-461f-bf50-2140b8eab7a5 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:30.856965 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa518f1-2ca7-4293-8cd9-4c212a34e0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:30.856965 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa518f1-2ca7-4293-8cd9-4c212a34e0bb admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:30.857800 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa518f1-2ca7-4293-8cd9-4c212a34e0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:30.857800 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa518f1-2ca7-4293-8cd9-4c212a34e0bb admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:30.857800 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa518f1-2ca7-4293-8cd9-4c212a34e0bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:30.857800 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa518f1-2ca7-4293-8cd9-4c212a34e0bb admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:30.964945 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16fa50-dc7b-4cb2-99e6-1f6e46dfb6b9 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:30.965387 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1244/2470] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:12:30 2022] POST /identity/v3/users => generated 285 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:12:30.966890 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-6c16fa50-dc7b-4cb2-99e6-1f6e46dfb6b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:30.969192 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa518f1-2ca7-4293-8cd9-4c212a34e0bb admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:30.981335 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16fa50-dc7b-4cb2-99e6-1f6e46dfb6b9 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:30.986337 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa518f1-2ca7-4293-8cd9-4c212a34e0bb admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:30.987227 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:12:30.988887 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff188dd-9a0d-4f24-94a5-9e0f953e0318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:30.989792 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff188dd-9a0d-4f24-94a5-9e0f953e0318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:30.990101 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff188dd-9a0d-4f24-94a5-9e0f953e0318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:30.990543 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff188dd-9a0d-4f24-94a5-9e0f953e0318 admin admin] PATH_INFO: `/v3/projects/6a66e5b840bb45e1b220ecb8fd72e68c` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:30.992876 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff188dd-9a0d-4f24-94a5-9e0f953e0318 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a66e5b840bb45e1b220ecb8fd72e68c)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:30.993847 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980ccc7-72f9-408b-94b5-f5f7f440b7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:30.994819 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff188dd-9a0d-4f24-94a5-9e0f953e0318 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:30.994947 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980ccc7-72f9-408b-94b5-f5f7f440b7d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:30.995511 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980ccc7-72f9-408b-94b5-f5f7f440b7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:30.996054 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980ccc7-72f9-408b-94b5-f5f7f440b7d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:30.997400 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980ccc7-72f9-408b-94b5-f5f7f440b7d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:30.999052 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980ccc7-72f9-408b-94b5-f5f7f440b7d4 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:31.009554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1245/2471] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:12:31.013642 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980ccc7-72f9-408b-94b5-f5f7f440b7d4 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:31.019254 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:12:31.024305 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980ccc7-72f9-408b-94b5-f5f7f440b7d4 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:31.029062 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9219e-ca7e-4dfa-ab47-d755ef8be164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:31.030516 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9219e-ca7e-4dfa-ab47-d755ef8be164 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:31.030856 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9219e-ca7e-4dfa-ab47-d755ef8be164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:31.031143 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9219e-ca7e-4dfa-ab47-d755ef8be164 admin admin] PATH_INFO: `/v3/projects/ae4d998c046d4540ad598be38f5ab2b6/users/66047c13621b4373b0bd5140a554a762/roles/86273ff072f3438d822e870272491768` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:31.047000 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e9219e-ca7e-4dfa-ab47-d755ef8be164 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae4d998c046d4540ad598be38f5ab2b6, user_id=66047c13621b4373b0bd5140a554a762, role_id=86273ff072f3438d822e870272491768)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:31.049633 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e9219e-ca7e-4dfa-ab47-d755ef8be164 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:31.152741 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1246/2472] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:12:31 2022] PUT /identity/v3/projects/ae4d998c046d4540ad598be38f5ab2b6/users/66047c13621b4373b0bd5140a554a762/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:12:31.156994 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9219e-ca7e-4dfa-ab47-d755ef8be164 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:31.162134 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-eff188dd-9a0d-4f24-94a5-9e0f953e0318 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a66e5b840bb45e1b220ecb8fd72e68c', 'request_id': 'req-eff188dd-9a0d-4f24-94a5-9e0f953e0318'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:31.171818 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-eff188dd-9a0d-4f24-94a5-9e0f953e0318 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a66e5b840bb45e1b220ecb8fd72e68c', 'request_id': 'req-eff188dd-9a0d-4f24-94a5-9e0f953e0318'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:31.178112 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-eff188dd-9a0d-4f24-94a5-9e0f953e0318 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a66e5b840bb45e1b220ecb8fd72e68c', 'request_id': 'req-eff188dd-9a0d-4f24-94a5-9e0f953e0318'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:31.220876 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9219e-ca7e-4dfa-ab47-d755ef8be164 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:31.277151 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d5bb9-0364-4cb0-9541-978e591bb678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:31.277819 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d5bb9-0364-4cb0-9541-978e591bb678 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:31.278102 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d5bb9-0364-4cb0-9541-978e591bb678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:31.278382 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d5bb9-0364-4cb0-9541-978e591bb678 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:31.279096 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d5bb9-0364-4cb0-9541-978e591bb678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:31.280776 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d5bb9-0364-4cb0-9541-978e591bb678 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:31.290710 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1247/2473] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:12:31.294525 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d5bb9-0364-4cb0-9541-978e591bb678 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:31.304705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d5bb9-0364-4cb0-9541-978e591bb678 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:31.305721 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-eff188dd-9a0d-4f24-94a5-9e0f953e0318 admin admin] The token cache is being invalidate because project 6a66e5b840bb45e1b220ecb8fd72e68c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:12:31.306112 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-eff188dd-9a0d-4f24-94a5-9e0f953e0318 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:31.306760 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-eff188dd-9a0d-4f24-94a5-9e0f953e0318 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:31.308440 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1227/2474] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:12:30 2022] DELETE /identity/v3/projects/6a66e5b840bb45e1b220ecb8fd72e68c => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:12:31.333327 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6094c-ecc6-49ea-b8f7-bc9e9dcc21cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:31.333327 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6094c-ecc6-49ea-b8f7-bc9e9dcc21cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:31.333327 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6094c-ecc6-49ea-b8f7-bc9e9dcc21cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:31.333327 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6094c-ecc6-49ea-b8f7-bc9e9dcc21cf admin admin] PATH_INFO: `/v3/projects/ae4d998c046d4540ad598be38f5ab2b6/users/66047c13621b4373b0bd5140a554a762/roles/86273ff072f3438d822e870272491768` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:31.333739 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6094c-ecc6-49ea-b8f7-bc9e9dcc21cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae4d998c046d4540ad598be38f5ab2b6, user_id=66047c13621b4373b0bd5140a554a762, role_id=86273ff072f3438d822e870272491768)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:31.333739 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6094c-ecc6-49ea-b8f7-bc9e9dcc21cf admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:31.333739 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1248/2475] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:12:31 2022] PUT /identity/v3/projects/ae4d998c046d4540ad598be38f5ab2b6/users/66047c13621b4373b0bd5140a554a762/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:12:31.340701 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e80a9-2876-465a-8ac6-13b66ef50b30 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:31.340997 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e80a9-2876-465a-8ac6-13b66ef50b30 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:31.341282 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e80a9-2876-465a-8ac6-13b66ef50b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:31.343399 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a1a0b-f531-4176-9fb4-a6c2b50242fc None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:31.343695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a1a0b-f531-4176-9fb4-a6c2b50242fc None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:31.343996 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a1a0b-f531-4176-9fb4-a6c2b50242fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:31.371112 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-306e80a9-2876-465a-8ac6-13b66ef50b30 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:12:31.372443 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-306e80a9-2876-465a-8ac6-13b66ef50b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:31.378138 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-795a1a0b-f531-4176-9fb4-a6c2b50242fc None None] MFA Rules not processed for user `66047c13621b4373b0bd5140a554a762`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:12:31.379341 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-795a1a0b-f531-4176-9fb4-a6c2b50242fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:31.436813 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:12:31.442044 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1228/2476] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:12:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:12:31.449659 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14212ed4-751b-4fd2-aac9-d790ff1f9367 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:31.449959 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14212ed4-751b-4fd2-aac9-d790ff1f9367 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:31.450242 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14212ed4-751b-4fd2-aac9-d790ff1f9367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:31.468019 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1249/2477] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:12:31 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:12:31.472465 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-14212ed4-751b-4fd2-aac9-d790ff1f9367 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:12:31.473704 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-14212ed4-751b-4fd2-aac9-d790ff1f9367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:31.477337 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a1a0b-f531-4176-9fb4-a6c2b50242fc None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:31.478769 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-795a1a0b-f531-4176-9fb4-a6c2b50242fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:31.486035 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1229/2478] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:12:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:12:31.491193 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14212ed4-751b-4fd2-aac9-d790ff1f9367 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:31.496362 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14212ed4-751b-4fd2-aac9-d790ff1f9367 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:31.501842 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae671c5-30d5-4ab4-a1d2-e70ee359c1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:31.502491 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae671c5-30d5-4ab4-a1d2-e70ee359c1ae admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:31.502780 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae671c5-30d5-4ab4-a1d2-e70ee359c1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:31.503063 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae671c5-30d5-4ab4-a1d2-e70ee359c1ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:31.503818 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae671c5-30d5-4ab4-a1d2-e70ee359c1ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:12:31.504172 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae671c5-30d5-4ab4-a1d2-e70ee359c1ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:31.505766 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae671c5-30d5-4ab4-a1d2-e70ee359c1ae admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:31.519748 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1230/2479] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:12:31.525192 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae671c5-30d5-4ab4-a1d2-e70ee359c1ae admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:31.537227 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae671c5-30d5-4ab4-a1d2-e70ee359c1ae admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:31.542628 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec3202-e37a-4dbd-bc45-cef4e68c8d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:31.543434 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec3202-e37a-4dbd-bc45-cef4e68c8d98 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:31.543845 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec3202-e37a-4dbd-bc45-cef4e68c8d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:31.544248 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec3202-e37a-4dbd-bc45-cef4e68c8d98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:31.545025 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec3202-e37a-4dbd-bc45-cef4e68c8d98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:31.547589 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec3202-e37a-4dbd-bc45-cef4e68c8d98 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:31.576121 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a1a0b-f531-4176-9fb4-a6c2b50242fc None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:31.580691 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664521a-b716-4f41-95cf-050f33c20672 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:31.581355 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664521a-b716-4f41-95cf-050f33c20672 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:31.581622 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664521a-b716-4f41-95cf-050f33c20672 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:31.581898 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664521a-b716-4f41-95cf-050f33c20672 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:31.596382 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664521a-b716-4f41-95cf-050f33c20672 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:31.597886 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664521a-b716-4f41-95cf-050f33c20672 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:31.607298 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1250/2480] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:12:31 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 21:12:31.639722 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1231/2481] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:12:31 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:12:31.643773 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664521a-b716-4f41-95cf-050f33c20672 service cinder] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:31.654078 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664521a-b716-4f41-95cf-050f33c20672 service cinder] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:31.711718 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0873619-ad93-44df-b3cb-fa06d61dcf94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:31.712446 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0873619-ad93-44df-b3cb-fa06d61dcf94 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:31.712739 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0873619-ad93-44df-b3cb-fa06d61dcf94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:31.713022 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0873619-ad93-44df-b3cb-fa06d61dcf94 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:31.713707 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0873619-ad93-44df-b3cb-fa06d61dcf94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:31.715613 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0873619-ad93-44df-b3cb-fa06d61dcf94 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:31.803217 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1251/2482] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:12:31 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:12:31.807500 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec3202-e37a-4dbd-bc45-cef4e68c8d98 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:31.819119 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec3202-e37a-4dbd-bc45-cef4e68c8d98 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:31.821557 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0873619-ad93-44df-b3cb-fa06d61dcf94 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:31.824474 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4a781-a706-4fb9-a6c7-c9cef5110c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:31.825148 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4a781-a706-4fb9-a6c7-c9cef5110c97 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:31.825434 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4a781-a706-4fb9-a6c7-c9cef5110c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:31.825852 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4a781-a706-4fb9-a6c7-c9cef5110c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:31.826587 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4a781-a706-4fb9-a6c7-c9cef5110c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:31.829554 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4a781-a706-4fb9-a6c7-c9cef5110c97 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:31.843540 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1232/2483] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:12:31.844579 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4a781-a706-4fb9-a6c7-c9cef5110c97 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:31.854222 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4a781-a706-4fb9-a6c7-c9cef5110c97 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:31.859545 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a25e5-2452-4316-b554-aad3ef614ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:31.860237 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a25e5-2452-4316-b554-aad3ef614ccb admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:31.860524 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a25e5-2452-4316-b554-aad3ef614ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:31.860804 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a25e5-2452-4316-b554-aad3ef614ccb admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:31.861524 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a25e5-2452-4316-b554-aad3ef614ccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:31.863204 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a25e5-2452-4316-b554-aad3ef614ccb admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:31.873492 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1233/2484] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:12:31.878169 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a25e5-2452-4316-b554-aad3ef614ccb admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:31.883981 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0873619-ad93-44df-b3cb-fa06d61dcf94 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:31.888273 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a25e5-2452-4316-b554-aad3ef614ccb admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:31.888945 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe544d-87b4-4a56-a9a7-651dc082bc13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:31.890412 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe544d-87b4-4a56-a9a7-651dc082bc13 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:31.890703 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe544d-87b4-4a56-a9a7-651dc082bc13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:31.890988 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe544d-87b4-4a56-a9a7-651dc082bc13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:31.892849 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-51fe544d-87b4-4a56-a9a7-651dc082bc13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:31.893967 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214106ca-1462-489e-a607-b365181358b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:31.901156 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214106ca-1462-489e-a607-b365181358b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:31.901156 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214106ca-1462-489e-a607-b365181358b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:31.901156 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214106ca-1462-489e-a607-b365181358b2 admin admin] PATH_INFO: `/v3/projects/adda03f88c7d40979007bdd9cd756264/users/bbf6bb607547460fa2496336a54cf9e4/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:31.902225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:12:31.910824 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214106ca-1462-489e-a607-b365181358b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adda03f88c7d40979007bdd9cd756264, user_id=bbf6bb607547460fa2496336a54cf9e4, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:31.913480 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214106ca-1462-489e-a607-b365181358b2 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:31.951381 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe544d-87b4-4a56-a9a7-651dc082bc13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:31.955083 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe544d-87b4-4a56-a9a7-651dc082bc13 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:31.964278 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1252/2485] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:12:31 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 21:12:32.019314 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1234/2486] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:12:31 2022] PUT /identity/v3/projects/adda03f88c7d40979007bdd9cd756264/users/bbf6bb607547460fa2496336a54cf9e4/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:12:32.030212 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30708b5b-8391-463a-9718-e800e230e7e3 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:32.030689 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30708b5b-8391-463a-9718-e800e230e7e3 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:32.030987 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30708b5b-8391-463a-9718-e800e230e7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:32.056975 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-30708b5b-8391-463a-9718-e800e230e7e3 None None] MFA Rules not processed for user `bbf6bb607547460fa2496336a54cf9e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:12:32.058101 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-30708b5b-8391-463a-9718-e800e230e7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:32.120586 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1253/2487] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:12:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:12:32.125846 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214106ca-1462-489e-a607-b365181358b2 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:32.147319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:12:32.194572 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214106ca-1462-489e-a607-b365181358b2 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:32.199497 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d52ac-469a-4e16-9f7d-f9c72d51d129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:32.200204 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d52ac-469a-4e16-9f7d-f9c72d51d129 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:32.200493 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d52ac-469a-4e16-9f7d-f9c72d51d129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:32.200773 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d52ac-469a-4e16-9f7d-f9c72d51d129 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:32.201467 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24d52ac-469a-4e16-9f7d-f9c72d51d129 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:32.203576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24d52ac-469a-4e16-9f7d-f9c72d51d129 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:32.308498 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1235/2488] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:12:32 2022] POST /identity/v3/projects => generated 377 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:12:32.313129 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30708b5b-8391-463a-9718-e800e230e7e3 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:32.323576 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30708b5b-8391-463a-9718-e800e230e7e3 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:32.389209 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1374ef4-fbad-4cd1-9354-3468ab3e5dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:32.390030 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1374ef4-fbad-4cd1-9354-3468ab3e5dde admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:32.390320 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1374ef4-fbad-4cd1-9354-3468ab3e5dde admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:32.390624 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1374ef4-fbad-4cd1-9354-3468ab3e5dde admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:32.391434 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1374ef4-fbad-4cd1-9354-3468ab3e5dde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:32.393233 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1374ef4-fbad-4cd1-9354-3468ab3e5dde admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:32.478236 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1254/2489] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:12:32 2022] POST /identity/v3/users => generated 295 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 21:12:32.482289 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d52ac-469a-4e16-9f7d-f9c72d51d129 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:32.493200 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d52ac-469a-4e16-9f7d-f9c72d51d129 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:32.497761 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa671238-0d45-48f5-9a78-304f997feec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:32.498426 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa671238-0d45-48f5-9a78-304f997feec1 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:32.499390 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa671238-0d45-48f5-9a78-304f997feec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:32.499672 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa671238-0d45-48f5-9a78-304f997feec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:32.500444 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa671238-0d45-48f5-9a78-304f997feec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:32.502035 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa671238-0d45-48f5-9a78-304f997feec1 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:32.512429 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1236/2490] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:12:32.516623 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1374ef4-fbad-4cd1-9354-3468ab3e5dde admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:32.526854 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1374ef4-fbad-4cd1-9354-3468ab3e5dde admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:32.532168 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a09ad8-d4f1-4407-b63a-fe6d4cc1cf03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:32.533041 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a09ad8-d4f1-4407-b63a-fe6d4cc1cf03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:32.533474 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a09ad8-d4f1-4407-b63a-fe6d4cc1cf03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:32.533638 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a09ad8-d4f1-4407-b63a-fe6d4cc1cf03 admin admin] PATH_INFO: `/v3/projects/404765d8faef451481c8c622c2d0df03/users/abd0ea1791b14720a5eacded168fe749/roles/86273ff072f3438d822e870272491768` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:32.549490 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a09ad8-d4f1-4407-b63a-fe6d4cc1cf03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=404765d8faef451481c8c622c2d0df03, user_id=abd0ea1791b14720a5eacded168fe749, role_id=86273ff072f3438d822e870272491768)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:32.552184 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a09ad8-d4f1-4407-b63a-fe6d4cc1cf03 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:32.618644 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1255/2491] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:12:32 2022] PUT /identity/v3/projects/404765d8faef451481c8c622c2d0df03/users/abd0ea1791b14720a5eacded168fe749/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:12:32.623268 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa671238-0d45-48f5-9a78-304f997feec1 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:32.633190 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa671238-0d45-48f5-9a78-304f997feec1 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:32.693936 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c15b7-d42c-4cba-9bcd-c4acd4cd3944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:32.694648 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c15b7-d42c-4cba-9bcd-c4acd4cd3944 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:32.694934 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c15b7-d42c-4cba-9bcd-c4acd4cd3944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:32.695218 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c15b7-d42c-4cba-9bcd-c4acd4cd3944 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:32.695947 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c15b7-d42c-4cba-9bcd-c4acd4cd3944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:32.697574 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c15b7-d42c-4cba-9bcd-c4acd4cd3944 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:32.707678 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1237/2492] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:12:32.712040 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a09ad8-d4f1-4407-b63a-fe6d4cc1cf03 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:32.719382 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:12:32.723453 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a09ad8-d4f1-4407-b63a-fe6d4cc1cf03 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:32.728242 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161730f6-f425-4a6c-9da7-e59e629eee65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:32.729185 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161730f6-f425-4a6c-9da7-e59e629eee65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:32.729476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161730f6-f425-4a6c-9da7-e59e629eee65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:32.729759 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161730f6-f425-4a6c-9da7-e59e629eee65 admin admin] PATH_INFO: `/v3/projects/404765d8faef451481c8c622c2d0df03/users/abd0ea1791b14720a5eacded168fe749/roles/86273ff072f3438d822e870272491768` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:32.731813 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161730f6-f425-4a6c-9da7-e59e629eee65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=404765d8faef451481c8c622c2d0df03, user_id=abd0ea1791b14720a5eacded168fe749, role_id=86273ff072f3438d822e870272491768)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:32.735227 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161730f6-f425-4a6c-9da7-e59e629eee65 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:32.747179 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1256/2493] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:12:32 2022] PUT /identity/v3/projects/404765d8faef451481c8c622c2d0df03/users/abd0ea1791b14720a5eacded168fe749/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:12:32.759298 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cea7af-ee89-4ef0-b006-5717c68248f6 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:32.759592 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cea7af-ee89-4ef0-b006-5717c68248f6 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:32.763296 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cea7af-ee89-4ef0-b006-5717c68248f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:32.796355 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-c0cea7af-ee89-4ef0-b006-5717c68248f6 None None] MFA Rules not processed for user `abd0ea1791b14720a5eacded168fe749`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:12:32.797574 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c0cea7af-ee89-4ef0-b006-5717c68248f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:32.867943 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1238/2494] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:12:32 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:12:32.879627 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161730f6-f425-4a6c-9da7-e59e629eee65 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:32.935892 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161730f6-f425-4a6c-9da7-e59e629eee65 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:32.940064 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4721a0-c622-46ad-824b-c7b5ab0877d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:32.940705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4721a0-c622-46ad-824b-c7b5ab0877d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:32.941001 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4721a0-c622-46ad-824b-c7b5ab0877d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:32.941281 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4721a0-c622-46ad-824b-c7b5ab0877d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:32.997439 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4721a0-c622-46ad-824b-c7b5ab0877d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:32.999100 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4721a0-c622-46ad-824b-c7b5ab0877d2 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:33.007866 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1257/2495] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:12:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 21:12:36.354687 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cea7af-ee89-4ef0-b006-5717c68248f6 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:36.364908 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cea7af-ee89-4ef0-b006-5717c68248f6 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:36.368444 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8fce3-60c5-41b4-881c-8bc0862a005a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:36.369106 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8fce3-60c5-41b4-881c-8bc0862a005a service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:36.369394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8fce3-60c5-41b4-881c-8bc0862a005a service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:36.369677 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8fce3-60c5-41b4-881c-8bc0862a005a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:36.378739 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8fce3-60c5-41b4-881c-8bc0862a005a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:36.380193 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8fce3-60c5-41b4-881c-8bc0862a005a service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:36.389574 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1239/2496] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:12:36 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:12:43.004029 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=51,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:12:44.646024 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93de5d-2101-4de9-ad6e-a51f56bc0337 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:44.646602 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93de5d-2101-4de9-ad6e-a51f56bc0337 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:44.646602 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93de5d-2101-4de9-ad6e-a51f56bc0337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:44.682844 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-df93de5d-2101-4de9-ad6e-a51f56bc0337 None None] MFA Rules not processed for user `90ea5d52fd6d4068b7837d363eebb94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:12:44.684114 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-df93de5d-2101-4de9-ad6e-a51f56bc0337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:44.753171 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1258/2497] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Jul 11 21:12:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:12:44.908366 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8fce3-60c5-41b4-881c-8bc0862a005a service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:44.909777 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-62e8fce3-60c5-41b4-881c-8bc0862a005a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:44.915021 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:12:44.984685 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8fce3-60c5-41b4-881c-8bc0862a005a service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:44.985626 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be651d6-5e67-4690-8955-090d8675349b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc950dfb1d3b4308a33f3d430fe34c1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:44.986342 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be651d6-5e67-4690-8955-090d8675349b service swift] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:44.986627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be651d6-5e67-4690-8955-090d8675349b service swift] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:44.986906 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be651d6-5e67-4690-8955-090d8675349b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:44.995233 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be651d6-5e67-4690-8955-090d8675349b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:44.996829 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be651d6-5e67-4690-8955-090d8675349b service swift] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:45.004813 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1240/2498] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jul 11 21:12:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 21:12:46.485025 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93de5d-2101-4de9-ad6e-a51f56bc0337 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:46.487215 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-df93de5d-2101-4de9-ad6e-a51f56bc0337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:46.588250 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93de5d-2101-4de9-ad6e-a51f56bc0337 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:46.595229 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29d21d-fe35-4ca6-9963-8fd1735ed443 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:46.596312 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29d21d-fe35-4ca6-9963-8fd1735ed443 service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:46.596819 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29d21d-fe35-4ca6-9963-8fd1735ed443 service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:46.597309 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29d21d-fe35-4ca6-9963-8fd1735ed443 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:46.599451 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-ba29d21d-fe35-4ca6-9963-8fd1735ed443 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:46.616771 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba29d21d-fe35-4ca6-9963-8fd1735ed443 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:46.618413 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba29d21d-fe35-4ca6-9963-8fd1735ed443 service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:46.631296 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1259/2499] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:12:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:12:51.338431 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be651d6-5e67-4690-8955-090d8675349b service swift] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:51.339903 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-1be651d6-5e67-4690-8955-090d8675349b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:51.406745 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be651d6-5e67-4690-8955-090d8675349b service swift] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:51.411556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20137a6-4f2c-4303-9cc3-c248df63039e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:51.412471 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20137a6-4f2c-4303-9cc3-c248df63039e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:51.412806 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20137a6-4f2c-4303-9cc3-c248df63039e admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:51.413082 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20137a6-4f2c-4303-9cc3-c248df63039e admin admin] PATH_INFO: `/v3/users/e6c938b42ff043b992aa928adc9038c1` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:51.414286 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20137a6-4f2c-4303-9cc3-c248df63039e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6c938b42ff043b992aa928adc9038c1)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:51.416370 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20137a6-4f2c-4303-9cc3-c248df63039e admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:51.581568 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29d21d-fe35-4ca6-9963-8fd1735ed443 service nova] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:51.593144 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29d21d-fe35-4ca6-9963-8fd1735ed443 service nova] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:51.599281 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a818c60-7374-41ab-9bee-48dbfd3da6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:51.600376 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a818c60-7374-41ab-9bee-48dbfd3da6c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:51.600893 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a818c60-7374-41ab-9bee-48dbfd3da6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:51.601271 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a818c60-7374-41ab-9bee-48dbfd3da6c6 admin admin] PATH_INFO: `/v3/users/bbf6bb607547460fa2496336a54cf9e4` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:51.607765 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a818c60-7374-41ab-9bee-48dbfd3da6c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbf6bb607547460fa2496336a54cf9e4)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:51.610848 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a818c60-7374-41ab-9bee-48dbfd3da6c6 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:51.647446 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-a20137a6-4f2c-4303-9cc3-c248df63039e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6c938b42ff043b992aa928adc9038c1'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:51.673915 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-a20137a6-4f2c-4303-9cc3-c248df63039e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6c938b42ff043b992aa928adc9038c1'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:51.674971 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-a20137a6-4f2c-4303-9cc3-c248df63039e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6c938b42ff043b992aa928adc9038c1'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:51.675826 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-a20137a6-4f2c-4303-9cc3-c248df63039e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6c938b42ff043b992aa928adc9038c1'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:51.758783 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-a20137a6-4f2c-4303-9cc3-c248df63039e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6c938b42ff043b992aa928adc9038c1'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:51.789078 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1241/2500] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:12:51 2022] DELETE /identity/v3/users/e6c938b42ff043b992aa928adc9038c1 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:12:51.795249 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc33216-f795-427a-aca8-01df5cacd269 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:51.799570 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc33216-f795-427a-aca8-01df5cacd269 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:51.800505 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc33216-f795-427a-aca8-01df5cacd269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:51.825034 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-2a818c60-7374-41ab-9bee-48dbfd3da6c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbf6bb607547460fa2496336a54cf9e4'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:51.843140 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-2a818c60-7374-41ab-9bee-48dbfd3da6c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbf6bb607547460fa2496336a54cf9e4'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:51.844794 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-2a818c60-7374-41ab-9bee-48dbfd3da6c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbf6bb607547460fa2496336a54cf9e4'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:51.849133 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-efc33216-f795-427a-aca8-01df5cacd269 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:12:51.849628 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-2a818c60-7374-41ab-9bee-48dbfd3da6c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbf6bb607547460fa2496336a54cf9e4'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:51.854527 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-efc33216-f795-427a-aca8-01df5cacd269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:51.866303 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:12:51.923177 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-2a818c60-7374-41ab-9bee-48dbfd3da6c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbf6bb607547460fa2496336a54cf9e4'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:51.935873 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:12:51.948800 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1242/2501] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:12:51.949023 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1260/2502] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:12:51 2022] DELETE /identity/v3/users/bbf6bb607547460fa2496336a54cf9e4 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:12:51.953253 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0582db-43a8-43d4-ba4b-85b7061d4120 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:51.953960 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0582db-43a8-43d4-ba4b-85b7061d4120 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:51.954463 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0582db-43a8-43d4-ba4b-85b7061d4120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:51.956697 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a818c60-7374-41ab-9bee-48dbfd3da6c6 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:51.958525 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-2a818c60-7374-41ab-9bee-48dbfd3da6c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:51.975547 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-3c0582db-43a8-43d4-ba4b-85b7061d4120 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:12:51.976953 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-3c0582db-43a8-43d4-ba4b-85b7061d4120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:52.044352 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a818c60-7374-41ab-9bee-48dbfd3da6c6 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:52.045424 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1243/2503] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:12:52.054883 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee04e6b-64b8-4bfc-8c2d-c813a2e5adef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:52.055541 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0582db-43a8-43d4-ba4b-85b7061d4120 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:52.055730 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee04e6b-64b8-4bfc-8c2d-c813a2e5adef service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:52.056078 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee04e6b-64b8-4bfc-8c2d-c813a2e5adef service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:52.056366 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee04e6b-64b8-4bfc-8c2d-c813a2e5adef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:52.057336 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-3c0582db-43a8-43d4-ba4b-85b7061d4120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:52.069537 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee04e6b-64b8-4bfc-8c2d-c813a2e5adef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:52.071904 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee04e6b-64b8-4bfc-8c2d-c813a2e5adef service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:52.078419 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0582db-43a8-43d4-ba4b-85b7061d4120 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:52.078419 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b823b16-6f27-4644-8a71-42ffc12e4ed2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:52.078419 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b823b16-6f27-4644-8a71-42ffc12e4ed2 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:52.078953 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b823b16-6f27-4644-8a71-42ffc12e4ed2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:52.079055 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b823b16-6f27-4644-8a71-42ffc12e4ed2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:52.091724 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b823b16-6f27-4644-8a71-42ffc12e4ed2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:52.091724 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b823b16-6f27-4644-8a71-42ffc12e4ed2 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:52.092123 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1261/2504] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:12:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:12:52.104817 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1244/2505] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:12:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 21:12:52.643235 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee04e6b-64b8-4bfc-8c2d-c813a2e5adef service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:52.649250 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-3ee04e6b-64b8-4bfc-8c2d-c813a2e5adef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:52.668043 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b823b16-6f27-4644-8a71-42ffc12e4ed2 service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:52.670008 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-7b823b16-6f27-4644-8a71-42ffc12e4ed2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:52.690498 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b823b16-6f27-4644-8a71-42ffc12e4ed2 service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:52.693260 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee04e6b-64b8-4bfc-8c2d-c813a2e5adef service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:52.698925 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a3eb5-dc7b-4d90-b35d-29a8043ade88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:52.699935 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a3eb5-dc7b-4d90-b35d-29a8043ade88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:52.700384 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a3eb5-dc7b-4d90-b35d-29a8043ade88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:52.700732 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a3eb5-dc7b-4d90-b35d-29a8043ade88 admin admin] PATH_INFO: `/v3/projects/adda03f88c7d40979007bdd9cd756264` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:52.702290 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a3eb5-dc7b-4d90-b35d-29a8043ade88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adda03f88c7d40979007bdd9cd756264)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:52.704936 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a3eb5-dc7b-4d90-b35d-29a8043ade88 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:52.717250 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e77f2b-76a1-4753-96e9-17726e305467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:52.718610 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e77f2b-76a1-4753-96e9-17726e305467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:52.719269 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e77f2b-76a1-4753-96e9-17726e305467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:52.720315 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e77f2b-76a1-4753-96e9-17726e305467 admin admin] PATH_INFO: `/v3/projects/3695aab9b7554b3188d6f9b1ddb0bd88` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:52.722768 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e77f2b-76a1-4753-96e9-17726e305467 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3695aab9b7554b3188d6f9b1ddb0bd88)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:52.725313 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e77f2b-76a1-4753-96e9-17726e305467 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:52.853270 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a0e77f2b-76a1-4753-96e9-17726e305467 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3695aab9b7554b3188d6f9b1ddb0bd88', 'request_id': 'req-a0e77f2b-76a1-4753-96e9-17726e305467'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:52.855370 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-784a3eb5-dc7b-4d90-b35d-29a8043ade88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adda03f88c7d40979007bdd9cd756264', 'request_id': 'req-784a3eb5-dc7b-4d90-b35d-29a8043ade88'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:52.861401 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a0e77f2b-76a1-4753-96e9-17726e305467 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3695aab9b7554b3188d6f9b1ddb0bd88', 'request_id': 'req-a0e77f2b-76a1-4753-96e9-17726e305467'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:52.866336 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-784a3eb5-dc7b-4d90-b35d-29a8043ade88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adda03f88c7d40979007bdd9cd756264', 'request_id': 'req-784a3eb5-dc7b-4d90-b35d-29a8043ade88'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:52.872636 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a0e77f2b-76a1-4753-96e9-17726e305467 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3695aab9b7554b3188d6f9b1ddb0bd88', 'request_id': 'req-a0e77f2b-76a1-4753-96e9-17726e305467'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:52.877766 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-784a3eb5-dc7b-4d90-b35d-29a8043ade88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adda03f88c7d40979007bdd9cd756264', 'request_id': 'req-784a3eb5-dc7b-4d90-b35d-29a8043ade88'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:52.991428 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a0e77f2b-76a1-4753-96e9-17726e305467 admin admin] The token cache is being invalidate because project 3695aab9b7554b3188d6f9b1ddb0bd88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:12:52.991775 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a0e77f2b-76a1-4753-96e9-17726e305467 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:52.992431 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a0e77f2b-76a1-4753-96e9-17726e305467 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:52.994077 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1262/2506] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:12:52 2022] DELETE /identity/v3/projects/3695aab9b7554b3188d6f9b1ddb0bd88 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:12:52.997892 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e77f2b-76a1-4753-96e9-17726e305467 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:52.999450 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a0e77f2b-76a1-4753-96e9-17726e305467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:53.058406 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-784a3eb5-dc7b-4d90-b35d-29a8043ade88 admin admin] The token cache is being invalidate because project adda03f88c7d40979007bdd9cd756264 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:12:53.058921 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-784a3eb5-dc7b-4d90-b35d-29a8043ade88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:53.060939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-784a3eb5-dc7b-4d90-b35d-29a8043ade88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:53.066386 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1245/2507] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:12:52 2022] DELETE /identity/v3/projects/adda03f88c7d40979007bdd9cd756264 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:12:53.068524 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a3eb5-dc7b-4d90-b35d-29a8043ade88 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:53.071380 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-784a3eb5-dc7b-4d90-b35d-29a8043ade88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:53.123155 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:12:53.166209 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e77f2b-76a1-4753-96e9-17726e305467 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:53.180394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a3eb5-dc7b-4d90-b35d-29a8043ade88 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:53.186703 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1059d7b-2378-4902-913a-3076e48503e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:53.188819 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1059d7b-2378-4902-913a-3076e48503e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:53.191941 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1059d7b-2378-4902-913a-3076e48503e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:53.191941 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1059d7b-2378-4902-913a-3076e48503e9 admin admin] PATH_INFO: `/v3/users/abd0ea1791b14720a5eacded168fe749` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:53.191941 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1059d7b-2378-4902-913a-3076e48503e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abd0ea1791b14720a5eacded168fe749)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:53.193361 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1059d7b-2378-4902-913a-3076e48503e9 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:53.204458 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:12:53.247043 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afcfc98-f602-4018-9b82-1ad688520abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:53.247929 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afcfc98-f602-4018-9b82-1ad688520abf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:53.248253 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afcfc98-f602-4018-9b82-1ad688520abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:53.248535 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afcfc98-f602-4018-9b82-1ad688520abf admin admin] PATH_INFO: `/v3/users/66047c13621b4373b0bd5140a554a762` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:53.250056 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afcfc98-f602-4018-9b82-1ad688520abf admin admin] RBAC: Authorizing `identity:delete_user(user_id=66047c13621b4373b0bd5140a554a762)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:53.251955 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afcfc98-f602-4018-9b82-1ad688520abf admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:53.442394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-f1059d7b-2378-4902-913a-3076e48503e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abd0ea1791b14720a5eacded168fe749'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:53.449495 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-f1059d7b-2378-4902-913a-3076e48503e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abd0ea1791b14720a5eacded168fe749'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:53.450192 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-f1059d7b-2378-4902-913a-3076e48503e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abd0ea1791b14720a5eacded168fe749'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:53.450816 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-f1059d7b-2378-4902-913a-3076e48503e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abd0ea1791b14720a5eacded168fe749'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:53.478011 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-7afcfc98-f602-4018-9b82-1ad688520abf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66047c13621b4373b0bd5140a554a762'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:53.485825 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-7afcfc98-f602-4018-9b82-1ad688520abf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66047c13621b4373b0bd5140a554a762'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:53.487176 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-7afcfc98-f602-4018-9b82-1ad688520abf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66047c13621b4373b0bd5140a554a762'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:53.487832 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-7afcfc98-f602-4018-9b82-1ad688520abf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66047c13621b4373b0bd5140a554a762'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:53.541934 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-f1059d7b-2378-4902-913a-3076e48503e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abd0ea1791b14720a5eacded168fe749'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:53.568861 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1246/2508] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:12:53 2022] DELETE /identity/v3/users/abd0ea1791b14720a5eacded168fe749 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:12:53.597627 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-7afcfc98-f602-4018-9b82-1ad688520abf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66047c13621b4373b0bd5140a554a762'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:53.618543 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1263/2509] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:12:52 2022] DELETE /identity/v3/users/66047c13621b4373b0bd5140a554a762 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:12:54.063694 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1059d7b-2378-4902-913a-3076e48503e9 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:54.070379 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-f1059d7b-2378-4902-913a-3076e48503e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:54.130940 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afcfc98-f602-4018-9b82-1ad688520abf admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:54.132516 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-7afcfc98-f602-4018-9b82-1ad688520abf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:54.182141 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1059d7b-2378-4902-913a-3076e48503e9 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:54.235953 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afcfc98-f602-4018-9b82-1ad688520abf admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:54.241226 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae4631-1b4e-4762-8dbf-d4e7dacd71a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:54.243263 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae4631-1b4e-4762-8dbf-d4e7dacd71a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:54.243553 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae4631-1b4e-4762-8dbf-d4e7dacd71a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:54.243840 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae4631-1b4e-4762-8dbf-d4e7dacd71a1 admin admin] PATH_INFO: `/v3/projects/ae4d998c046d4540ad598be38f5ab2b6` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:54.245167 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae4631-1b4e-4762-8dbf-d4e7dacd71a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae4d998c046d4540ad598be38f5ab2b6)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:54.247094 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae4631-1b4e-4762-8dbf-d4e7dacd71a1 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:54.279990 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:12:54.298140 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579a605-db34-4a92-9e54-9452346a0b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:54.299129 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579a605-db34-4a92-9e54-9452346a0b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:54.299425 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579a605-db34-4a92-9e54-9452346a0b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:54.299701 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579a605-db34-4a92-9e54-9452346a0b12 admin admin] PATH_INFO: `/v3/projects/404765d8faef451481c8c622c2d0df03` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:54.300954 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579a605-db34-4a92-9e54-9452346a0b12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=404765d8faef451481c8c622c2d0df03)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:54.302945 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579a605-db34-4a92-9e54-9452346a0b12 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:54.417144 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:12:54.419188 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-d8ae4631-1b4e-4762-8dbf-d4e7dacd71a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae4d998c046d4540ad598be38f5ab2b6', 'request_id': 'req-d8ae4631-1b4e-4762-8dbf-d4e7dacd71a1'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:54.427460 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-d8ae4631-1b4e-4762-8dbf-d4e7dacd71a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae4d998c046d4540ad598be38f5ab2b6', 'request_id': 'req-d8ae4631-1b4e-4762-8dbf-d4e7dacd71a1'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:54.435697 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-d8ae4631-1b4e-4762-8dbf-d4e7dacd71a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae4d998c046d4540ad598be38f5ab2b6', 'request_id': 'req-d8ae4631-1b4e-4762-8dbf-d4e7dacd71a1'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:54.447945 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-6579a605-db34-4a92-9e54-9452346a0b12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '404765d8faef451481c8c622c2d0df03', 'request_id': 'req-6579a605-db34-4a92-9e54-9452346a0b12'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:54.455224 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-6579a605-db34-4a92-9e54-9452346a0b12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '404765d8faef451481c8c622c2d0df03', 'request_id': 'req-6579a605-db34-4a92-9e54-9452346a0b12'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:54.461451 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-6579a605-db34-4a92-9e54-9452346a0b12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '404765d8faef451481c8c622c2d0df03', 'request_id': 'req-6579a605-db34-4a92-9e54-9452346a0b12'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:54.552980 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-d8ae4631-1b4e-4762-8dbf-d4e7dacd71a1 admin admin] The token cache is being invalidate because project ae4d998c046d4540ad598be38f5ab2b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:12:54.553196 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-d8ae4631-1b4e-4762-8dbf-d4e7dacd71a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:54.553854 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-d8ae4631-1b4e-4762-8dbf-d4e7dacd71a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:54.555743 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1264/2510] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:12:54 2022] DELETE /identity/v3/projects/ae4d998c046d4540ad598be38f5ab2b6 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:12:54.560474 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b3631-d5b5-41bf-95b9-96681b442089 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:54.560775 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b3631-d5b5-41bf-95b9-96681b442089 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:54.561062 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b3631-d5b5-41bf-95b9-96681b442089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:54.580871 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-d34b3631-d5b5-41bf-95b9-96681b442089 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:12:54.582174 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-d34b3631-d5b5-41bf-95b9-96681b442089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:54.646395 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-6579a605-db34-4a92-9e54-9452346a0b12 admin admin] The token cache is being invalidate because project 404765d8faef451481c8c622c2d0df03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:12:54.646699 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-6579a605-db34-4a92-9e54-9452346a0b12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:54.647404 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-6579a605-db34-4a92-9e54-9452346a0b12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:12:54.652749 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1247/2511] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:12:54 2022] DELETE /identity/v3/projects/404765d8faef451481c8c622c2d0df03 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:12:54.652948 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1265/2512] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:12:54.660403 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b61e10-de22-4da3-8e70-8ef3534e3982 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:54.660745 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c28c7c-0a45-4ae5-bca5-ad0d6f476ef5 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:54.661059 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c28c7c-0a45-4ae5-bca5-ad0d6f476ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:54.661346 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c28c7c-0a45-4ae5-bca5-ad0d6f476ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:54.661764 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b61e10-de22-4da3-8e70-8ef3534e3982 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:54.662263 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b61e10-de22-4da3-8e70-8ef3534e3982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:54.683418 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-b2c28c7c-0a45-4ae5-bca5-ad0d6f476ef5 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:12:54.684693 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b2c28c7c-0a45-4ae5-bca5-ad0d6f476ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:54.685091 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-95b61e10-de22-4da3-8e70-8ef3534e3982 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:12:54.686341 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-95b61e10-de22-4da3-8e70-8ef3534e3982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:54.694612 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1248/2513] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:12:54.695214 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1266/2514] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:12:54.706426 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c28c7c-0a45-4ae5-bca5-ad0d6f476ef5 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:54.707075 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a8c9d-1d91-4187-8d05-d535acab0c19 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:54.707450 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a8c9d-1d91-4187-8d05-d535acab0c19 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:54.708387 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a8c9d-1d91-4187-8d05-d535acab0c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:54.717742 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c28c7c-0a45-4ae5-bca5-ad0d6f476ef5 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:54.723540 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f838683-002e-4187-b5f3-d4a12fdd98d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:54.724272 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f838683-002e-4187-b5f3-d4a12fdd98d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:54.724568 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f838683-002e-4187-b5f3-d4a12fdd98d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:54.724854 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f838683-002e-4187-b5f3-d4a12fdd98d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:54.725628 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f838683-002e-4187-b5f3-d4a12fdd98d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:12:54.725946 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f838683-002e-4187-b5f3-d4a12fdd98d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:54.727562 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f838683-002e-4187-b5f3-d4a12fdd98d4 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:54.729301 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-687a8c9d-1d91-4187-8d05-d535acab0c19 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:12:54.730515 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-687a8c9d-1d91-4187-8d05-d535acab0c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:54.739187 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1267/2515] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:12:54.741111 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1249/2516] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:12:54.744555 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a8c9d-1d91-4187-8d05-d535acab0c19 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:54.745154 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f838683-002e-4187-b5f3-d4a12fdd98d4 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:54.755169 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a8c9d-1d91-4187-8d05-d535acab0c19 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:54.756096 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f838683-002e-4187-b5f3-d4a12fdd98d4 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:54.760676 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4db2a2-5713-48f3-8129-1a0b8c4a54d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:54.760972 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17662d-36cb-49df-b697-f2c741b55071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:54.761484 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4db2a2-5713-48f3-8129-1a0b8c4a54d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:54.761677 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17662d-36cb-49df-b697-f2c741b55071 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:54.761806 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4db2a2-5713-48f3-8129-1a0b8c4a54d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:54.761926 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17662d-36cb-49df-b697-f2c741b55071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:54.762138 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4db2a2-5713-48f3-8129-1a0b8c4a54d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:54.762252 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17662d-36cb-49df-b697-f2c741b55071 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:54.763015 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c17662d-36cb-49df-b697-f2c741b55071 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:54.763149 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4db2a2-5713-48f3-8129-1a0b8c4a54d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:12:54.763312 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4db2a2-5713-48f3-8129-1a0b8c4a54d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:54.764904 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c17662d-36cb-49df-b697-f2c741b55071 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:54.765822 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4db2a2-5713-48f3-8129-1a0b8c4a54d0 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:54.779590 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1268/2517] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:12:54.785424 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4db2a2-5713-48f3-8129-1a0b8c4a54d0 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:54.796009 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4db2a2-5713-48f3-8129-1a0b8c4a54d0 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:54.800978 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf07a1-fcc7-40fe-b051-f355e766bc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:54.801651 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf07a1-fcc7-40fe-b051-f355e766bc6a admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:54.801944 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf07a1-fcc7-40fe-b051-f355e766bc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:54.802224 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf07a1-fcc7-40fe-b051-f355e766bc6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:54.802910 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf07a1-fcc7-40fe-b051-f355e766bc6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:54.804915 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf07a1-fcc7-40fe-b051-f355e766bc6a admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:55.136306 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1250/2518] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:12:54 2022] POST /identity/v3/projects => generated 369 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 21:12:55.140899 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17662d-36cb-49df-b697-f2c741b55071 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:55.177970 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1269/2519] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:12:54 2022] POST /identity/v3/projects => generated 381 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 21:12:55.182164 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf07a1-fcc7-40fe-b051-f355e766bc6a admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:55.232068 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17662d-36cb-49df-b697-f2c741b55071 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:55.252989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf07a1-fcc7-40fe-b051-f355e766bc6a admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:55.257625 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886d833-b256-406b-8e3f-1458b86ef643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:55.258378 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886d833-b256-406b-8e3f-1458b86ef643 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:55.258738 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886d833-b256-406b-8e3f-1458b86ef643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:55.259114 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886d833-b256-406b-8e3f-1458b86ef643 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:55.259874 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2886d833-b256-406b-8e3f-1458b86ef643 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:55.261879 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2886d833-b256-406b-8e3f-1458b86ef643 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:55.274654 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:12:55.290046 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c7964-7d0b-4172-a968-643e27efb5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:55.290731 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c7964-7d0b-4172-a968-643e27efb5b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:55.291021 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c7964-7d0b-4172-a968-643e27efb5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:55.291299 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c7964-7d0b-4172-a968-643e27efb5b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:55.292010 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c7964-7d0b-4172-a968-643e27efb5b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:55.293960 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c7964-7d0b-4172-a968-643e27efb5b0 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:55.367819 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1270/2520] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:12:55 2022] POST /identity/v3/users => generated 291 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:12:55.369005 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886d833-b256-406b-8e3f-1458b86ef643 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:55.380482 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886d833-b256-406b-8e3f-1458b86ef643 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:55.388941 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ded903-b551-49a3-a6f3-3f80081e0f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:55.389652 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ded903-b551-49a3-a6f3-3f80081e0f83 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:55.389943 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ded903-b551-49a3-a6f3-3f80081e0f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:55.390848 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ded903-b551-49a3-a6f3-3f80081e0f83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:55.391865 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ded903-b551-49a3-a6f3-3f80081e0f83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:55.404235 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ded903-b551-49a3-a6f3-3f80081e0f83 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:55.406410 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1251/2521] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:12:55 2022] POST /identity/v3/users => generated 285 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 21:12:55.407365 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c7964-7d0b-4172-a968-643e27efb5b0 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:55.426650 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c7964-7d0b-4172-a968-643e27efb5b0 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:55.431473 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a680276-de7c-4464-a244-d77f68dfeeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:55.432267 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a680276-de7c-4464-a244-d77f68dfeeef admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:55.432863 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a680276-de7c-4464-a244-d77f68dfeeef admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:55.433208 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a680276-de7c-4464-a244-d77f68dfeeef admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:55.433952 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a680276-de7c-4464-a244-d77f68dfeeef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:55.435906 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a680276-de7c-4464-a244-d77f68dfeeef admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:55.443058 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1271/2522] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 21:12:55.444377 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ded903-b551-49a3-a6f3-3f80081e0f83 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:55.449173 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1252/2523] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:12:55.457229 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a680276-de7c-4464-a244-d77f68dfeeef admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:55.467065 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ded903-b551-49a3-a6f3-3f80081e0f83 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:55.474112 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a680276-de7c-4464-a244-d77f68dfeeef admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:55.479492 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8779f-8731-45fa-b288-412be43bb6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:55.480604 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8779f-8731-45fa-b288-412be43bb6da admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:55.480991 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8779f-8731-45fa-b288-412be43bb6da admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:55.481355 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8779f-8731-45fa-b288-412be43bb6da admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:55.482326 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8779f-8731-45fa-b288-412be43bb6da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:55.484530 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8779f-8731-45fa-b288-412be43bb6da admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:55.493922 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d67a2-f4aa-4aae-9ebc-9d5ac5c59c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:55.494634 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d67a2-f4aa-4aae-9ebc-9d5ac5c59c4f admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:55.494935 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d67a2-f4aa-4aae-9ebc-9d5ac5c59c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:55.495225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d67a2-f4aa-4aae-9ebc-9d5ac5c59c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:55.495997 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d67a2-f4aa-4aae-9ebc-9d5ac5c59c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:55.498728 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d67a2-f4aa-4aae-9ebc-9d5ac5c59c4f admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:55.501020 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:12:55.502282 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1253/2524] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 21:12:55.505442 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8779f-8731-45fa-b288-412be43bb6da admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:55.518758 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8779f-8731-45fa-b288-412be43bb6da admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:55.524358 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7a5cc-e8a7-4110-8b9d-7451ab425dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:55.525491 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7a5cc-e8a7-4110-8b9d-7451ab425dcd admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:55.525941 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7a5cc-e8a7-4110-8b9d-7451ab425dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:55.526387 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7a5cc-e8a7-4110-8b9d-7451ab425dcd admin admin] PATH_INFO: `/v3/projects/b0e7b9ab6c0c40aabb3b3a31c475560c/users/74a4a07f70aa420ab2f8f7822f6af824/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:55.537109 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1272/2525] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:12:55.538060 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d67a2-f4aa-4aae-9ebc-9d5ac5c59c4f admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:55.550238 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7a5cc-e8a7-4110-8b9d-7451ab425dcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0e7b9ab6c0c40aabb3b3a31c475560c, user_id=74a4a07f70aa420ab2f8f7822f6af824, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:55.554010 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7a5cc-e8a7-4110-8b9d-7451ab425dcd admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:55.559616 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d67a2-f4aa-4aae-9ebc-9d5ac5c59c4f admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:55.579151 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43bae07-5deb-491f-82f5-da739f0908f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:55.580104 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bae07-5deb-491f-82f5-da739f0908f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:55.580403 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bae07-5deb-491f-82f5-da739f0908f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:55.580689 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bae07-5deb-491f-82f5-da739f0908f5 admin admin] PATH_INFO: `/v3/projects/bdf19bcbc6b9461284f9c87593f72399/users/5dc1bd1ac41a4d07922522e3476c1696/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:55.598641 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43bae07-5deb-491f-82f5-da739f0908f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdf19bcbc6b9461284f9c87593f72399, user_id=5dc1bd1ac41a4d07922522e3476c1696, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:55.601501 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43bae07-5deb-491f-82f5-da739f0908f5 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:55.673266 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1254/2526] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:12:55 2022] PUT /identity/v3/projects/b0e7b9ab6c0c40aabb3b3a31c475560c/users/74a4a07f70aa420ab2f8f7822f6af824/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:12:55.684644 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7d0a7-c849-4567-a58d-6c75ffb73802 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:55.684835 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7d0a7-c849-4567-a58d-6c75ffb73802 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:55.685156 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7d0a7-c849-4567-a58d-6c75ffb73802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:55.705148 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1273/2527] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:12:55 2022] PUT /identity/v3/projects/bdf19bcbc6b9461284f9c87593f72399/users/5dc1bd1ac41a4d07922522e3476c1696/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:12:55.722374 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbf6e4-9316-48e8-b5f3-e84b7e1df525 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:55.722708 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbf6e4-9316-48e8-b5f3-e84b7e1df525 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:55.722975 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbf6e4-9316-48e8-b5f3-e84b7e1df525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:55.726652 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-30c7d0a7-c849-4567-a58d-6c75ffb73802 None None] MFA Rules not processed for user `74a4a07f70aa420ab2f8f7822f6af824`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:12:55.728145 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-30c7d0a7-c849-4567-a58d-6c75ffb73802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:55.753681 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-04bbf6e4-9316-48e8-b5f3-e84b7e1df525 None None] MFA Rules not processed for user `5dc1bd1ac41a4d07922522e3476c1696`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:12:55.754938 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-04bbf6e4-9316-48e8-b5f3-e84b7e1df525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:55.837509 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1255/2528] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:12:55 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:12:55.844140 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7d0a7-c849-4567-a58d-6c75ffb73802 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:55.850710 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1274/2529] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:12:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:12:55.855549 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bbf6e4-9316-48e8-b5f3-e84b7e1df525 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:55.919777 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7d0a7-c849-4567-a58d-6c75ffb73802 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:55.924945 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8aa10-a5d6-4fea-b0a5-77763fbd80c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:55.925617 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8aa10-a5d6-4fea-b0a5-77763fbd80c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:55.925905 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8aa10-a5d6-4fea-b0a5-77763fbd80c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:55.926185 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8aa10-a5d6-4fea-b0a5-77763fbd80c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:55.927629 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece8aa10-a5d6-4fea-b0a5-77763fbd80c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:55.929812 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece8aa10-a5d6-4fea-b0a5-77763fbd80c6 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:55.934757 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bbf6e4-9316-48e8-b5f3-e84b7e1df525 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:55.941460 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0bc1e9-6226-48f4-80e7-2e99f2a0c8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:55.942281 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bc1e9-6226-48f4-80e7-2e99f2a0c8d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:55.942776 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bc1e9-6226-48f4-80e7-2e99f2a0c8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:55.943160 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bc1e9-6226-48f4-80e7-2e99f2a0c8d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:55.943985 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0bc1e9-6226-48f4-80e7-2e99f2a0c8d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:55.946351 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0bc1e9-6226-48f4-80e7-2e99f2a0c8d2 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:56.024658 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1256/2530] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:12:55 2022] POST /identity/v3/projects => generated 369 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:12:56.029515 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8aa10-a5d6-4fea-b0a5-77763fbd80c6 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:56.034379 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:12:56.103840 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8aa10-a5d6-4fea-b0a5-77763fbd80c6 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:56.111543 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1275/2531] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:12:55 2022] POST /identity/v3/projects => generated 383 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:12:56.111708 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7f972-b954-46a9-a0a6-aea7b7c482c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:56.111708 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7f972-b954-46a9-a0a6-aea7b7c482c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:56.111708 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7f972-b954-46a9-a0a6-aea7b7c482c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:56.111708 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7f972-b954-46a9-a0a6-aea7b7c482c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:56.112116 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d7f972-b954-46a9-a0a6-aea7b7c482c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:56.112574 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0bc1e9-6226-48f4-80e7-2e99f2a0c8d2 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:56.112745 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d7f972-b954-46a9-a0a6-aea7b7c482c8 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:56.161852 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:12:56.177780 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0bc1e9-6226-48f4-80e7-2e99f2a0c8d2 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:56.180879 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcecc725-cb4e-4a77-ae23-b570aa497af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:56.181550 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcecc725-cb4e-4a77-ae23-b570aa497af9 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:56.181838 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcecc725-cb4e-4a77-ae23-b570aa497af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:56.182118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcecc725-cb4e-4a77-ae23-b570aa497af9 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:56.182802 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcecc725-cb4e-4a77-ae23-b570aa497af9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:56.184742 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcecc725-cb4e-4a77-ae23-b570aa497af9 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:56.209244 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1257/2532] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:12:56 2022] POST /identity/v3/users => generated 291 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 21:12:56.210530 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7f972-b954-46a9-a0a6-aea7b7c482c8 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:56.221457 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7f972-b954-46a9-a0a6-aea7b7c482c8 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:56.227268 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e39c9-7a91-4f00-912c-14c90b3be08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:56.227957 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e39c9-7a91-4f00-912c-14c90b3be08d admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:56.229478 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e39c9-7a91-4f00-912c-14c90b3be08d admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:56.229478 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e39c9-7a91-4f00-912c-14c90b3be08d admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:56.229478 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e39c9-7a91-4f00-912c-14c90b3be08d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:56.230845 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e39c9-7a91-4f00-912c-14c90b3be08d admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:56.241224 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1258/2533] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:12:56.245011 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e39c9-7a91-4f00-912c-14c90b3be08d admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:56.254499 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e39c9-7a91-4f00-912c-14c90b3be08d admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:56.259049 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22fa3f7-eb5a-460e-ae5f-30fbdaff883f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:56.259889 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fa3f7-eb5a-460e-ae5f-30fbdaff883f admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:56.260212 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fa3f7-eb5a-460e-ae5f-30fbdaff883f admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:56.260493 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fa3f7-eb5a-460e-ae5f-30fbdaff883f admin admin] PATH_INFO: `/v3/projects/4607428c713341488c71ea0b5e1a0f4f/users/791882a7707f423288f5361687f67691/roles/86273ff072f3438d822e870272491768` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:56.276564 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22fa3f7-eb5a-460e-ae5f-30fbdaff883f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4607428c713341488c71ea0b5e1a0f4f, user_id=791882a7707f423288f5361687f67691, role_id=86273ff072f3438d822e870272491768)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:56.279150 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22fa3f7-eb5a-460e-ae5f-30fbdaff883f admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:56.300513 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1276/2534] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:12:56 2022] POST /identity/v3/users => generated 298 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:12:56.304346 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcecc725-cb4e-4a77-ae23-b570aa497af9 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:56.314559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcecc725-cb4e-4a77-ae23-b570aa497af9 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:56.319368 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ba541-595c-4a0d-bcab-ffc5d7c2f352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:56.320951 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ba541-595c-4a0d-bcab-ffc5d7c2f352 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:56.320951 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ba541-595c-4a0d-bcab-ffc5d7c2f352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:56.320951 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ba541-595c-4a0d-bcab-ffc5d7c2f352 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:56.321484 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ba541-595c-4a0d-bcab-ffc5d7c2f352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:56.323088 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ba541-595c-4a0d-bcab-ffc5d7c2f352 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:56.335151 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1277/2535] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 21:12:56.339392 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ba541-595c-4a0d-bcab-ffc5d7c2f352 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:56.350717 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ba541-595c-4a0d-bcab-ffc5d7c2f352 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:56.355490 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71abbeb-2b43-45ee-bff6-b8ea2e8db04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:56.356530 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71abbeb-2b43-45ee-bff6-b8ea2e8db04b admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:56.356828 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71abbeb-2b43-45ee-bff6-b8ea2e8db04b admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:56.357102 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71abbeb-2b43-45ee-bff6-b8ea2e8db04b admin admin] PATH_INFO: `/v3/projects/7aaac73ec7c44804822f7f67c51cb519/users/021441eafaf64be4a1704f37d2a2103b/roles/86273ff072f3438d822e870272491768` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:56.373389 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71abbeb-2b43-45ee-bff6-b8ea2e8db04b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aaac73ec7c44804822f7f67c51cb519, user_id=021441eafaf64be4a1704f37d2a2103b, role_id=86273ff072f3438d822e870272491768)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:56.376343 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71abbeb-2b43-45ee-bff6-b8ea2e8db04b admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:56.398239 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1259/2536] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:12:56 2022] PUT /identity/v3/projects/4607428c713341488c71ea0b5e1a0f4f/users/791882a7707f423288f5361687f67691/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:12:56.402033 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22fa3f7-eb5a-460e-ae5f-30fbdaff883f admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:56.462570 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22fa3f7-eb5a-460e-ae5f-30fbdaff883f admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:56.466578 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1278/2537] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:12:56 2022] PUT /identity/v3/projects/7aaac73ec7c44804822f7f67c51cb519/users/021441eafaf64be4a1704f37d2a2103b/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:12:56.470949 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71abbeb-2b43-45ee-bff6-b8ea2e8db04b admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:56.523673 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0bfdcd-4d45-4193-8735-1155f2454fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:56.524753 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bfdcd-4d45-4193-8735-1155f2454fea admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:56.525042 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bfdcd-4d45-4193-8735-1155f2454fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:56.525327 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bfdcd-4d45-4193-8735-1155f2454fea admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:56.526139 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0bfdcd-4d45-4193-8735-1155f2454fea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:56.527638 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0bfdcd-4d45-4193-8735-1155f2454fea admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:56.533806 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:12:56.538939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1260/2538] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:12:56.542880 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0bfdcd-4d45-4193-8735-1155f2454fea admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:56.552458 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0bfdcd-4d45-4193-8735-1155f2454fea admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:56.553065 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71abbeb-2b43-45ee-bff6-b8ea2e8db04b admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:56.557552 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622d75d-1861-40cc-aa57-46a997374aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:56.557757 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2380f6-96da-4f06-83b1-e9fd0eea1b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:56.558428 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2380f6-96da-4f06-83b1-e9fd0eea1b8a admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:56.558619 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622d75d-1861-40cc-aa57-46a997374aa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:56.558757 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2380f6-96da-4f06-83b1-e9fd0eea1b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:56.558915 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622d75d-1861-40cc-aa57-46a997374aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:56.559030 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2380f6-96da-4f06-83b1-e9fd0eea1b8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:56.559198 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622d75d-1861-40cc-aa57-46a997374aa7 admin admin] PATH_INFO: `/v3/projects/4607428c713341488c71ea0b5e1a0f4f/users/791882a7707f423288f5361687f67691/roles/86273ff072f3438d822e870272491768` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:56.559693 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2380f6-96da-4f06-83b1-e9fd0eea1b8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:56.561234 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622d75d-1861-40cc-aa57-46a997374aa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4607428c713341488c71ea0b5e1a0f4f, user_id=791882a7707f423288f5361687f67691, role_id=86273ff072f3438d822e870272491768)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:56.561362 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2380f6-96da-4f06-83b1-e9fd0eea1b8a admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:56.564644 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622d75d-1861-40cc-aa57-46a997374aa7 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:56.572278 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1279/2539] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 21:12:56.576005 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1261/2540] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:12:56 2022] PUT /identity/v3/projects/4607428c713341488c71ea0b5e1a0f4f/users/791882a7707f423288f5361687f67691/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:12:56.581298 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2380f6-96da-4f06-83b1-e9fd0eea1b8a admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:56.586344 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2380f6-96da-4f06-83b1-e9fd0eea1b8a admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:56.590341 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511c0f8-b138-434e-80c9-b4d9c5a410e6 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:56.590701 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511c0f8-b138-434e-80c9-b4d9c5a410e6 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:56.591078 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511c0f8-b138-434e-80c9-b4d9c5a410e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:56.616930 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-1511c0f8-b138-434e-80c9-b4d9c5a410e6 None None] MFA Rules not processed for user `791882a7707f423288f5361687f67691`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:12:56.618825 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-1511c0f8-b138-434e-80c9-b4d9c5a410e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:56.652094 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081824e8-8545-4945-8bee-7738c68778c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:56.653269 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081824e8-8545-4945-8bee-7738c68778c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:56.654118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081824e8-8545-4945-8bee-7738c68778c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:56.654411 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081824e8-8545-4945-8bee-7738c68778c4 admin admin] PATH_INFO: `/v3/projects/7aaac73ec7c44804822f7f67c51cb519/users/021441eafaf64be4a1704f37d2a2103b/roles/86273ff072f3438d822e870272491768` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:56.656718 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081824e8-8545-4945-8bee-7738c68778c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aaac73ec7c44804822f7f67c51cb519, user_id=021441eafaf64be4a1704f37d2a2103b, role_id=86273ff072f3438d822e870272491768)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:56.659787 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081824e8-8545-4945-8bee-7738c68778c4 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:56.675990 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1280/2541] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:12:56 2022] PUT /identity/v3/projects/7aaac73ec7c44804822f7f67c51cb519/users/021441eafaf64be4a1704f37d2a2103b/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:12:56.685809 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ebdeb-cb5b-4caa-b98c-9f5bb078d296 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:56.686104 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ebdeb-cb5b-4caa-b98c-9f5bb078d296 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:56.686387 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ebdeb-cb5b-4caa-b98c-9f5bb078d296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:56.709314 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1262/2542] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:12:56 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:12:56.717748 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-970ebdeb-cb5b-4caa-b98c-9f5bb078d296 None None] MFA Rules not processed for user `021441eafaf64be4a1704f37d2a2103b`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:12:56.719498 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-970ebdeb-cb5b-4caa-b98c-9f5bb078d296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:56.720519 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511c0f8-b138-434e-80c9-b4d9c5a410e6 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:56.722050 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-1511c0f8-b138-434e-80c9-b4d9c5a410e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:56.739448 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:12:56.790953 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511c0f8-b138-434e-80c9-b4d9c5a410e6 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:56.799952 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1281/2543] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:12:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:12:56.813382 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ebdeb-cb5b-4caa-b98c-9f5bb078d296 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:56.814826 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-970ebdeb-cb5b-4caa-b98c-9f5bb078d296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:12:56.861553 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739e95b-4dcd-45ac-8b7b-aa77f4aa3317 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:56.862218 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739e95b-4dcd-45ac-8b7b-aa77f4aa3317 service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:56.862509 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739e95b-4dcd-45ac-8b7b-aa77f4aa3317 service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:56.862788 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739e95b-4dcd-45ac-8b7b-aa77f4aa3317 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:56.874039 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ebdeb-cb5b-4caa-b98c-9f5bb078d296 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:56.878215 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769cdc2-5f03-4c13-bfca-0138869f5a2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:56.878863 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769cdc2-5f03-4c13-bfca-0138869f5a2a service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:56.879152 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769cdc2-5f03-4c13-bfca-0138869f5a2a service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:56.879434 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769cdc2-5f03-4c13-bfca-0138869f5a2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:56.889381 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0769cdc2-5f03-4c13-bfca-0138869f5a2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:56.890964 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0769cdc2-5f03-4c13-bfca-0138869f5a2a service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:56.901365 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1282/2544] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:12:56 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:12:56.913749 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:12:56.939941 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9739e95b-4dcd-45ac-8b7b-aa77f4aa3317 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:56.941504 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9739e95b-4dcd-45ac-8b7b-aa77f4aa3317 service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:56.951830 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1263/2545] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:12:56 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 21:12:57.003772 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769cdc2-5f03-4c13-bfca-0138869f5a2a service cinder] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:57.012776 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769cdc2-5f03-4c13-bfca-0138869f5a2a service cinder] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:57.017381 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a24b75-3c81-4fa7-8283-4313cf9d5eca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:57.018118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a24b75-3c81-4fa7-8283-4313cf9d5eca service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:57.018484 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a24b75-3c81-4fa7-8283-4313cf9d5eca service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:57.018852 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a24b75-3c81-4fa7-8283-4313cf9d5eca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:57.076139 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a24b75-3c81-4fa7-8283-4313cf9d5eca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:57.077671 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a24b75-3c81-4fa7-8283-4313cf9d5eca service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:12:57.086933 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1283/2546] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:12:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:12:59.813139 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739e95b-4dcd-45ac-8b7b-aa77f4aa3317 service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:12:59.879666 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739e95b-4dcd-45ac-8b7b-aa77f4aa3317 service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:12:59.884340 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40076bb1-9a9e-438f-aeb9-ca85b44cba9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:12:59.885261 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40076bb1-9a9e-438f-aeb9-ca85b44cba9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:12:59.885552 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40076bb1-9a9e-438f-aeb9-ca85b44cba9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:12:59.885827 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40076bb1-9a9e-438f-aeb9-ca85b44cba9c admin admin] PATH_INFO: `/v3/users/74a4a07f70aa420ab2f8f7822f6af824` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:12:59.887013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40076bb1-9a9e-438f-aeb9-ca85b44cba9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=74a4a07f70aa420ab2f8f7822f6af824)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:12:59.888951 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40076bb1-9a9e-438f-aeb9-ca85b44cba9c admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:00.050555 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-40076bb1-9a9e-438f-aeb9-ca85b44cba9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74a4a07f70aa420ab2f8f7822f6af824'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:00.057643 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-40076bb1-9a9e-438f-aeb9-ca85b44cba9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74a4a07f70aa420ab2f8f7822f6af824'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:00.058429 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-40076bb1-9a9e-438f-aeb9-ca85b44cba9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74a4a07f70aa420ab2f8f7822f6af824'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:00.059055 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-40076bb1-9a9e-438f-aeb9-ca85b44cba9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74a4a07f70aa420ab2f8f7822f6af824'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:00.122834 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-40076bb1-9a9e-438f-aeb9-ca85b44cba9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74a4a07f70aa420ab2f8f7822f6af824'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:00.141694 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1264/2547] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:12:59 2022] DELETE /identity/v3/users/74a4a07f70aa420ab2f8f7822f6af824 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:13:00.146527 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4941d6c-5af3-4c8c-9f12-3915a9197ceb None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:00.147022 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4941d6c-5af3-4c8c-9f12-3915a9197ceb None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:00.147122 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4941d6c-5af3-4c8c-9f12-3915a9197ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:00.164182 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-c4941d6c-5af3-4c8c-9f12-3915a9197ceb None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:00.165375 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-c4941d6c-5af3-4c8c-9f12-3915a9197ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:00.212403 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40076bb1-9a9e-438f-aeb9-ca85b44cba9c admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:00.213886 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-40076bb1-9a9e-438f-aeb9-ca85b44cba9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:00.216400 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:00.226254 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1284/2548] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:13:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:13:00.239764 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4941d6c-5af3-4c8c-9f12-3915a9197ceb None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:00.241494 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-c4941d6c-5af3-4c8c-9f12-3915a9197ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:00.291250 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:00.295008 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40076bb1-9a9e-438f-aeb9-ca85b44cba9c admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:00.304978 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd536072-86bf-4011-a1e5-7267e4ce5ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:00.304978 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd536072-86bf-4011-a1e5-7267e4ce5ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:00.304978 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd536072-86bf-4011-a1e5-7267e4ce5ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:00.304978 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd536072-86bf-4011-a1e5-7267e4ce5ecc admin admin] PATH_INFO: `/v3/users/5dc1bd1ac41a4d07922522e3476c1696` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:00.305486 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd536072-86bf-4011-a1e5-7267e4ce5ecc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dc1bd1ac41a4d07922522e3476c1696)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:00.305486 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd536072-86bf-4011-a1e5-7267e4ce5ecc admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:00.307301 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4941d6c-5af3-4c8c-9f12-3915a9197ceb None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:00.312546 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a5b30-5043-46ff-b98b-2217de5e6fca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:00.313286 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a5b30-5043-46ff-b98b-2217de5e6fca service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:00.313700 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a5b30-5043-46ff-b98b-2217de5e6fca service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:00.314085 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a5b30-5043-46ff-b98b-2217de5e6fca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:00.327859 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a5b30-5043-46ff-b98b-2217de5e6fca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:00.330066 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a5b30-5043-46ff-b98b-2217de5e6fca service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:00.340746 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1285/2549] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:13:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:13:00.545583 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-bd536072-86bf-4011-a1e5-7267e4ce5ecc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dc1bd1ac41a4d07922522e3476c1696'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:00.552642 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-bd536072-86bf-4011-a1e5-7267e4ce5ecc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dc1bd1ac41a4d07922522e3476c1696'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:00.553311 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-bd536072-86bf-4011-a1e5-7267e4ce5ecc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dc1bd1ac41a4d07922522e3476c1696'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:00.553906 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-bd536072-86bf-4011-a1e5-7267e4ce5ecc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dc1bd1ac41a4d07922522e3476c1696'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:00.670100 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-bd536072-86bf-4011-a1e5-7267e4ce5ecc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dc1bd1ac41a4d07922522e3476c1696'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:00.694477 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1265/2550] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:13:00 2022] DELETE /identity/v3/users/5dc1bd1ac41a4d07922522e3476c1696 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:13:00.697958 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031845c9-f3ce-4233-b358-306bc7aa4450 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:00.698340 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031845c9-f3ce-4233-b358-306bc7aa4450 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:00.698886 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031845c9-f3ce-4233-b358-306bc7aa4450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:00.717635 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-031845c9-f3ce-4233-b358-306bc7aa4450 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:00.718861 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-031845c9-f3ce-4233-b358-306bc7aa4450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:00.780561 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1286/2551] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:13:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:13:00.790038 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd536072-86bf-4011-a1e5-7267e4ce5ecc admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:00.791433 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-bd536072-86bf-4011-a1e5-7267e4ce5ecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:00.829220 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031845c9-f3ce-4233-b358-306bc7aa4450 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:00.830426 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-031845c9-f3ce-4233-b358-306bc7aa4450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:00.845799 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031845c9-f3ce-4233-b358-306bc7aa4450 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:00.851109 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd887f3a-51f9-4f42-bdb0-a0923ca43abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:00.852609 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd887f3a-51f9-4f42-bdb0-a0923ca43abd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:00.853068 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd887f3a-51f9-4f42-bdb0-a0923ca43abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:00.853358 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd887f3a-51f9-4f42-bdb0-a0923ca43abd admin admin] PATH_INFO: `/v3/projects/b0e7b9ab6c0c40aabb3b3a31c475560c` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:00.854740 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd887f3a-51f9-4f42-bdb0-a0923ca43abd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0e7b9ab6c0c40aabb3b3a31c475560c)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:00.856785 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd887f3a-51f9-4f42-bdb0-a0923ca43abd admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:00.870005 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd536072-86bf-4011-a1e5-7267e4ce5ecc admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:00.874337 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e021b170-f24e-4ddd-8ec0-29cbcf27cb31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:00.875010 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021b170-f24e-4ddd-8ec0-29cbcf27cb31 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:00.875735 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021b170-f24e-4ddd-8ec0-29cbcf27cb31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:00.876074 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021b170-f24e-4ddd-8ec0-29cbcf27cb31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:00.888103 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e021b170-f24e-4ddd-8ec0-29cbcf27cb31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:00.889564 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e021b170-f24e-4ddd-8ec0-29cbcf27cb31 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:00.899607 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1266/2552] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:13:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:13:00.974675 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-dd887f3a-51f9-4f42-bdb0-a0923ca43abd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0e7b9ab6c0c40aabb3b3a31c475560c', 'request_id': 'req-dd887f3a-51f9-4f42-bdb0-a0923ca43abd'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:00.981554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-dd887f3a-51f9-4f42-bdb0-a0923ca43abd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0e7b9ab6c0c40aabb3b3a31c475560c', 'request_id': 'req-dd887f3a-51f9-4f42-bdb0-a0923ca43abd'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:00.988252 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-dd887f3a-51f9-4f42-bdb0-a0923ca43abd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0e7b9ab6c0c40aabb3b3a31c475560c', 'request_id': 'req-dd887f3a-51f9-4f42-bdb0-a0923ca43abd'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:01.077171 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-dd887f3a-51f9-4f42-bdb0-a0923ca43abd admin admin] The token cache is being invalidate because project b0e7b9ab6c0c40aabb3b3a31c475560c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:13:01.077467 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-dd887f3a-51f9-4f42-bdb0-a0923ca43abd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:01.078108 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-dd887f3a-51f9-4f42-bdb0-a0923ca43abd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:01.082893 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1287/2553] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:13:00 2022] DELETE /identity/v3/projects/b0e7b9ab6c0c40aabb3b3a31c475560c => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:13:01.084829 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e021b170-f24e-4ddd-8ec0-29cbcf27cb31 service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:01.095399 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e021b170-f24e-4ddd-8ec0-29cbcf27cb31 service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:01.164991 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b8025-e9b9-4cf6-bbd4-c35bbaa46150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:01.165910 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b8025-e9b9-4cf6-bbd4-c35bbaa46150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:01.166194 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b8025-e9b9-4cf6-bbd4-c35bbaa46150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:01.166476 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b8025-e9b9-4cf6-bbd4-c35bbaa46150 admin admin] PATH_INFO: `/v3/users/791882a7707f423288f5361687f67691` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:01.167793 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63b8025-e9b9-4cf6-bbd4-c35bbaa46150 admin admin] RBAC: Authorizing `identity:delete_user(user_id=791882a7707f423288f5361687f67691)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:01.170025 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63b8025-e9b9-4cf6-bbd4-c35bbaa46150 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:01.195225 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:01.325385 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd887f3a-51f9-4f42-bdb0-a0923ca43abd admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:01.326893 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-dd887f3a-51f9-4f42-bdb0-a0923ca43abd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:01.341956 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd887f3a-51f9-4f42-bdb0-a0923ca43abd admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:01.347749 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21939660-143f-4ee6-b0d9-fb794e087e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:01.349180 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21939660-143f-4ee6-b0d9-fb794e087e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:01.349772 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21939660-143f-4ee6-b0d9-fb794e087e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:01.349984 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21939660-143f-4ee6-b0d9-fb794e087e24 admin admin] PATH_INFO: `/v3/projects/bdf19bcbc6b9461284f9c87593f72399` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:01.355539 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21939660-143f-4ee6-b0d9-fb794e087e24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdf19bcbc6b9461284f9c87593f72399)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:01.355539 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21939660-143f-4ee6-b0d9-fb794e087e24 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:01.377123 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:01.388750 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b63b8025-e9b9-4cf6-bbd4-c35bbaa46150 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '791882a7707f423288f5361687f67691'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:01.396553 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b63b8025-e9b9-4cf6-bbd4-c35bbaa46150 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '791882a7707f423288f5361687f67691'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:01.397227 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b63b8025-e9b9-4cf6-bbd4-c35bbaa46150 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '791882a7707f423288f5361687f67691'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:01.397843 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b63b8025-e9b9-4cf6-bbd4-c35bbaa46150 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '791882a7707f423288f5361687f67691'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:01.487153 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-21939660-143f-4ee6-b0d9-fb794e087e24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdf19bcbc6b9461284f9c87593f72399', 'request_id': 'req-21939660-143f-4ee6-b0d9-fb794e087e24'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:01.493240 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-21939660-143f-4ee6-b0d9-fb794e087e24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdf19bcbc6b9461284f9c87593f72399', 'request_id': 'req-21939660-143f-4ee6-b0d9-fb794e087e24'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:01.498147 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b63b8025-e9b9-4cf6-bbd4-c35bbaa46150 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '791882a7707f423288f5361687f67691'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:01.506991 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-21939660-143f-4ee6-b0d9-fb794e087e24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdf19bcbc6b9461284f9c87593f72399', 'request_id': 'req-21939660-143f-4ee6-b0d9-fb794e087e24'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:01.521033 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1267/2554] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:13:01 2022] DELETE /identity/v3/users/791882a7707f423288f5361687f67691 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:13:01.602835 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-21939660-143f-4ee6-b0d9-fb794e087e24 admin admin] The token cache is being invalidate because project bdf19bcbc6b9461284f9c87593f72399 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:13:01.606242 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-21939660-143f-4ee6-b0d9-fb794e087e24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:01.606242 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-21939660-143f-4ee6-b0d9-fb794e087e24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:01.606242 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1288/2555] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:13:01 2022] DELETE /identity/v3/projects/bdf19bcbc6b9461284f9c87593f72399 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:13:01.609275 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b8025-e9b9-4cf6-bbd4-c35bbaa46150 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:01.616741 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b63b8025-e9b9-4cf6-bbd4-c35bbaa46150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:01.693291 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b8025-e9b9-4cf6-bbd4-c35bbaa46150 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:01.697977 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4987d5e-333b-454b-8130-45a65801ca14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:01.698868 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4987d5e-333b-454b-8130-45a65801ca14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:01.699154 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4987d5e-333b-454b-8130-45a65801ca14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:01.699432 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4987d5e-333b-454b-8130-45a65801ca14 admin admin] PATH_INFO: `/v3/users/021441eafaf64be4a1704f37d2a2103b` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:01.700882 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4987d5e-333b-454b-8130-45a65801ca14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=021441eafaf64be4a1704f37d2a2103b)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:01.702840 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4987d5e-333b-454b-8130-45a65801ca14 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:01.942247 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21939660-143f-4ee6-b0d9-fb794e087e24 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:01.944788 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-21939660-143f-4ee6-b0d9-fb794e087e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:01.962916 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b4987d5e-333b-454b-8130-45a65801ca14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '021441eafaf64be4a1704f37d2a2103b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:01.972892 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b4987d5e-333b-454b-8130-45a65801ca14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '021441eafaf64be4a1704f37d2a2103b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:01.973481 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b4987d5e-333b-454b-8130-45a65801ca14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '021441eafaf64be4a1704f37d2a2103b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:01.974316 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b4987d5e-333b-454b-8130-45a65801ca14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '021441eafaf64be4a1704f37d2a2103b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:02.029835 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21939660-143f-4ee6-b0d9-fb794e087e24 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:02.035459 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a4f59b-f11a-4360-ad81-ce4dd21f8c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:02.035993 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4f59b-f11a-4360-ad81-ce4dd21f8c1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:02.036883 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4f59b-f11a-4360-ad81-ce4dd21f8c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:02.037217 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4f59b-f11a-4360-ad81-ce4dd21f8c1e admin admin] PATH_INFO: `/v3/projects/4607428c713341488c71ea0b5e1a0f4f` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:02.038516 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a4f59b-f11a-4360-ad81-ce4dd21f8c1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4607428c713341488c71ea0b5e1a0f4f)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:02.040465 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a4f59b-f11a-4360-ad81-ce4dd21f8c1e admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:02.046675 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-b4987d5e-333b-454b-8130-45a65801ca14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '021441eafaf64be4a1704f37d2a2103b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:02.072900 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1268/2556] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:13:01 2022] DELETE /identity/v3/users/021441eafaf64be4a1704f37d2a2103b => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:13:02.074249 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7cc8c-11eb-4cce-a824-ddab34aa9de2 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:02.074682 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7cc8c-11eb-4cce-a824-ddab34aa9de2 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:02.074965 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7cc8c-11eb-4cce-a824-ddab34aa9de2 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:02.076294 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1269/2557] 10.222.0.40 () {54 vars in 921 bytes} [Mon Jul 11 21:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 21:13:02.083410 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d7857-c429-41a6-bb77-c2d5806b74d3 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:02.083706 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d7857-c429-41a6-bb77-c2d5806b74d3 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:02.084008 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d7857-c429-41a6-bb77-c2d5806b74d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:02.103950 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-e10d7857-c429-41a6-bb77-c2d5806b74d3 None None] MFA Rules not processed for user `8ac15411c75f4bd4a86f6753c9240a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:02.105185 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-e10d7857-c429-41a6-bb77-c2d5806b74d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:02.118503 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:02.177271 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1270/2558] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Jul 11 21:13:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:13:02.178509 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-c0a4f59b-f11a-4360-ad81-ce4dd21f8c1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4607428c713341488c71ea0b5e1a0f4f', 'request_id': 'req-c0a4f59b-f11a-4360-ad81-ce4dd21f8c1e'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:02.185474 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-c0a4f59b-f11a-4360-ad81-ce4dd21f8c1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4607428c713341488c71ea0b5e1a0f4f', 'request_id': 'req-c0a4f59b-f11a-4360-ad81-ce4dd21f8c1e'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:02.189320 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d7857-c429-41a6-bb77-c2d5806b74d3 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:02.190843 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-e10d7857-c429-41a6-bb77-c2d5806b74d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:02.193636 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-c0a4f59b-f11a-4360-ad81-ce4dd21f8c1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4607428c713341488c71ea0b5e1a0f4f', 'request_id': 'req-c0a4f59b-f11a-4360-ad81-ce4dd21f8c1e'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:02.245678 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d7857-c429-41a6-bb77-c2d5806b74d3 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:02.293783 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae5cd7-1426-4023-b544-24590a3e5775 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da488c75631e4e5992304ff6c0579aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:02.294439 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae5cd7-1426-4023-b544-24590a3e5775 service glance] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:02.294724 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae5cd7-1426-4023-b544-24590a3e5775 service glance] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:02.295003 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae5cd7-1426-4023-b544-24590a3e5775 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:02.305201 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-c0a4f59b-f11a-4360-ad81-ce4dd21f8c1e admin admin] The token cache is being invalidate because project 4607428c713341488c71ea0b5e1a0f4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:13:02.305625 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-c0a4f59b-f11a-4360-ad81-ce4dd21f8c1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:02.306358 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-c0a4f59b-f11a-4360-ad81-ce4dd21f8c1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:02.308484 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1289/2559] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:13:01 2022] DELETE /identity/v3/projects/4607428c713341488c71ea0b5e1a0f4f => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:13:02.313096 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cd853-3f62-4353-b78f-6538bb228ab1 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:02.313603 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cd853-3f62-4353-b78f-6538bb228ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:02.314568 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cd853-3f62-4353-b78f-6538bb228ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:02.341645 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-2f3cd853-3f62-4353-b78f-6538bb228ab1 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:02.342867 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-2f3cd853-3f62-4353-b78f-6538bb228ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:02.371998 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae5cd7-1426-4023-b544-24590a3e5775 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:02.373431 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae5cd7-1426-4023-b544-24590a3e5775 service glance] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:02.380805 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:02.385956 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1271/2560] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:13:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 21:13:02.416114 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1290/2561] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:13:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:13:02.420283 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f608f-d6d6-49b4-8ef8-c1368359973a None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:02.420710 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f608f-d6d6-49b4-8ef8-c1368359973a None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:02.421197 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f608f-d6d6-49b4-8ef8-c1368359973a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:02.445488 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-152f608f-d6d6-49b4-8ef8-c1368359973a None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:02.445488 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-152f608f-d6d6-49b4-8ef8-c1368359973a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:02.451812 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1272/2562] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:13:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:13:02.456183 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3cd853-3f62-4353-b78f-6538bb228ab1 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:02.466133 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3cd853-3f62-4353-b78f-6538bb228ab1 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:02.472093 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba16015-108a-41ab-8aec-1797788cfef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:02.474259 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba16015-108a-41ab-8aec-1797788cfef0 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:02.474259 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba16015-108a-41ab-8aec-1797788cfef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:02.474259 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba16015-108a-41ab-8aec-1797788cfef0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:02.474259 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba16015-108a-41ab-8aec-1797788cfef0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:13:02.474743 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba16015-108a-41ab-8aec-1797788cfef0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:02.475985 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba16015-108a-41ab-8aec-1797788cfef0 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:02.488324 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1291/2563] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:13:02.492635 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f608f-d6d6-49b4-8ef8-c1368359973a None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:02.502914 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f608f-d6d6-49b4-8ef8-c1368359973a None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:02.507778 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff92795-b2ec-4e4f-abed-f3b4ed577c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:02.508482 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff92795-b2ec-4e4f-abed-f3b4ed577c93 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:02.508775 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff92795-b2ec-4e4f-abed-f3b4ed577c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:02.509058 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff92795-b2ec-4e4f-abed-f3b4ed577c93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:02.509758 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff92795-b2ec-4e4f-abed-f3b4ed577c93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:02.511742 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff92795-b2ec-4e4f-abed-f3b4ed577c93 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:02.528421 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba16015-108a-41ab-8aec-1797788cfef0 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:02.530133 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-4ba16015-108a-41ab-8aec-1797788cfef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:02.544347 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba16015-108a-41ab-8aec-1797788cfef0 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:02.551158 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3bf596-5536-44f4-9c30-faf92f433d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:02.552324 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3bf596-5536-44f4-9c30-faf92f433d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:02.552650 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3bf596-5536-44f4-9c30-faf92f433d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:02.553081 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3bf596-5536-44f4-9c30-faf92f433d26 admin admin] PATH_INFO: `/v3/projects/7aaac73ec7c44804822f7f67c51cb519` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:02.554287 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3bf596-5536-44f4-9c30-faf92f433d26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7aaac73ec7c44804822f7f67c51cb519)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:02.556385 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3bf596-5536-44f4-9c30-faf92f433d26 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:02.610239 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1273/2564] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:13:02 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 21:13:02.612605 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec4e4c-26c1-4be4-8e79-05f43cb4f81e None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:02.612903 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec4e4c-26c1-4be4-8e79-05f43cb4f81e None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:02.613316 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec4e4c-26c1-4be4-8e79-05f43cb4f81e None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:02.614570 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1274/2565] 10.222.0.40 () {54 vars in 921 bytes} [Mon Jul 11 21:13:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 21:13:02.615257 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec4e4c-26c1-4be4-8e79-05f43cb4f81e None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:02.681825 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-0b3bf596-5536-44f4-9c30-faf92f433d26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aaac73ec7c44804822f7f67c51cb519', 'request_id': 'req-0b3bf596-5536-44f4-9c30-faf92f433d26'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:02.682533 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec4e4c-26c1-4be4-8e79-05f43cb4f81e None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:02.689541 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-0b3bf596-5536-44f4-9c30-faf92f433d26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aaac73ec7c44804822f7f67c51cb519', 'request_id': 'req-0b3bf596-5536-44f4-9c30-faf92f433d26'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:02.699058 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-0b3bf596-5536-44f4-9c30-faf92f433d26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aaac73ec7c44804822f7f67c51cb519', 'request_id': 'req-0b3bf596-5536-44f4-9c30-faf92f433d26'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:02.739643 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc3a10-45fb-4b85-b9ac-b0960b9d8c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:02.740452 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc3a10-45fb-4b85-b9ac-b0960b9d8c6f admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:02.740738 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc3a10-45fb-4b85-b9ac-b0960b9d8c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:02.741014 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc3a10-45fb-4b85-b9ac-b0960b9d8c6f admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:02.741707 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc3a10-45fb-4b85-b9ac-b0960b9d8c6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:02.743642 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc3a10-45fb-4b85-b9ac-b0960b9d8c6f admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:02.772086 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-0b3bf596-5536-44f4-9c30-faf92f433d26 admin admin] The token cache is being invalidate because project 7aaac73ec7c44804822f7f67c51cb519 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:13:02.772382 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-0b3bf596-5536-44f4-9c30-faf92f433d26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:02.773065 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-0b3bf596-5536-44f4-9c30-faf92f433d26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:02.774644 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1292/2566] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:13:02 2022] DELETE /identity/v3/projects/7aaac73ec7c44804822f7f67c51cb519 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:13:02.775856 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a57cdc-992e-4cdf-a3a8-51eb0d2b15fc None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:02.776175 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a57cdc-992e-4cdf-a3a8-51eb0d2b15fc None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:02.776454 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a57cdc-992e-4cdf-a3a8-51eb0d2b15fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:02.791042 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=100 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:02.796717 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-41a57cdc-992e-4cdf-a3a8-51eb0d2b15fc None None] MFA Rules not processed for user `29046b079f1a4f4ea2244e69cbbaa805`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:02.797922 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-41a57cdc-992e-4cdf-a3a8-51eb0d2b15fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:02.850319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1275/2567] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:13:02 2022] POST /identity/v3/users => generated 290 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:13:02.850319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba8312-c0f7-44bb-8d37-30b5540fb6a5 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:02.850319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba8312-c0f7-44bb-8d37-30b5540fb6a5 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:02.850319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba8312-c0f7-44bb-8d37-30b5540fb6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:02.851017 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1293/2568] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Jul 11 21:13:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:13:02.851852 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a57cdc-992e-4cdf-a3a8-51eb0d2b15fc None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:02.853150 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-41a57cdc-992e-4cdf-a3a8-51eb0d2b15fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:02.868460 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a57cdc-992e-4cdf-a3a8-51eb0d2b15fc None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:02.873138 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3e93f-ca63-4bea-b753-4ac4440f6126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:02.873815 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3e93f-ca63-4bea-b753-4ac4440f6126 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:02.874107 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3e93f-ca63-4bea-b753-4ac4440f6126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:02.874228 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-5eba8312-c0f7-44bb-8d37-30b5540fb6a5 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:02.874387 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3e93f-ca63-4bea-b753-4ac4440f6126 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:02.875127 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d3e93f-ca63-4bea-b753-4ac4440f6126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:02.875441 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-5eba8312-c0f7-44bb-8d37-30b5540fb6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:02.877849 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d3e93f-ca63-4bea-b753-4ac4440f6126 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:02.888280 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1276/2569] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:13:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:13:02.888280 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba8312-c0f7-44bb-8d37-30b5540fb6a5 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:02.888280 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-5eba8312-c0f7-44bb-8d37-30b5540fb6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:02.888610 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1294/2570] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:13:02.892652 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3e93f-ca63-4bea-b753-4ac4440f6126 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:02.902603 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3e93f-ca63-4bea-b753-4ac4440f6126 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:02.903924 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba8312-c0f7-44bb-8d37-30b5540fb6a5 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:02.907250 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ce3ef-ec74-4a6e-980c-424dbb1db0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:02.907556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f2a51-9c8e-4a24-b8e5-bda7bdb86a47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:02.907928 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ce3ef-ec74-4a6e-980c-424dbb1db0f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:02.908266 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ce3ef-ec74-4a6e-980c-424dbb1db0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:02.908429 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f2a51-9c8e-4a24-b8e5-bda7bdb86a47 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:02.908528 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ce3ef-ec74-4a6e-980c-424dbb1db0f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:02.908723 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f2a51-9c8e-4a24-b8e5-bda7bdb86a47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:02.909033 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f2a51-9c8e-4a24-b8e5-bda7bdb86a47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:02.909407 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ce3ef-ec74-4a6e-980c-424dbb1db0f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:02.911042 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ce3ef-ec74-4a6e-980c-424dbb1db0f9 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:02.916638 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f2a51-9c8e-4a24-b8e5-bda7bdb86a47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:02.918090 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f2a51-9c8e-4a24-b8e5-bda7bdb86a47 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:02.921511 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1295/2571] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 21:13:02.922684 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee3346-85f8-4574-81d5-d41052830922 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:02.922976 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee3346-85f8-4574-81d5-d41052830922 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:02.923795 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee3346-85f8-4574-81d5-d41052830922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:02.929606 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1277/2572] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:13:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:13:02.930405 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f2a51-9c8e-4a24-b8e5-bda7bdb86a47 service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:02.942718 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f2a51-9c8e-4a24-b8e5-bda7bdb86a47 service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:02.942998 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-1dee3346-85f8-4574-81d5-d41052830922 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:02.944352 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-1dee3346-85f8-4574-81d5-d41052830922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:02.947564 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff6c2f-8905-4fdf-99de-d45277cbda00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:02.948494 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff6c2f-8905-4fdf-99de-d45277cbda00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:02.948788 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff6c2f-8905-4fdf-99de-d45277cbda00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:02.949130 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff6c2f-8905-4fdf-99de-d45277cbda00 admin admin] PATH_INFO: `/v3/projects/137c370868944937b32d04d983109b58/users/6a8a8c5fc2db489ca0014203abd839e3/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:02.952292 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1296/2573] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:13:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:13:02.956454 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee3346-85f8-4574-81d5-d41052830922 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:02.965550 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff6c2f-8905-4fdf-99de-d45277cbda00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=137c370868944937b32d04d983109b58, user_id=6a8a8c5fc2db489ca0014203abd839e3, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:02.966657 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee3346-85f8-4574-81d5-d41052830922 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:02.968287 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff6c2f-8905-4fdf-99de-d45277cbda00 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:02.971654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e25a8-33c7-43a2-8d49-b7129b76303e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:02.972467 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e25a8-33c7-43a2-8d49-b7129b76303e admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:02.972759 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e25a8-33c7-43a2-8d49-b7129b76303e admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:02.973047 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e25a8-33c7-43a2-8d49-b7129b76303e admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:02.973771 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e25a8-33c7-43a2-8d49-b7129b76303e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:13:02.974087 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e25a8-33c7-43a2-8d49-b7129b76303e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:02.975670 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e25a8-33c7-43a2-8d49-b7129b76303e admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:02.988505 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1297/2574] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:13:02.992753 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e25a8-33c7-43a2-8d49-b7129b76303e admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:03.003591 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e25a8-33c7-43a2-8d49-b7129b76303e admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:03.008252 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3fca77-1a44-4d9e-92b7-61434b27a5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:03.008914 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3fca77-1a44-4d9e-92b7-61434b27a5ce admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:03.009207 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3fca77-1a44-4d9e-92b7-61434b27a5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:03.009490 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3fca77-1a44-4d9e-92b7-61434b27a5ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:03.010179 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3fca77-1a44-4d9e-92b7-61434b27a5ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:03.012170 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3fca77-1a44-4d9e-92b7-61434b27a5ce admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:03.026833 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:03.050006 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1278/2575] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:13:02 2022] PUT /identity/v3/projects/137c370868944937b32d04d983109b58/users/6a8a8c5fc2db489ca0014203abd839e3/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:13:03.051448 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e9600-47e7-4f94-9c39-af434993254c None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:03.051755 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e9600-47e7-4f94-9c39-af434993254c None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:03.052053 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e9600-47e7-4f94-9c39-af434993254c None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:03.053378 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1279/2576] 10.222.0.40 () {54 vars in 921 bytes} [Mon Jul 11 21:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 21:13:03.058792 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d8bcb-f27d-4208-9a54-22e95e06e778 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:03.059108 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d8bcb-f27d-4208-9a54-22e95e06e778 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:03.059395 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d8bcb-f27d-4208-9a54-22e95e06e778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:03.079715 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-b14d8bcb-f27d-4208-9a54-22e95e06e778 None None] MFA Rules not processed for user `8ac15411c75f4bd4a86f6753c9240a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:03.081046 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b14d8bcb-f27d-4208-9a54-22e95e06e778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:03.101967 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1298/2577] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:13:02 2022] POST /identity/v3/projects => generated 387 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:13:03.106603 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014a2fd-68e9-4179-8bc8-10e4ceaa1803 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:03.106904 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014a2fd-68e9-4179-8bc8-10e4ceaa1803 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:03.107183 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014a2fd-68e9-4179-8bc8-10e4ceaa1803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:03.107852 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:03.145283 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-2014a2fd-68e9-4179-8bc8-10e4ceaa1803 None None] MFA Rules not processed for user `6a8a8c5fc2db489ca0014203abd839e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:03.147029 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-2014a2fd-68e9-4179-8bc8-10e4ceaa1803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:03.157247 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1280/2578] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Jul 11 21:13:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:13:03.158011 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d8bcb-f27d-4208-9a54-22e95e06e778 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:03.215627 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1299/2579] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:13:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:13:03.216451 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014a2fd-68e9-4179-8bc8-10e4ceaa1803 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:03.237752 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d8bcb-f27d-4208-9a54-22e95e06e778 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:03.280257 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014a2fd-68e9-4179-8bc8-10e4ceaa1803 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:03.292161 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9eeff-fb40-4462-a023-35f7c6573d74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:03.292836 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9eeff-fb40-4462-a023-35f7c6573d74 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:03.293248 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9eeff-fb40-4462-a023-35f7c6573d74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:03.293382 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9eeff-fb40-4462-a023-35f7c6573d74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:03.304864 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b26812-5d45-41e2-97c5-786fbf4414b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:03.304864 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b26812-5d45-41e2-97c5-786fbf4414b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:03.304864 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b26812-5d45-41e2-97c5-786fbf4414b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:03.304864 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b26812-5d45-41e2-97c5-786fbf4414b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:03.306145 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b26812-5d45-41e2-97c5-786fbf4414b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:03.308317 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b26812-5d45-41e2-97c5-786fbf4414b8 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:03.364647 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9eeff-fb40-4462-a023-35f7c6573d74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:03.366136 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9eeff-fb40-4462-a023-35f7c6573d74 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:03.377204 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1300/2580] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:13:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:13:03.377979 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9eeff-fb40-4462-a023-35f7c6573d74 service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:03.385227 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1281/2581] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:13:03 2022] POST /identity/v3/users => generated 294 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:13:03.386581 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b26812-5d45-41e2-97c5-786fbf4414b8 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:03.389939 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9eeff-fb40-4462-a023-35f7c6573d74 service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:03.395222 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d82a8-9135-4685-b28e-0b42551a052f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:03.395891 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d82a8-9135-4685-b28e-0b42551a052f admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:03.399238 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d82a8-9135-4685-b28e-0b42551a052f admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:03.399238 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d82a8-9135-4685-b28e-0b42551a052f admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:03.399238 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2d82a8-9135-4685-b28e-0b42551a052f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:03.399494 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b26812-5d45-41e2-97c5-786fbf4414b8 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:03.399601 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2d82a8-9135-4685-b28e-0b42551a052f admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:03.402656 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be103e5-0d30-4ac7-b99a-dc60c0536817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:03.403592 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be103e5-0d30-4ac7-b99a-dc60c0536817 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:03.404317 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be103e5-0d30-4ac7-b99a-dc60c0536817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:03.404608 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be103e5-0d30-4ac7-b99a-dc60c0536817 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:03.405441 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be103e5-0d30-4ac7-b99a-dc60c0536817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:03.407022 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be103e5-0d30-4ac7-b99a-dc60c0536817 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:03.419892 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1282/2582] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 21:13:03.424464 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be103e5-0d30-4ac7-b99a-dc60c0536817 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:03.434403 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be103e5-0d30-4ac7-b99a-dc60c0536817 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:03.439338 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b394d0b-5a7c-4df9-aa0b-a4524c3e1f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:03.440033 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b394d0b-5a7c-4df9-aa0b-a4524c3e1f9b admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:03.440323 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b394d0b-5a7c-4df9-aa0b-a4524c3e1f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:03.440606 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b394d0b-5a7c-4df9-aa0b-a4524c3e1f9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:03.441337 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b394d0b-5a7c-4df9-aa0b-a4524c3e1f9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:03.442928 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b394d0b-5a7c-4df9-aa0b-a4524c3e1f9b admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:03.453240 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1283/2583] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 21:13:03.457157 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b394d0b-5a7c-4df9-aa0b-a4524c3e1f9b admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:03.466894 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b394d0b-5a7c-4df9-aa0b-a4524c3e1f9b admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:03.472240 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb70b0-5547-495b-afd4-fd0013293b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:03.473107 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb70b0-5547-495b-afd4-fd0013293b20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:03.473402 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb70b0-5547-495b-afd4-fd0013293b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:03.473673 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb70b0-5547-495b-afd4-fd0013293b20 admin admin] PATH_INFO: `/v3/projects/dd24953e835d41c184c2f2c96aee6ab5/users/761f0f424dbc4fd9b93d41c2f943f3ea/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:03.488684 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1301/2584] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:13:03 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:13:03.492744 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb70b0-5547-495b-afd4-fd0013293b20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd24953e835d41c184c2f2c96aee6ab5, user_id=761f0f424dbc4fd9b93d41c2f943f3ea, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:03.492880 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d82a8-9135-4685-b28e-0b42551a052f admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:03.495388 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb70b0-5547-495b-afd4-fd0013293b20 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:03.497167 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:03.556960 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d82a8-9135-4685-b28e-0b42551a052f admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:03.561968 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c926d1-6017-4ac6-baf8-b47f93fc3ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:03.562635 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c926d1-6017-4ac6-baf8-b47f93fc3ff2 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:03.562921 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c926d1-6017-4ac6-baf8-b47f93fc3ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:03.563196 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c926d1-6017-4ac6-baf8-b47f93fc3ff2 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:03.564614 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c926d1-6017-4ac6-baf8-b47f93fc3ff2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:03.566585 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c926d1-6017-4ac6-baf8-b47f93fc3ff2 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:03.579223 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1284/2585] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:13:03 2022] PUT /identity/v3/projects/dd24953e835d41c184c2f2c96aee6ab5/users/761f0f424dbc4fd9b93d41c2f943f3ea/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:13:03.590502 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb495040-41c2-4cfc-972d-120b79015ff4 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:03.590796 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb495040-41c2-4cfc-972d-120b79015ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:03.591099 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb495040-41c2-4cfc-972d-120b79015ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:03.614849 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:03.617820 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-eb495040-41c2-4cfc-972d-120b79015ff4 None None] MFA Rules not processed for user `761f0f424dbc4fd9b93d41c2f943f3ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:03.619024 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-eb495040-41c2-4cfc-972d-120b79015ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:03.664746 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1302/2586] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:13:03 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 21:13:03.668812 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c926d1-6017-4ac6-baf8-b47f93fc3ff2 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:03.679700 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c926d1-6017-4ac6-baf8-b47f93fc3ff2 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:03.691567 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1285/2587] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:13:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:13:03.692852 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb495040-41c2-4cfc-972d-120b79015ff4 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:03.740307 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83589482-793d-43d6-bf9c-f30947a9d806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:03.740905 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83589482-793d-43d6-bf9c-f30947a9d806 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:03.741192 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83589482-793d-43d6-bf9c-f30947a9d806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:03.741463 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83589482-793d-43d6-bf9c-f30947a9d806 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:03.742246 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83589482-793d-43d6-bf9c-f30947a9d806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:03.743842 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83589482-793d-43d6-bf9c-f30947a9d806 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:03.753963 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1303/2588] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 21:13:03.757939 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83589482-793d-43d6-bf9c-f30947a9d806 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:03.758166 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb495040-41c2-4cfc-972d-120b79015ff4 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:03.763275 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcafd97-b349-4fe3-abaa-6fdbbdfc6d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:03.763949 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcafd97-b349-4fe3-abaa-6fdbbdfc6d6c admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:03.764302 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcafd97-b349-4fe3-abaa-6fdbbdfc6d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:03.764584 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcafd97-b349-4fe3-abaa-6fdbbdfc6d6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:03.765347 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcafd97-b349-4fe3-abaa-6fdbbdfc6d6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:03.767751 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcafd97-b349-4fe3-abaa-6fdbbdfc6d6c admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:03.768176 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83589482-793d-43d6-bf9c-f30947a9d806 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:03.773281 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940bb3d-62f8-4ef1-8512-80b0b6aeca19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:03.773921 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940bb3d-62f8-4ef1-8512-80b0b6aeca19 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:03.774233 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940bb3d-62f8-4ef1-8512-80b0b6aeca19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:03.774512 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940bb3d-62f8-4ef1-8512-80b0b6aeca19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:03.775229 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4940bb3d-62f8-4ef1-8512-80b0b6aeca19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:03.776830 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4940bb3d-62f8-4ef1-8512-80b0b6aeca19 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:03.788004 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1304/2589] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:13:03.791949 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940bb3d-62f8-4ef1-8512-80b0b6aeca19 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:03.802091 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940bb3d-62f8-4ef1-8512-80b0b6aeca19 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:03.806667 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff54da9-e18c-47a8-8b5a-954b0f765e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:03.807553 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff54da9-e18c-47a8-8b5a-954b0f765e35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:03.807840 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff54da9-e18c-47a8-8b5a-954b0f765e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:03.808165 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff54da9-e18c-47a8-8b5a-954b0f765e35 admin admin] PATH_INFO: `/v3/projects/0dd94fdee7bb43dab2bf2d92c1f0bb29/users/598cec4cf583416eaef719e68bddb820/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:03.823624 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff54da9-e18c-47a8-8b5a-954b0f765e35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dd94fdee7bb43dab2bf2d92c1f0bb29, user_id=598cec4cf583416eaef719e68bddb820, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:03.826304 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff54da9-e18c-47a8-8b5a-954b0f765e35 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:03.868862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1286/2590] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:13:03 2022] POST /identity/v3/projects => generated 387 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 21:13:03.870128 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcafd97-b349-4fe3-abaa-6fdbbdfc6d6c admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:03.887716 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1305/2591] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:13:03 2022] PUT /identity/v3/projects/0dd94fdee7bb43dab2bf2d92c1f0bb29/users/598cec4cf583416eaef719e68bddb820/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:13:03.904031 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef54574-59d5-40d4-bafe-ceeda30507bb None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:03.904335 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef54574-59d5-40d4-bafe-ceeda30507bb None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:03.904626 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef54574-59d5-40d4-bafe-ceeda30507bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:03.931204 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-5ef54574-59d5-40d4-bafe-ceeda30507bb None None] MFA Rules not processed for user `598cec4cf583416eaef719e68bddb820`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:03.932453 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-5ef54574-59d5-40d4-bafe-ceeda30507bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:03.936542 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcafd97-b349-4fe3-abaa-6fdbbdfc6d6c admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:03.971894 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:03.976236 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:04.001308 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8422756-3af3-487f-9f5f-07acfdacefc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:04.001308 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8422756-3af3-487f-9f5f-07acfdacefc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:04.001308 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8422756-3af3-487f-9f5f-07acfdacefc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:04.001308 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8422756-3af3-487f-9f5f-07acfdacefc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:04.002062 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8422756-3af3-487f-9f5f-07acfdacefc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:04.002148 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1306/2592] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:13:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:13:04.002241 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8422756-3af3-487f-9f5f-07acfdacefc1 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:04.003693 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef54574-59d5-40d4-bafe-ceeda30507bb None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:04.014049 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef54574-59d5-40d4-bafe-ceeda30507bb None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:04.019376 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f68a7-6b10-4f6f-9503-bc6c2a5ad150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:04.020162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f68a7-6b10-4f6f-9503-bc6c2a5ad150 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:04.020466 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f68a7-6b10-4f6f-9503-bc6c2a5ad150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:04.020743 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f68a7-6b10-4f6f-9503-bc6c2a5ad150 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:04.021703 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f68a7-6b10-4f6f-9503-bc6c2a5ad150 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:04.023696 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f68a7-6b10-4f6f-9503-bc6c2a5ad150 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:04.109770 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1287/2593] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:13:03 2022] POST /identity/v3/users => generated 300 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 21:13:04.114254 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8422756-3af3-487f-9f5f-07acfdacefc1 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:04.123723 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8422756-3af3-487f-9f5f-07acfdacefc1 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:04.128876 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52409da-053e-4b80-b7a8-24328bcfd7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:04.129543 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52409da-053e-4b80-b7a8-24328bcfd7ca admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:04.129836 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52409da-053e-4b80-b7a8-24328bcfd7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:04.130299 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52409da-053e-4b80-b7a8-24328bcfd7ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:04.131042 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52409da-053e-4b80-b7a8-24328bcfd7ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:04.132675 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52409da-053e-4b80-b7a8-24328bcfd7ca admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:04.139133 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1307/2594] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:13:04 2022] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 21:13:04.143513 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f68a7-6b10-4f6f-9503-bc6c2a5ad150 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:04.148842 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1288/2595] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 21:13:04.149832 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52409da-053e-4b80-b7a8-24328bcfd7ca admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:04.160883 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52409da-053e-4b80-b7a8-24328bcfd7ca admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:04.209684 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f68a7-6b10-4f6f-9503-bc6c2a5ad150 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:04.214496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648510cf-bfcd-4085-8e3a-e1c089667796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:04.215160 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648510cf-bfcd-4085-8e3a-e1c089667796 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:04.215448 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648510cf-bfcd-4085-8e3a-e1c089667796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:04.215734 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648510cf-bfcd-4085-8e3a-e1c089667796 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:04.216468 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648510cf-bfcd-4085-8e3a-e1c089667796 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:04.217394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80613d-97e0-4486-b0d8-5789166af7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:04.218317 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80613d-97e0-4486-b0d8-5789166af7d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:04.218429 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648510cf-bfcd-4085-8e3a-e1c089667796 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:04.218607 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80613d-97e0-4486-b0d8-5789166af7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:04.218888 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80613d-97e0-4486-b0d8-5789166af7d7 admin admin] PATH_INFO: `/v3/projects/5a3a4a9b8a50455bb3ed5a99583b592c/users/4b2108d305074c9c852e1bf0b893926e/roles/86273ff072f3438d822e870272491768` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:04.233800 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb80613d-97e0-4486-b0d8-5789166af7d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a3a4a9b8a50455bb3ed5a99583b592c, user_id=4b2108d305074c9c852e1bf0b893926e, role_id=86273ff072f3438d822e870272491768)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:04.236576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb80613d-97e0-4486-b0d8-5789166af7d7 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:04.334014 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1308/2596] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:13:04 2022] POST /identity/v3/users => generated 295 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:13:04.337518 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648510cf-bfcd-4085-8e3a-e1c089667796 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:04.347599 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648510cf-bfcd-4085-8e3a-e1c089667796 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:04.352436 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3c080-4fed-4e22-b409-09bc6c2b8b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:04.353107 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3c080-4fed-4e22-b409-09bc6c2b8b3c admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:04.353398 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3c080-4fed-4e22-b409-09bc6c2b8b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:04.353681 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3c080-4fed-4e22-b409-09bc6c2b8b3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:04.354412 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec3c080-4fed-4e22-b409-09bc6c2b8b3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:04.356114 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec3c080-4fed-4e22-b409-09bc6c2b8b3c admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:04.369397 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1309/2597] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 21:13:04.371210 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3c080-4fed-4e22-b409-09bc6c2b8b3c admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:04.382074 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3c080-4fed-4e22-b409-09bc6c2b8b3c admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:04.387758 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a561ae-1ea3-458c-b6e7-c12fa2d3789a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:04.388734 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a561ae-1ea3-458c-b6e7-c12fa2d3789a admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:04.389022 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a561ae-1ea3-458c-b6e7-c12fa2d3789a admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:04.389301 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a561ae-1ea3-458c-b6e7-c12fa2d3789a admin admin] PATH_INFO: `/v3/projects/d97e41251d5f4d99b4579ec17bc90061/users/f18a48c08fc4431a976d23f5220d0bc0/roles/86273ff072f3438d822e870272491768` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:04.399580 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1289/2598] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:13:04 2022] PUT /identity/v3/projects/5a3a4a9b8a50455bb3ed5a99583b592c/users/4b2108d305074c9c852e1bf0b893926e/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:13:04.404138 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80613d-97e0-4486-b0d8-5789166af7d7 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:04.409954 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a561ae-1ea3-458c-b6e7-c12fa2d3789a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d97e41251d5f4d99b4579ec17bc90061, user_id=f18a48c08fc4431a976d23f5220d0bc0, role_id=86273ff072f3438d822e870272491768)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:04.412935 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a561ae-1ea3-458c-b6e7-c12fa2d3789a admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:04.483230 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80613d-97e0-4486-b0d8-5789166af7d7 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:04.489556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a805271-adce-41d4-8383-6f11478db1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:04.490472 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a805271-adce-41d4-8383-6f11478db1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:04.490472 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a805271-adce-41d4-8383-6f11478db1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:04.490781 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a805271-adce-41d4-8383-6f11478db1d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:04.491627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a805271-adce-41d4-8383-6f11478db1d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:04.494128 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a805271-adce-41d4-8383-6f11478db1d6 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:04.498331 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1310/2599] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:13:04 2022] PUT /identity/v3/projects/d97e41251d5f4d99b4579ec17bc90061/users/f18a48c08fc4431a976d23f5220d0bc0/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:13:04.507289 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a561ae-1ea3-458c-b6e7-c12fa2d3789a admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:04.513554 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1290/2600] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:13:04.525103 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a805271-adce-41d4-8383-6f11478db1d6 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:04.535104 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a805271-adce-41d4-8383-6f11478db1d6 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:04.572715 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:04.580615 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a561ae-1ea3-458c-b6e7-c12fa2d3789a admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:04.586236 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e2aa8-7d29-428a-a821-3d1314bce5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:04.586859 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e2aa8-7d29-428a-a821-3d1314bce5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:04.587150 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e2aa8-7d29-428a-a821-3d1314bce5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:04.587490 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e2aa8-7d29-428a-a821-3d1314bce5f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:04.588413 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e2aa8-7d29-428a-a821-3d1314bce5f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:04.590117 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e2aa8-7d29-428a-a821-3d1314bce5f0 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:04.601593 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67561979-238a-485f-97a1-5c5b011e8ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:04.604979 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1311/2601] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 21:13:04.605130 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67561979-238a-485f-97a1-5c5b011e8ad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:04.605130 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67561979-238a-485f-97a1-5c5b011e8ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:04.605130 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67561979-238a-485f-97a1-5c5b011e8ad9 admin admin] PATH_INFO: `/v3/projects/5a3a4a9b8a50455bb3ed5a99583b592c/users/4b2108d305074c9c852e1bf0b893926e/roles/86273ff072f3438d822e870272491768` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:04.606380 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e2aa8-7d29-428a-a821-3d1314bce5f0 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:04.606503 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67561979-238a-485f-97a1-5c5b011e8ad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a3a4a9b8a50455bb3ed5a99583b592c, user_id=4b2108d305074c9c852e1bf0b893926e, role_id=86273ff072f3438d822e870272491768)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:04.609163 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67561979-238a-485f-97a1-5c5b011e8ad9 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:04.616892 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e2aa8-7d29-428a-a821-3d1314bce5f0 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:04.621122 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1291/2602] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:13:04 2022] PUT /identity/v3/projects/5a3a4a9b8a50455bb3ed5a99583b592c/users/4b2108d305074c9c852e1bf0b893926e/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:13:04.628843 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:04.631792 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d09a4-c0a9-48ed-b0ba-fe7377328ee8 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:04.632188 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d09a4-c0a9-48ed-b0ba-fe7377328ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:04.632477 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d09a4-c0a9-48ed-b0ba-fe7377328ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:04.669273 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-f28d09a4-c0a9-48ed-b0ba-fe7377328ee8 None None] MFA Rules not processed for user `4b2108d305074c9c852e1bf0b893926e`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:04.670505 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-f28d09a4-c0a9-48ed-b0ba-fe7377328ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:04.682923 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f2020-7954-403d-a2f1-2a06871e090e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:04.683825 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f2020-7954-403d-a2f1-2a06871e090e admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:04.684150 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f2020-7954-403d-a2f1-2a06871e090e admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:04.684436 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f2020-7954-403d-a2f1-2a06871e090e admin admin] PATH_INFO: `/v3/projects/d97e41251d5f4d99b4579ec17bc90061/users/f18a48c08fc4431a976d23f5220d0bc0/roles/86273ff072f3438d822e870272491768` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:04.686609 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f2020-7954-403d-a2f1-2a06871e090e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d97e41251d5f4d99b4579ec17bc90061, user_id=f18a48c08fc4431a976d23f5220d0bc0, role_id=86273ff072f3438d822e870272491768)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:04.690496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f2020-7954-403d-a2f1-2a06871e090e admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:04.702303 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1312/2603] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:13:04 2022] PUT /identity/v3/projects/d97e41251d5f4d99b4579ec17bc90061/users/f18a48c08fc4431a976d23f5220d0bc0/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:13:04.721173 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e44443-babd-47c9-a7b0-2bd59ed21a47 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:04.721478 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e44443-babd-47c9-a7b0-2bd59ed21a47 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:04.721849 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e44443-babd-47c9-a7b0-2bd59ed21a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:04.744170 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1292/2604] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:13:04 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:13:04.749193 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-72e44443-babd-47c9-a7b0-2bd59ed21a47 None None] MFA Rules not processed for user `f18a48c08fc4431a976d23f5220d0bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:04.750469 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-72e44443-babd-47c9-a7b0-2bd59ed21a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:04.755439 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d09a4-c0a9-48ed-b0ba-fe7377328ee8 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:04.756874 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-f28d09a4-c0a9-48ed-b0ba-fe7377328ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:04.816110 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d09a4-c0a9-48ed-b0ba-fe7377328ee8 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:04.832764 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1313/2605] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:13:04 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:13:04.869098 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecded50f-c2f8-48ea-81d4-3b5118116022 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:04.869681 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecded50f-c2f8-48ea-81d4-3b5118116022 service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:04.869966 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecded50f-c2f8-48ea-81d4-3b5118116022 service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:04.870246 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecded50f-c2f8-48ea-81d4-3b5118116022 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:04.891448 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:04.895925 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e44443-babd-47c9-a7b0-2bd59ed21a47 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:04.897654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-72e44443-babd-47c9-a7b0-2bd59ed21a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:04.910118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e44443-babd-47c9-a7b0-2bd59ed21a47 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:04.913834 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4aa87-a4d9-42a4-a62c-dc32087b7de7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:04.914519 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4aa87-a4d9-42a4-a62c-dc32087b7de7 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:04.914810 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4aa87-a4d9-42a4-a62c-dc32087b7de7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:04.915099 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4aa87-a4d9-42a4-a62c-dc32087b7de7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:04.925275 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e4aa87-a4d9-42a4-a62c-dc32087b7de7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:04.926724 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e4aa87-a4d9-42a4-a62c-dc32087b7de7 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:04.933325 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecded50f-c2f8-48ea-81d4-3b5118116022 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:04.934751 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecded50f-c2f8-48ea-81d4-3b5118116022 service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:04.937266 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1314/2606] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:13:04 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 21:13:04.948066 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1293/2607] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:13:04 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 21:13:05.071673 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4aa87-a4d9-42a4-a62c-dc32087b7de7 service cinder] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:05.082426 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4aa87-a4d9-42a4-a62c-dc32087b7de7 service cinder] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:05.086227 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5655bae8-6e40-4159-95e1-63b5da5f8e06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:05.086986 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655bae8-6e40-4159-95e1-63b5da5f8e06 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:05.087277 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655bae8-6e40-4159-95e1-63b5da5f8e06 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:05.087591 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655bae8-6e40-4159-95e1-63b5da5f8e06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:05.144792 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5655bae8-6e40-4159-95e1-63b5da5f8e06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:05.146116 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5655bae8-6e40-4159-95e1-63b5da5f8e06 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:05.155289 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1315/2608] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:13:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:13:06.232909 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecded50f-c2f8-48ea-81d4-3b5118116022 service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:06.301575 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecded50f-c2f8-48ea-81d4-3b5118116022 service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:06.306481 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bab9d6-5eaf-4360-b6e4-2d58bb9fb9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:06.307373 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bab9d6-5eaf-4360-b6e4-2d58bb9fb9ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:06.307660 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bab9d6-5eaf-4360-b6e4-2d58bb9fb9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:06.307940 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bab9d6-5eaf-4360-b6e4-2d58bb9fb9ff admin admin] PATH_INFO: `/v3/users/761f0f424dbc4fd9b93d41c2f943f3ea` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:06.309810 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bab9d6-5eaf-4360-b6e4-2d58bb9fb9ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=761f0f424dbc4fd9b93d41c2f943f3ea)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:06.312522 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bab9d6-5eaf-4360-b6e4-2d58bb9fb9ff admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:06.498302 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-90bab9d6-5eaf-4360-b6e4-2d58bb9fb9ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '761f0f424dbc4fd9b93d41c2f943f3ea'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:06.507850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-90bab9d6-5eaf-4360-b6e4-2d58bb9fb9ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '761f0f424dbc4fd9b93d41c2f943f3ea'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:06.508777 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-90bab9d6-5eaf-4360-b6e4-2d58bb9fb9ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '761f0f424dbc4fd9b93d41c2f943f3ea'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:06.509756 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-90bab9d6-5eaf-4360-b6e4-2d58bb9fb9ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '761f0f424dbc4fd9b93d41c2f943f3ea'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:06.574724 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-90bab9d6-5eaf-4360-b6e4-2d58bb9fb9ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '761f0f424dbc4fd9b93d41c2f943f3ea'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:06.598199 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1294/2609] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:13:06 2022] DELETE /identity/v3/users/761f0f424dbc4fd9b93d41c2f943f3ea => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:13:06.603224 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9d350-ea7e-4f2b-856c-cd1c48e1604d None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:06.603743 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9d350-ea7e-4f2b-856c-cd1c48e1604d None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:06.603867 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9d350-ea7e-4f2b-856c-cd1c48e1604d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:06.627501 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-87e9d350-ea7e-4f2b-856c-cd1c48e1604d None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:06.628668 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-87e9d350-ea7e-4f2b-856c-cd1c48e1604d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:06.639232 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:06.698993 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1316/2610] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:13:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:13:06.709795 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bab9d6-5eaf-4360-b6e4-2d58bb9fb9ff admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:06.711467 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-90bab9d6-5eaf-4360-b6e4-2d58bb9fb9ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:06.758318 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:06.772009 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6ba65-8c46-4c43-b1fa-b766e3e7c113 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:06.772009 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6ba65-8c46-4c43-b1fa-b766e3e7c113 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:06.772009 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6ba65-8c46-4c43-b1fa-b766e3e7c113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:06.781393 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bab9d6-5eaf-4360-b6e4-2d58bb9fb9ff admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:06.788210 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aca36d-3317-4f00-b8be-ab8e5c9f8a44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:06.789459 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aca36d-3317-4f00-b8be-ab8e5c9f8a44 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:06.789917 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aca36d-3317-4f00-b8be-ab8e5c9f8a44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:06.791191 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aca36d-3317-4f00-b8be-ab8e5c9f8a44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:06.793846 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-60e6ba65-8c46-4c43-b1fa-b766e3e7c113 None None] MFA Rules not processed for user `90ea5d52fd6d4068b7837d363eebb94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:06.795065 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-60e6ba65-8c46-4c43-b1fa-b766e3e7c113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:06.804597 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aca36d-3317-4f00-b8be-ab8e5c9f8a44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:06.806115 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aca36d-3317-4f00-b8be-ab8e5c9f8a44 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:06.817225 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1295/2611] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:13:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:13:06.868964 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1317/2612] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Jul 11 21:13:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:13:06.881594 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aca36d-3317-4f00-b8be-ab8e5c9f8a44 service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:06.883405 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-71aca36d-3317-4f00-b8be-ab8e5c9f8a44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:06.959849 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aca36d-3317-4f00-b8be-ab8e5c9f8a44 service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:06.966395 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e32bc-b083-4e18-b594-0de75ee45735 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc950dfb1d3b4308a33f3d430fe34c1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:06.970960 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e32bc-b083-4e18-b594-0de75ee45735 service swift] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:06.970960 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e32bc-b083-4e18-b594-0de75ee45735 service swift] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:06.970960 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e32bc-b083-4e18-b594-0de75ee45735 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:06.976695 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e32bc-b083-4e18-b594-0de75ee45735 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:06.978212 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e32bc-b083-4e18-b594-0de75ee45735 service swift] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:06.986848 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1296/2613] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jul 11 21:13:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 21:13:07.342834 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6ba65-8c46-4c43-b1fa-b766e3e7c113 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:07.345054 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-60e6ba65-8c46-4c43-b1fa-b766e3e7c113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:07.370562 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6ba65-8c46-4c43-b1fa-b766e3e7c113 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:07.386860 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dac63c-a483-408c-9343-116113cdbfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:07.387825 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dac63c-a483-408c-9343-116113cdbfba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:07.388268 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dac63c-a483-408c-9343-116113cdbfba admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:07.388554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dac63c-a483-408c-9343-116113cdbfba admin admin] PATH_INFO: `/v3/projects/dd24953e835d41c184c2f2c96aee6ab5` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:07.390758 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dac63c-a483-408c-9343-116113cdbfba admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd24953e835d41c184c2f2c96aee6ab5)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:07.394295 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dac63c-a483-408c-9343-116113cdbfba admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:07.519938 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b7dac63c-a483-408c-9343-116113cdbfba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd24953e835d41c184c2f2c96aee6ab5', 'request_id': 'req-b7dac63c-a483-408c-9343-116113cdbfba'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:07.533945 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b7dac63c-a483-408c-9343-116113cdbfba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd24953e835d41c184c2f2c96aee6ab5', 'request_id': 'req-b7dac63c-a483-408c-9343-116113cdbfba'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:07.538716 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b7dac63c-a483-408c-9343-116113cdbfba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd24953e835d41c184c2f2c96aee6ab5', 'request_id': 'req-b7dac63c-a483-408c-9343-116113cdbfba'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:07.619960 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b7dac63c-a483-408c-9343-116113cdbfba admin admin] The token cache is being invalidate because project dd24953e835d41c184c2f2c96aee6ab5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:13:07.620742 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b7dac63c-a483-408c-9343-116113cdbfba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:07.621396 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b7dac63c-a483-408c-9343-116113cdbfba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:07.623384 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1318/2614] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:13:07 2022] DELETE /identity/v3/projects/dd24953e835d41c184c2f2c96aee6ab5 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:13:07.628918 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e32bc-b083-4e18-b594-0de75ee45735 service swift] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:07.642636 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e32bc-b083-4e18-b594-0de75ee45735 service swift] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:07.724742 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50a4f4-2928-4cb8-a98d-d8031b117c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:07.725767 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50a4f4-2928-4cb8-a98d-d8031b117c11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:07.726062 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50a4f4-2928-4cb8-a98d-d8031b117c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:07.726395 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50a4f4-2928-4cb8-a98d-d8031b117c11 admin admin] PATH_INFO: `/v3/users/4b2108d305074c9c852e1bf0b893926e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:07.727844 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d50a4f4-2928-4cb8-a98d-d8031b117c11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b2108d305074c9c852e1bf0b893926e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:07.729927 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d50a4f4-2928-4cb8-a98d-d8031b117c11 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:07.939651 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-1d50a4f4-2928-4cb8-a98d-d8031b117c11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b2108d305074c9c852e1bf0b893926e'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:07.952470 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-1d50a4f4-2928-4cb8-a98d-d8031b117c11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b2108d305074c9c852e1bf0b893926e'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:07.953974 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-1d50a4f4-2928-4cb8-a98d-d8031b117c11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b2108d305074c9c852e1bf0b893926e'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:07.954989 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-1d50a4f4-2928-4cb8-a98d-d8031b117c11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b2108d305074c9c852e1bf0b893926e'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:08.047245 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-1d50a4f4-2928-4cb8-a98d-d8031b117c11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b2108d305074c9c852e1bf0b893926e'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:08.064606 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:08.086294 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1297/2615] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:13:07 2022] DELETE /identity/v3/users/4b2108d305074c9c852e1bf0b893926e => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:13:08.605778 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dac63c-a483-408c-9343-116113cdbfba admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:08.609274 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-b7dac63c-a483-408c-9343-116113cdbfba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:08.628067 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dac63c-a483-408c-9343-116113cdbfba admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:08.698093 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:08.715612 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a422a47-6701-4a63-b732-4934ef3620c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:08.716522 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a422a47-6701-4a63-b732-4934ef3620c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:08.716815 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a422a47-6701-4a63-b732-4934ef3620c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:08.717101 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a422a47-6701-4a63-b732-4934ef3620c2 admin admin] PATH_INFO: `/v3/projects/5a3a4a9b8a50455bb3ed5a99583b592c` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:08.718386 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a422a47-6701-4a63-b732-4934ef3620c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a3a4a9b8a50455bb3ed5a99583b592c)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:08.721236 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a422a47-6701-4a63-b732-4934ef3620c2 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:08.835816 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3a422a47-6701-4a63-b732-4934ef3620c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a3a4a9b8a50455bb3ed5a99583b592c', 'request_id': 'req-3a422a47-6701-4a63-b732-4934ef3620c2'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:08.842572 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3a422a47-6701-4a63-b732-4934ef3620c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a3a4a9b8a50455bb3ed5a99583b592c', 'request_id': 'req-3a422a47-6701-4a63-b732-4934ef3620c2'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:08.850091 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3a422a47-6701-4a63-b732-4934ef3620c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a3a4a9b8a50455bb3ed5a99583b592c', 'request_id': 'req-3a422a47-6701-4a63-b732-4934ef3620c2'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:08.929118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3a422a47-6701-4a63-b732-4934ef3620c2 admin admin] The token cache is being invalidate because project 5a3a4a9b8a50455bb3ed5a99583b592c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:13:08.929428 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3a422a47-6701-4a63-b732-4934ef3620c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:08.930819 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3a422a47-6701-4a63-b732-4934ef3620c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:08.932563 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1319/2616] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:13:08 2022] DELETE /identity/v3/projects/5a3a4a9b8a50455bb3ed5a99583b592c => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:13:08.937639 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b4821-7cdd-4a22-9a8a-0b6337f14a40 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:08.938118 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b4821-7cdd-4a22-9a8a-0b6337f14a40 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:08.938377 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b4821-7cdd-4a22-9a8a-0b6337f14a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:08.961845 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-f63b4821-7cdd-4a22-9a8a-0b6337f14a40 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:08.963257 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-f63b4821-7cdd-4a22-9a8a-0b6337f14a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:09.044437 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1298/2617] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:13:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:13:09.053687 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12417c5-90ea-4671-8ba4-08cdc4459956 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:09.054053 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12417c5-90ea-4671-8ba4-08cdc4459956 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:09.054566 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12417c5-90ea-4671-8ba4-08cdc4459956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:09.073799 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-f12417c5-90ea-4671-8ba4-08cdc4459956 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:09.075163 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-f12417c5-90ea-4671-8ba4-08cdc4459956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:09.083895 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1320/2618] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:13:09.088224 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b4821-7cdd-4a22-9a8a-0b6337f14a40 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:09.103489 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b4821-7cdd-4a22-9a8a-0b6337f14a40 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:09.109221 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9a415-20b3-49d0-bf0f-5f984a73e7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:09.109908 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9a415-20b3-49d0-bf0f-5f984a73e7c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:09.110220 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9a415-20b3-49d0-bf0f-5f984a73e7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:09.110504 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9a415-20b3-49d0-bf0f-5f984a73e7c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:09.111268 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9a415-20b3-49d0-bf0f-5f984a73e7c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:13:09.111580 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9a415-20b3-49d0-bf0f-5f984a73e7c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:09.113201 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9a415-20b3-49d0-bf0f-5f984a73e7c1 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:09.126087 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1299/2619] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:13:09.130345 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12417c5-90ea-4671-8ba4-08cdc4459956 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:09.140161 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12417c5-90ea-4671-8ba4-08cdc4459956 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:09.147598 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03657dd8-c770-43ca-9ec5-550e472a5c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:09.149408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03657dd8-c770-43ca-9ec5-550e472a5c73 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:09.149408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03657dd8-c770-43ca-9ec5-550e472a5c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:09.149408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03657dd8-c770-43ca-9ec5-550e472a5c73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:09.149797 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03657dd8-c770-43ca-9ec5-550e472a5c73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:09.151837 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03657dd8-c770-43ca-9ec5-550e472a5c73 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:09.233378 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1321/2620] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:13:09 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:13:09.237785 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9a415-20b3-49d0-bf0f-5f984a73e7c1 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:09.256791 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9a415-20b3-49d0-bf0f-5f984a73e7c1 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:09.373748 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f0cb6-4328-474b-906d-67c2010f657e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:09.373748 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f0cb6-4328-474b-906d-67c2010f657e admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:09.373748 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f0cb6-4328-474b-906d-67c2010f657e admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:09.373748 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f0cb6-4328-474b-906d-67c2010f657e admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:09.374232 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f0cb6-4328-474b-906d-67c2010f657e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:09.375531 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f0cb6-4328-474b-906d-67c2010f657e admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:09.478012 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03657dd8-c770-43ca-9ec5-550e472a5c73 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:09.479825 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-03657dd8-c770-43ca-9ec5-550e472a5c73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:09.488367 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1300/2621] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:13:09 2022] POST /identity/v3/users => generated 288 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:13:09.492682 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f0cb6-4328-474b-906d-67c2010f657e admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:09.503631 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03657dd8-c770-43ca-9ec5-550e472a5c73 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:09.514589 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f0cb6-4328-474b-906d-67c2010f657e admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:09.519783 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241cda2b-b214-44b8-924e-5db14e02efc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:09.520435 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4427e-9d3a-4bd6-9f8f-6ac9af7fecfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:09.520806 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241cda2b-b214-44b8-924e-5db14e02efc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:09.521172 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241cda2b-b214-44b8-924e-5db14e02efc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:09.521853 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241cda2b-b214-44b8-924e-5db14e02efc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:09.522784 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241cda2b-b214-44b8-924e-5db14e02efc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:09.522976 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4427e-9d3a-4bd6-9f8f-6ac9af7fecfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:09.523341 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4427e-9d3a-4bd6-9f8f-6ac9af7fecfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:09.523636 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4427e-9d3a-4bd6-9f8f-6ac9af7fecfc admin admin] PATH_INFO: `/v3/users/6a8a8c5fc2db489ca0014203abd839e3` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:09.524827 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241cda2b-b214-44b8-924e-5db14e02efc7 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:09.529287 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d4427e-9d3a-4bd6-9f8f-6ac9af7fecfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a8a8c5fc2db489ca0014203abd839e3)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:09.531620 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d4427e-9d3a-4bd6-9f8f-6ac9af7fecfc admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:09.538479 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1301/2622] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:13:09.543269 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241cda2b-b214-44b8-924e-5db14e02efc7 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:09.557961 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241cda2b-b214-44b8-924e-5db14e02efc7 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:09.566013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843ee55-c815-4fc7-9947-7c17ee07c3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:09.566707 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843ee55-c815-4fc7-9947-7c17ee07c3d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:09.566996 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843ee55-c815-4fc7-9947-7c17ee07c3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:09.567279 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843ee55-c815-4fc7-9947-7c17ee07c3d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:09.568050 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8843ee55-c815-4fc7-9947-7c17ee07c3d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:09.569647 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8843ee55-c815-4fc7-9947-7c17ee07c3d8 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:09.581424 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1302/2623] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:13:09.585815 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843ee55-c815-4fc7-9947-7c17ee07c3d8 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:09.596178 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843ee55-c815-4fc7-9947-7c17ee07c3d8 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:09.600960 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f428f-a3ab-4c79-923b-5979afce7131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:09.602103 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f428f-a3ab-4c79-923b-5979afce7131 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:09.602405 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f428f-a3ab-4c79-923b-5979afce7131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:09.602684 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f428f-a3ab-4c79-923b-5979afce7131 admin admin] PATH_INFO: `/v3/projects/a09488edd3384e10b162631153f2cfe0/users/58dc439cb0dc479291e97cd0c4438349/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:09.622595 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746f428f-a3ab-4c79-923b-5979afce7131 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a09488edd3384e10b162631153f2cfe0, user_id=58dc439cb0dc479291e97cd0c4438349, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:09.622595 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746f428f-a3ab-4c79-923b-5979afce7131 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:09.707436 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1303/2624] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:13:09 2022] PUT /identity/v3/projects/a09488edd3384e10b162631153f2cfe0/users/58dc439cb0dc479291e97cd0c4438349/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:13:09.719095 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f364a-da94-43eb-8e15-3dc8aa577db1 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:09.719393 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f364a-da94-43eb-8e15-3dc8aa577db1 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:09.719673 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f364a-da94-43eb-8e15-3dc8aa577db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:09.756497 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-10d4427e-9d3a-4bd6-9f8f-6ac9af7fecfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a8a8c5fc2db489ca0014203abd839e3'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:09.765839 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-10d4427e-9d3a-4bd6-9f8f-6ac9af7fecfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a8a8c5fc2db489ca0014203abd839e3'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:09.766821 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-983f364a-da94-43eb-8e15-3dc8aa577db1 None None] MFA Rules not processed for user `58dc439cb0dc479291e97cd0c4438349`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:09.766971 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-10d4427e-9d3a-4bd6-9f8f-6ac9af7fecfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a8a8c5fc2db489ca0014203abd839e3'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:09.768324 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-10d4427e-9d3a-4bd6-9f8f-6ac9af7fecfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a8a8c5fc2db489ca0014203abd839e3'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:09.769689 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-983f364a-da94-43eb-8e15-3dc8aa577db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:09.780817 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:09.843667 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-10d4427e-9d3a-4bd6-9f8f-6ac9af7fecfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a8a8c5fc2db489ca0014203abd839e3'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:09.866603 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1304/2625] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:13:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:13:09.868551 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f364a-da94-43eb-8e15-3dc8aa577db1 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:09.870209 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-983f364a-da94-43eb-8e15-3dc8aa577db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:09.875496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1322/2626] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:13:09 2022] DELETE /identity/v3/users/6a8a8c5fc2db489ca0014203abd839e3 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:13:09.881202 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da2507-b2de-49c0-9fd0-b38d7d3a11d2 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:09.881619 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da2507-b2de-49c0-9fd0-b38d7d3a11d2 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:09.882983 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da2507-b2de-49c0-9fd0-b38d7d3a11d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:09.905317 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-57da2507-b2de-49c0-9fd0-b38d7d3a11d2 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:09.906877 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-57da2507-b2de-49c0-9fd0-b38d7d3a11d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:09.926720 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:09.960049 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f364a-da94-43eb-8e15-3dc8aa577db1 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:09.996382 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1323/2627] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:13:10.019065 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da2507-b2de-49c0-9fd0-b38d7d3a11d2 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:10.022908 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-57da2507-b2de-49c0-9fd0-b38d7d3a11d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:10.049532 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456e60b-d68f-4e4e-828a-e3a5af669bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:10.050619 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456e60b-d68f-4e4e-828a-e3a5af669bd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:10.051056 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456e60b-d68f-4e4e-828a-e3a5af669bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:10.051516 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456e60b-d68f-4e4e-828a-e3a5af669bd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:10.052653 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f456e60b-d68f-4e4e-828a-e3a5af669bd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:10.054763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f456e60b-d68f-4e4e-828a-e3a5af669bd2 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:10.113938 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da2507-b2de-49c0-9fd0-b38d7d3a11d2 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:10.117706 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436917bc-021b-4377-a673-a1a59852f7fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:10.118353 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436917bc-021b-4377-a673-a1a59852f7fb service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:10.118637 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436917bc-021b-4377-a673-a1a59852f7fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:10.118914 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436917bc-021b-4377-a673-a1a59852f7fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:10.130109 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436917bc-021b-4377-a673-a1a59852f7fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:10.131872 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436917bc-021b-4377-a673-a1a59852f7fb service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:10.145874 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1324/2628] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:13:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 21:13:10.176168 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1305/2629] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:13:09 2022] POST /identity/v3/projects => generated 375 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:13:10.177306 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436917bc-021b-4377-a673-a1a59852f7fb service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:10.190112 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436917bc-021b-4377-a673-a1a59852f7fb service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:10.279129 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c781593-a41f-4635-b523-5dbb35011038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:10.279803 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c781593-a41f-4635-b523-5dbb35011038 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:10.280122 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c781593-a41f-4635-b523-5dbb35011038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:10.280403 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c781593-a41f-4635-b523-5dbb35011038 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:10.281103 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c781593-a41f-4635-b523-5dbb35011038 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:10.283232 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c781593-a41f-4635-b523-5dbb35011038 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:10.401866 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1325/2630] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:13:10 2022] POST /identity/v3/users => generated 294 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:13:10.405490 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456e60b-d68f-4e4e-828a-e3a5af669bd2 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:10.421059 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456e60b-d68f-4e4e-828a-e3a5af669bd2 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:10.434033 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fff18-6132-4548-b1fd-d048dfc4c9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:10.434832 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fff18-6132-4548-b1fd-d048dfc4c9aa admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:10.435196 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fff18-6132-4548-b1fd-d048dfc4c9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:10.435554 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fff18-6132-4548-b1fd-d048dfc4c9aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:10.436395 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001fff18-6132-4548-b1fd-d048dfc4c9aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:10.438071 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001fff18-6132-4548-b1fd-d048dfc4c9aa admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:10.458300 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1306/2631] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:13:10.462641 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c781593-a41f-4635-b523-5dbb35011038 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:10.474260 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c781593-a41f-4635-b523-5dbb35011038 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:10.479577 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb827ad4-95cd-4b64-bc3d-17e52bd20b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:10.480665 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb827ad4-95cd-4b64-bc3d-17e52bd20b05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:10.481077 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb827ad4-95cd-4b64-bc3d-17e52bd20b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:10.481365 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb827ad4-95cd-4b64-bc3d-17e52bd20b05 admin admin] PATH_INFO: `/v3/projects/dba3aaca53164f24ad1c1b64cd5db385/users/109d1278ccce42479d1d5ac0daff5ec7/roles/86273ff072f3438d822e870272491768` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:10.511809 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb827ad4-95cd-4b64-bc3d-17e52bd20b05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dba3aaca53164f24ad1c1b64cd5db385, user_id=109d1278ccce42479d1d5ac0daff5ec7, role_id=86273ff072f3438d822e870272491768)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:10.518066 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb827ad4-95cd-4b64-bc3d-17e52bd20b05 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:10.615510 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1326/2632] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:13:10 2022] PUT /identity/v3/projects/dba3aaca53164f24ad1c1b64cd5db385/users/109d1278ccce42479d1d5ac0daff5ec7/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:13:10.620163 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fff18-6132-4548-b1fd-d048dfc4c9aa admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:10.631056 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fff18-6132-4548-b1fd-d048dfc4c9aa admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:10.660428 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:10.686359 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb827ad4-95cd-4b64-bc3d-17e52bd20b05 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:10.688041 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-cb827ad4-95cd-4b64-bc3d-17e52bd20b05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:10.712849 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993cb1b4-9eaf-4d22-af6f-efa66c645281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:10.713563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993cb1b4-9eaf-4d22-af6f-efa66c645281 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:10.715211 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993cb1b4-9eaf-4d22-af6f-efa66c645281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:10.715211 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993cb1b4-9eaf-4d22-af6f-efa66c645281 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:10.715211 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993cb1b4-9eaf-4d22-af6f-efa66c645281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:10.716649 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993cb1b4-9eaf-4d22-af6f-efa66c645281 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:10.738266 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1307/2633] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:13:10.739401 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993cb1b4-9eaf-4d22-af6f-efa66c645281 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:10.744930 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:10.749962 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993cb1b4-9eaf-4d22-af6f-efa66c645281 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:10.755258 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f68077-0fe8-4af6-8b3a-772d51b2e373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:10.756208 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f68077-0fe8-4af6-8b3a-772d51b2e373 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:10.756500 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f68077-0fe8-4af6-8b3a-772d51b2e373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:10.756850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f68077-0fe8-4af6-8b3a-772d51b2e373 admin admin] PATH_INFO: `/v3/projects/dba3aaca53164f24ad1c1b64cd5db385/users/109d1278ccce42479d1d5ac0daff5ec7/roles/86273ff072f3438d822e870272491768` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:10.758905 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f68077-0fe8-4af6-8b3a-772d51b2e373 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dba3aaca53164f24ad1c1b64cd5db385, user_id=109d1278ccce42479d1d5ac0daff5ec7, role_id=86273ff072f3438d822e870272491768)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:10.761804 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f68077-0fe8-4af6-8b3a-772d51b2e373 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:10.775123 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1308/2634] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:13:10 2022] PUT /identity/v3/projects/dba3aaca53164f24ad1c1b64cd5db385/users/109d1278ccce42479d1d5ac0daff5ec7/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:13:10.786576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41763a29-34c7-4dee-a32e-492aeb5d50b8 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:10.787053 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41763a29-34c7-4dee-a32e-492aeb5d50b8 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:10.787344 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41763a29-34c7-4dee-a32e-492aeb5d50b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:10.806803 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb827ad4-95cd-4b64-bc3d-17e52bd20b05 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:10.822914 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-41763a29-34c7-4dee-a32e-492aeb5d50b8 None None] MFA Rules not processed for user `109d1278ccce42479d1d5ac0daff5ec7`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:10.824317 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-41763a29-34c7-4dee-a32e-492aeb5d50b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:10.904324 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5575918-e9a9-4a55-9da4-78daf07663b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:10.905419 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5575918-e9a9-4a55-9da4-78daf07663b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:10.905713 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5575918-e9a9-4a55-9da4-78daf07663b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:10.906609 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5575918-e9a9-4a55-9da4-78daf07663b8 admin admin] PATH_INFO: `/v3/projects/137c370868944937b32d04d983109b58` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:10.908379 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5575918-e9a9-4a55-9da4-78daf07663b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=137c370868944937b32d04d983109b58)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:10.910854 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5575918-e9a9-4a55-9da4-78daf07663b8 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:10.919249 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1309/2635] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:13:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:13:10.928426 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41763a29-34c7-4dee-a32e-492aeb5d50b8 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:10.930435 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-41763a29-34c7-4dee-a32e-492aeb5d50b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:11.004208 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41763a29-34c7-4dee-a32e-492aeb5d50b8 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:11.007855 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f776925-a5b5-4c05-954e-62c5bebce1f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:11.008534 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f776925-a5b5-4c05-954e-62c5bebce1f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:11.008820 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f776925-a5b5-4c05-954e-62c5bebce1f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:11.009098 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f776925-a5b5-4c05-954e-62c5bebce1f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:11.055454 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a5575918-e9a9-4a55-9da4-78daf07663b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '137c370868944937b32d04d983109b58', 'request_id': 'req-a5575918-e9a9-4a55-9da4-78daf07663b8'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:11.062012 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a5575918-e9a9-4a55-9da4-78daf07663b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '137c370868944937b32d04d983109b58', 'request_id': 'req-a5575918-e9a9-4a55-9da4-78daf07663b8'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:11.062719 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:11.066656 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f776925-a5b5-4c05-954e-62c5bebce1f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:11.067985 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a5575918-e9a9-4a55-9da4-78daf07663b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '137c370868944937b32d04d983109b58', 'request_id': 'req-a5575918-e9a9-4a55-9da4-78daf07663b8'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:11.068201 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f776925-a5b5-4c05-954e-62c5bebce1f0 service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:11.077499 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1310/2636] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:13:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:13:11.202373 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a5575918-e9a9-4a55-9da4-78daf07663b8 admin admin] The token cache is being invalidate because project 137c370868944937b32d04d983109b58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:13:11.202769 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a5575918-e9a9-4a55-9da4-78daf07663b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:11.203524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a5575918-e9a9-4a55-9da4-78daf07663b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:11.206218 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1327/2637] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:13:10 2022] DELETE /identity/v3/projects/137c370868944937b32d04d983109b58 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:13:11.210844 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f776925-a5b5-4c05-954e-62c5bebce1f0 service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:11.224238 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f776925-a5b5-4c05-954e-62c5bebce1f0 service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:11.317218 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59747093-bb9d-4bd1-bcf5-d4f4c575c9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:11.318287 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59747093-bb9d-4bd1-bcf5-d4f4c575c9e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:11.318653 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59747093-bb9d-4bd1-bcf5-d4f4c575c9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:11.319067 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59747093-bb9d-4bd1-bcf5-d4f4c575c9e0 admin admin] PATH_INFO: `/v3/users/598cec4cf583416eaef719e68bddb820` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:11.320408 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59747093-bb9d-4bd1-bcf5-d4f4c575c9e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=598cec4cf583416eaef719e68bddb820)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:11.322785 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59747093-bb9d-4bd1-bcf5-d4f4c575c9e0 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:11.551874 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-59747093-bb9d-4bd1-bcf5-d4f4c575c9e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '598cec4cf583416eaef719e68bddb820'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:11.559990 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-59747093-bb9d-4bd1-bcf5-d4f4c575c9e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '598cec4cf583416eaef719e68bddb820'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:11.560890 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-59747093-bb9d-4bd1-bcf5-d4f4c575c9e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '598cec4cf583416eaef719e68bddb820'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:11.561499 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-59747093-bb9d-4bd1-bcf5-d4f4c575c9e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '598cec4cf583416eaef719e68bddb820'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:11.674757 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-59747093-bb9d-4bd1-bcf5-d4f4c575c9e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '598cec4cf583416eaef719e68bddb820'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:11.698129 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1311/2638] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:13:11 2022] DELETE /identity/v3/users/598cec4cf583416eaef719e68bddb820 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:13:12.288679 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5575918-e9a9-4a55-9da4-78daf07663b8 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:12.291426 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a5575918-e9a9-4a55-9da4-78daf07663b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:12.311662 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5575918-e9a9-4a55-9da4-78daf07663b8 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:12.381108 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ea7f0-aba7-4013-a56d-e80cd689d3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:12.381983 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ea7f0-aba7-4013-a56d-e80cd689d3b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:12.382272 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ea7f0-aba7-4013-a56d-e80cd689d3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:12.382554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ea7f0-aba7-4013-a56d-e80cd689d3b1 admin admin] PATH_INFO: `/v3/projects/0dd94fdee7bb43dab2bf2d92c1f0bb29` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:12.383760 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ea7f0-aba7-4013-a56d-e80cd689d3b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dd94fdee7bb43dab2bf2d92c1f0bb29)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:12.385768 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ea7f0-aba7-4013-a56d-e80cd689d3b1 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:12.392128 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:12.491734 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-891ea7f0-aba7-4013-a56d-e80cd689d3b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dd94fdee7bb43dab2bf2d92c1f0bb29', 'request_id': 'req-891ea7f0-aba7-4013-a56d-e80cd689d3b1'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:12.498075 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-891ea7f0-aba7-4013-a56d-e80cd689d3b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dd94fdee7bb43dab2bf2d92c1f0bb29', 'request_id': 'req-891ea7f0-aba7-4013-a56d-e80cd689d3b1'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:12.504075 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-891ea7f0-aba7-4013-a56d-e80cd689d3b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dd94fdee7bb43dab2bf2d92c1f0bb29', 'request_id': 'req-891ea7f0-aba7-4013-a56d-e80cd689d3b1'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:12.599132 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-891ea7f0-aba7-4013-a56d-e80cd689d3b1 admin admin] The token cache is being invalidate because project 0dd94fdee7bb43dab2bf2d92c1f0bb29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:13:12.599519 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-891ea7f0-aba7-4013-a56d-e80cd689d3b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:12.600284 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-891ea7f0-aba7-4013-a56d-e80cd689d3b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:12.605709 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1328/2639] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:13:12 2022] DELETE /identity/v3/projects/0dd94fdee7bb43dab2bf2d92c1f0bb29 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:13:12.607042 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59747093-bb9d-4bd1-bcf5-d4f4c575c9e0 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:12.608556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-59747093-bb9d-4bd1-bcf5-d4f4c575c9e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:12.623342 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59747093-bb9d-4bd1-bcf5-d4f4c575c9e0 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:12.689760 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94460f2c-3cdf-4e31-ac1c-473b08a2b9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:12.690859 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94460f2c-3cdf-4e31-ac1c-473b08a2b9eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:12.691157 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94460f2c-3cdf-4e31-ac1c-473b08a2b9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:12.691488 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94460f2c-3cdf-4e31-ac1c-473b08a2b9eb admin admin] PATH_INFO: `/v3/users/f18a48c08fc4431a976d23f5220d0bc0` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:12.692993 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94460f2c-3cdf-4e31-ac1c-473b08a2b9eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f18a48c08fc4431a976d23f5220d0bc0)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:12.695109 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94460f2c-3cdf-4e31-ac1c-473b08a2b9eb admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:12.743420 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:13.891487 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-94460f2c-3cdf-4e31-ac1c-473b08a2b9eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f18a48c08fc4431a976d23f5220d0bc0'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:13.907561 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-94460f2c-3cdf-4e31-ac1c-473b08a2b9eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f18a48c08fc4431a976d23f5220d0bc0'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:13.907561 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-94460f2c-3cdf-4e31-ac1c-473b08a2b9eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f18a48c08fc4431a976d23f5220d0bc0'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:13.907561 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-94460f2c-3cdf-4e31-ac1c-473b08a2b9eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f18a48c08fc4431a976d23f5220d0bc0'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:14.029697 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-94460f2c-3cdf-4e31-ac1c-473b08a2b9eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f18a48c08fc4431a976d23f5220d0bc0'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:14.051504 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1312/2640] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:13:12 2022] DELETE /identity/v3/users/f18a48c08fc4431a976d23f5220d0bc0 => generated 0 bytes in 1445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:13:14.605185 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ea7f0-aba7-4013-a56d-e80cd689d3b1 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:14.607408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-891ea7f0-aba7-4013-a56d-e80cd689d3b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:14.621486 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ea7f0-aba7-4013-a56d-e80cd689d3b1 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:14.734761 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5453066c-9693-4c78-9a73-a2318c0c6987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:14.735673 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453066c-9693-4c78-9a73-a2318c0c6987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:14.735997 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453066c-9693-4c78-9a73-a2318c0c6987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:14.736779 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453066c-9693-4c78-9a73-a2318c0c6987 admin admin] PATH_INFO: `/v3/projects/d97e41251d5f4d99b4579ec17bc90061` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:14.737555 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5453066c-9693-4c78-9a73-a2318c0c6987 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d97e41251d5f4d99b4579ec17bc90061)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:14.739560 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5453066c-9693-4c78-9a73-a2318c0c6987 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:14.848817 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-5453066c-9693-4c78-9a73-a2318c0c6987 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd97e41251d5f4d99b4579ec17bc90061', 'request_id': 'req-5453066c-9693-4c78-9a73-a2318c0c6987'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:14.855718 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-5453066c-9693-4c78-9a73-a2318c0c6987 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd97e41251d5f4d99b4579ec17bc90061', 'request_id': 'req-5453066c-9693-4c78-9a73-a2318c0c6987'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:14.863656 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-5453066c-9693-4c78-9a73-a2318c0c6987 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd97e41251d5f4d99b4579ec17bc90061', 'request_id': 'req-5453066c-9693-4c78-9a73-a2318c0c6987'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:14.936904 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-5453066c-9693-4c78-9a73-a2318c0c6987 admin admin] The token cache is being invalidate because project d97e41251d5f4d99b4579ec17bc90061 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:13:14.937211 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-5453066c-9693-4c78-9a73-a2318c0c6987 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:14.938059 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-5453066c-9693-4c78-9a73-a2318c0c6987 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:14.944417 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1329/2641] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:13:14 2022] DELETE /identity/v3/projects/d97e41251d5f4d99b4579ec17bc90061 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:13:14.946228 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0087b8d-a271-41e4-ba16-e6f376bec178 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:14.946694 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0087b8d-a271-41e4-ba16-e6f376bec178 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:14.946892 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0087b8d-a271-41e4-ba16-e6f376bec178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:14.976796 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5453066c-9693-4c78-9a73-a2318c0c6987 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:14.978321 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-5453066c-9693-4c78-9a73-a2318c0c6987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:14.981871 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-e0087b8d-a271-41e4-ba16-e6f376bec178 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:14.983163 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-e0087b8d-a271-41e4-ba16-e6f376bec178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:15.021679 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:15.070224 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5453066c-9693-4c78-9a73-a2318c0c6987 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:15.075669 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44579687-13c5-4dfd-9e0f-9f96a0160d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:15.076582 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44579687-13c5-4dfd-9e0f-9f96a0160d80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:15.076874 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44579687-13c5-4dfd-9e0f-9f96a0160d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:15.077156 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44579687-13c5-4dfd-9e0f-9f96a0160d80 admin admin] PATH_INFO: `/v3/users/58dc439cb0dc479291e97cd0c4438349` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:15.078351 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44579687-13c5-4dfd-9e0f-9f96a0160d80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58dc439cb0dc479291e97cd0c4438349)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:15.080909 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44579687-13c5-4dfd-9e0f-9f96a0160d80 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:15.081109 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1313/2642] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:13:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:13:15.094182 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39875c-f77d-45e1-bb69-263ee3b0cdeb None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:15.094491 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39875c-f77d-45e1-bb69-263ee3b0cdeb None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:15.094771 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39875c-f77d-45e1-bb69-263ee3b0cdeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:15.114703 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-9a39875c-f77d-45e1-bb69-263ee3b0cdeb None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:15.115873 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-9a39875c-f77d-45e1-bb69-263ee3b0cdeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:15.124278 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1314/2643] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:13:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:13:15.129749 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a39875c-f77d-45e1-bb69-263ee3b0cdeb None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:15.139988 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a39875c-f77d-45e1-bb69-263ee3b0cdeb None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:15.145418 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b32600-acdf-49e3-82fe-303dffd0492f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:15.146586 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b32600-acdf-49e3-82fe-303dffd0492f admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:15.146884 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b32600-acdf-49e3-82fe-303dffd0492f admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:15.147164 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b32600-acdf-49e3-82fe-303dffd0492f admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:15.147940 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b32600-acdf-49e3-82fe-303dffd0492f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:13:15.148404 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b32600-acdf-49e3-82fe-303dffd0492f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:15.150059 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b32600-acdf-49e3-82fe-303dffd0492f admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:15.165098 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1315/2644] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:13:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 21:13:15.169606 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b32600-acdf-49e3-82fe-303dffd0492f admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:15.180973 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b32600-acdf-49e3-82fe-303dffd0492f admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:15.185721 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9971c8-b299-4a9c-9689-100f28db4e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:15.190600 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9971c8-b299-4a9c-9689-100f28db4e28 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:15.190600 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9971c8-b299-4a9c-9689-100f28db4e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:15.190600 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9971c8-b299-4a9c-9689-100f28db4e28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:15.190600 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9971c8-b299-4a9c-9689-100f28db4e28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:15.190600 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9971c8-b299-4a9c-9689-100f28db4e28 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:15.297342 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1316/2645] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:13:15 2022] POST /identity/v3/projects => generated 381 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 21:13:15.302152 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9971c8-b299-4a9c-9689-100f28db4e28 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:15.317574 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-44579687-13c5-4dfd-9e0f-9f96a0160d80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58dc439cb0dc479291e97cd0c4438349'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:15.324480 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-44579687-13c5-4dfd-9e0f-9f96a0160d80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58dc439cb0dc479291e97cd0c4438349'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:15.329146 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-44579687-13c5-4dfd-9e0f-9f96a0160d80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58dc439cb0dc479291e97cd0c4438349'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:15.329146 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-44579687-13c5-4dfd-9e0f-9f96a0160d80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58dc439cb0dc479291e97cd0c4438349'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:15.354816 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:15.366604 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9971c8-b299-4a9c-9689-100f28db4e28 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:15.371303 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519a728-ded1-47d2-8bc9-a98468902dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:15.371992 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519a728-ded1-47d2-8bc9-a98468902dec admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:15.372300 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519a728-ded1-47d2-8bc9-a98468902dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:15.372585 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519a728-ded1-47d2-8bc9-a98468902dec admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:15.373319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3519a728-ded1-47d2-8bc9-a98468902dec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:15.375292 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3519a728-ded1-47d2-8bc9-a98468902dec admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:15.403221 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-44579687-13c5-4dfd-9e0f-9f96a0160d80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58dc439cb0dc479291e97cd0c4438349'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:15.421886 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1330/2646] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:13:14 2022] DELETE /identity/v3/users/58dc439cb0dc479291e97cd0c4438349 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:13:15.427034 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e35946-57ff-4b34-b21c-b77a823bc056 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:15.432625 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e35946-57ff-4b34-b21c-b77a823bc056 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:15.432625 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e35946-57ff-4b34-b21c-b77a823bc056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:15.445812 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-20e35946-57ff-4b34-b21c-b77a823bc056 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:15.447688 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-20e35946-57ff-4b34-b21c-b77a823bc056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:15.483439 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1317/2647] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:13:15 2022] POST /identity/v3/users => generated 291 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 21:13:15.488870 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519a728-ded1-47d2-8bc9-a98468902dec admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:15.490504 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-3519a728-ded1-47d2-8bc9-a98468902dec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:15.509178 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519a728-ded1-47d2-8bc9-a98468902dec admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:15.514412 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1331/2648] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:13:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:13:15.517442 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb72b38-fea7-48c2-82f9-748505af1755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:15.518645 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb72b38-fea7-48c2-82f9-748505af1755 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:15.518645 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb72b38-fea7-48c2-82f9-748505af1755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:15.518896 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb72b38-fea7-48c2-82f9-748505af1755 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:15.519725 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb72b38-fea7-48c2-82f9-748505af1755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:15.521634 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb72b38-fea7-48c2-82f9-748505af1755 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:15.524861 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e35946-57ff-4b34-b21c-b77a823bc056 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:15.526293 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-20e35946-57ff-4b34-b21c-b77a823bc056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:15.532450 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1318/2649] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 21:13:15.536840 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb72b38-fea7-48c2-82f9-748505af1755 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:15.546774 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb72b38-fea7-48c2-82f9-748505af1755 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:15.552274 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6379c6-8b07-4db0-92ae-b3167e381fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:15.552934 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6379c6-8b07-4db0-92ae-b3167e381fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:15.553218 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6379c6-8b07-4db0-92ae-b3167e381fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:15.553509 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6379c6-8b07-4db0-92ae-b3167e381fe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:15.554214 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6379c6-8b07-4db0-92ae-b3167e381fe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:15.555806 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6379c6-8b07-4db0-92ae-b3167e381fe3 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:15.566563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1319/2650] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 21:13:15.575230 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6379c6-8b07-4db0-92ae-b3167e381fe3 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:15.586820 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6379c6-8b07-4db0-92ae-b3167e381fe3 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:15.587921 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e35946-57ff-4b34-b21c-b77a823bc056 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:15.591650 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc05359-ed05-42f1-8a8a-5580e7c1808e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:15.592252 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc18c03-e02d-42ac-95df-e189097f854a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:15.592410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc05359-ed05-42f1-8a8a-5580e7c1808e service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:15.592628 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc05359-ed05-42f1-8a8a-5580e7c1808e service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:15.593034 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc05359-ed05-42f1-8a8a-5580e7c1808e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:15.593383 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc18c03-e02d-42ac-95df-e189097f854a admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:15.593743 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc18c03-e02d-42ac-95df-e189097f854a admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:15.594214 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc18c03-e02d-42ac-95df-e189097f854a admin admin] PATH_INFO: `/v3/projects/831180059c1e47d9bf61acee6ba36602/users/2904aea9f6fe4af897dcb8395827fd48/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:15.603348 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc05359-ed05-42f1-8a8a-5580e7c1808e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:15.607359 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc05359-ed05-42f1-8a8a-5580e7c1808e service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:15.614488 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc18c03-e02d-42ac-95df-e189097f854a admin admin] RBAC: Authorizing `identity:create_grant(project_id=831180059c1e47d9bf61acee6ba36602, user_id=2904aea9f6fe4af897dcb8395827fd48, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:15.615398 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1332/2651] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:13:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:13:15.617213 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc18c03-e02d-42ac-95df-e189097f854a admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:15.711395 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1320/2652] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:13:15 2022] PUT /identity/v3/projects/831180059c1e47d9bf61acee6ba36602/users/2904aea9f6fe4af897dcb8395827fd48/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:13:15.713005 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29dfcc4-067a-4e48-8137-92c42b037371 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:15.713944 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29dfcc4-067a-4e48-8137-92c42b037371 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:15.713944 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29dfcc4-067a-4e48-8137-92c42b037371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:15.742399 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-d29dfcc4-067a-4e48-8137-92c42b037371 None None] MFA Rules not processed for user `2904aea9f6fe4af897dcb8395827fd48`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:15.743367 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-d29dfcc4-067a-4e48-8137-92c42b037371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:15.819598 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1333/2653] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:13:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:13:15.820989 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc18c03-e02d-42ac-95df-e189097f854a admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:15.874929 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:15.890469 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc18c03-e02d-42ac-95df-e189097f854a admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:15.895809 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4855605b-b377-439c-8148-c78bb914f935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:15.896876 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855605b-b377-439c-8148-c78bb914f935 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:15.897168 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855605b-b377-439c-8148-c78bb914f935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:15.897447 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855605b-b377-439c-8148-c78bb914f935 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:15.898147 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4855605b-b377-439c-8148-c78bb914f935 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:15.900077 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4855605b-b377-439c-8148-c78bb914f935 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:15.997199 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1321/2654] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:13:15 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:13:16.001320 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29dfcc4-067a-4e48-8137-92c42b037371 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:16.013193 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29dfcc4-067a-4e48-8137-92c42b037371 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:16.070942 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dacc00a-dc8e-4cd0-a67f-3d7e9978afae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:16.071626 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dacc00a-dc8e-4cd0-a67f-3d7e9978afae admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:16.071916 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dacc00a-dc8e-4cd0-a67f-3d7e9978afae admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:16.072224 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dacc00a-dc8e-4cd0-a67f-3d7e9978afae admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:16.072913 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dacc00a-dc8e-4cd0-a67f-3d7e9978afae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:16.074813 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dacc00a-dc8e-4cd0-a67f-3d7e9978afae admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:16.117831 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4855605b-b377-439c-8148-c78bb914f935 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:16.119682 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-4855605b-b377-439c-8148-c78bb914f935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:16.134493 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4855605b-b377-439c-8148-c78bb914f935 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:16.139193 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab9e4e-8ffd-45a3-bd10-e108b55843d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:16.140120 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab9e4e-8ffd-45a3-bd10-e108b55843d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:16.140439 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab9e4e-8ffd-45a3-bd10-e108b55843d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:16.140715 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab9e4e-8ffd-45a3-bd10-e108b55843d8 admin admin] PATH_INFO: `/v3/projects/a09488edd3384e10b162631153f2cfe0` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:16.142001 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ab9e4e-8ffd-45a3-bd10-e108b55843d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a09488edd3384e10b162631153f2cfe0)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:16.144759 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ab9e4e-8ffd-45a3-bd10-e108b55843d8 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:16.165639 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1334/2655] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:13:16 2022] POST /identity/v3/users => generated 296 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:13:16.168494 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dacc00a-dc8e-4cd0-a67f-3d7e9978afae admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:16.182758 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dacc00a-dc8e-4cd0-a67f-3d7e9978afae admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:16.189701 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7bace-4659-4a44-92c3-fd4778d2f675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:16.190445 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7bace-4659-4a44-92c3-fd4778d2f675 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:16.190660 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7bace-4659-4a44-92c3-fd4778d2f675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:16.190935 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7bace-4659-4a44-92c3-fd4778d2f675 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:16.191665 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f7bace-4659-4a44-92c3-fd4778d2f675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:16.193303 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f7bace-4659-4a44-92c3-fd4778d2f675 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:16.203435 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1335/2656] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 21:13:16.208331 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7bace-4659-4a44-92c3-fd4778d2f675 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:16.218514 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7bace-4659-4a44-92c3-fd4778d2f675 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:16.223450 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10f08e-610c-4b8b-b4f0-e2507edb2b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:16.224368 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10f08e-610c-4b8b-b4f0-e2507edb2b6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:16.224693 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10f08e-610c-4b8b-b4f0-e2507edb2b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:16.224972 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10f08e-610c-4b8b-b4f0-e2507edb2b6d admin admin] PATH_INFO: `/v3/projects/60a084569752436d889bb4a85bda2f9f/users/10c5d70d81334e78bac8240bac2d3a5a/roles/86273ff072f3438d822e870272491768` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:16.240342 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d10f08e-610c-4b8b-b4f0-e2507edb2b6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=60a084569752436d889bb4a85bda2f9f, user_id=10c5d70d81334e78bac8240bac2d3a5a, role_id=86273ff072f3438d822e870272491768)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:16.243046 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d10f08e-610c-4b8b-b4f0-e2507edb2b6d admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:16.245394 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-12ab9e4e-8ffd-45a3-bd10-e108b55843d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a09488edd3384e10b162631153f2cfe0', 'request_id': 'req-12ab9e4e-8ffd-45a3-bd10-e108b55843d8'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:16.252870 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-12ab9e4e-8ffd-45a3-bd10-e108b55843d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a09488edd3384e10b162631153f2cfe0', 'request_id': 'req-12ab9e4e-8ffd-45a3-bd10-e108b55843d8'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:16.258505 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-12ab9e4e-8ffd-45a3-bd10-e108b55843d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a09488edd3384e10b162631153f2cfe0', 'request_id': 'req-12ab9e4e-8ffd-45a3-bd10-e108b55843d8'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:16.337258 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-12ab9e4e-8ffd-45a3-bd10-e108b55843d8 admin admin] The token cache is being invalidate because project a09488edd3384e10b162631153f2cfe0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:13:16.337542 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-12ab9e4e-8ffd-45a3-bd10-e108b55843d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:16.338030 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1336/2657] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:13:16 2022] PUT /identity/v3/projects/60a084569752436d889bb4a85bda2f9f/users/10c5d70d81334e78bac8240bac2d3a5a/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:13:16.340962 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-12ab9e4e-8ffd-45a3-bd10-e108b55843d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:16.341883 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10f08e-610c-4b8b-b4f0-e2507edb2b6d admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:16.342673 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1322/2658] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:13:16 2022] DELETE /identity/v3/projects/a09488edd3384e10b162631153f2cfe0 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:13:16.343751 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-2d10f08e-610c-4b8b-b4f0-e2507edb2b6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:16.346290 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab9e4e-8ffd-45a3-bd10-e108b55843d8 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:16.347609 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-12ab9e4e-8ffd-45a3-bd10-e108b55843d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:16.352703 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:16.379451 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:16.409470 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10f08e-610c-4b8b-b4f0-e2507edb2b6d admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:16.414291 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab9e4e-8ffd-45a3-bd10-e108b55843d8 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:16.414491 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06cb093-26d9-4734-b0ef-c13f624e64df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:16.416771 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cb093-26d9-4734-b0ef-c13f624e64df admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:16.416771 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cb093-26d9-4734-b0ef-c13f624e64df admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:16.416771 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cb093-26d9-4734-b0ef-c13f624e64df admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:16.416771 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06cb093-26d9-4734-b0ef-c13f624e64df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:16.418105 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06cb093-26d9-4734-b0ef-c13f624e64df admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:16.418993 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0842917c-7928-471b-96bb-df77e332f1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:16.419908 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842917c-7928-471b-96bb-df77e332f1b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:16.420228 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842917c-7928-471b-96bb-df77e332f1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:16.420509 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842917c-7928-471b-96bb-df77e332f1b0 admin admin] PATH_INFO: `/v3/users/109d1278ccce42479d1d5ac0daff5ec7` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:16.421721 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0842917c-7928-471b-96bb-df77e332f1b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=109d1278ccce42479d1d5ac0daff5ec7)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:16.424350 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0842917c-7928-471b-96bb-df77e332f1b0 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:16.429301 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1337/2659] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 21:13:16.433573 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06cb093-26d9-4734-b0ef-c13f624e64df admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:16.443901 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06cb093-26d9-4734-b0ef-c13f624e64df admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:16.448734 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd6846-4a7c-40bd-bcd6-ccfbe2ad86e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:16.449617 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd6846-4a7c-40bd-bcd6-ccfbe2ad86e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:16.449901 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd6846-4a7c-40bd-bcd6-ccfbe2ad86e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:16.450177 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd6846-4a7c-40bd-bcd6-ccfbe2ad86e6 admin admin] PATH_INFO: `/v3/projects/60a084569752436d889bb4a85bda2f9f/users/10c5d70d81334e78bac8240bac2d3a5a/roles/86273ff072f3438d822e870272491768` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:16.452351 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd6846-4a7c-40bd-bcd6-ccfbe2ad86e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60a084569752436d889bb4a85bda2f9f, user_id=10c5d70d81334e78bac8240bac2d3a5a, role_id=86273ff072f3438d822e870272491768)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:16.455918 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd6846-4a7c-40bd-bcd6-ccfbe2ad86e6 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:16.466604 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1338/2660] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:13:16 2022] PUT /identity/v3/projects/60a084569752436d889bb4a85bda2f9f/users/10c5d70d81334e78bac8240bac2d3a5a/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:13:16.534184 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717eaf9-9745-4591-b9e6-8886bf3644d3 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:16.534489 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717eaf9-9745-4591-b9e6-8886bf3644d3 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:16.534775 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717eaf9-9745-4591-b9e6-8886bf3644d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:16.560696 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-e717eaf9-9745-4591-b9e6-8886bf3644d3 None None] MFA Rules not processed for user `10c5d70d81334e78bac8240bac2d3a5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:16.561920 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-e717eaf9-9745-4591-b9e6-8886bf3644d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:16.620736 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-0842917c-7928-471b-96bb-df77e332f1b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '109d1278ccce42479d1d5ac0daff5ec7'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:16.628037 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-0842917c-7928-471b-96bb-df77e332f1b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '109d1278ccce42479d1d5ac0daff5ec7'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:16.628711 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-0842917c-7928-471b-96bb-df77e332f1b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '109d1278ccce42479d1d5ac0daff5ec7'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:16.629331 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-0842917c-7928-471b-96bb-df77e332f1b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '109d1278ccce42479d1d5ac0daff5ec7'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:16.631627 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1339/2661] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:13:16 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:13:16.643146 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717eaf9-9745-4591-b9e6-8886bf3644d3 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:16.644500 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-e717eaf9-9745-4591-b9e6-8886bf3644d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:16.703206 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-0842917c-7928-471b-96bb-df77e332f1b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '109d1278ccce42479d1d5ac0daff5ec7'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:16.703419 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717eaf9-9745-4591-b9e6-8886bf3644d3 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:16.708182 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce55ac-6ccc-4835-8bc8-468654a59eb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:16.708840 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce55ac-6ccc-4835-8bc8-468654a59eb4 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:16.709134 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce55ac-6ccc-4835-8bc8-468654a59eb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:16.709413 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce55ac-6ccc-4835-8bc8-468654a59eb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:16.711259 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-6fce55ac-6ccc-4835-8bc8-468654a59eb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:16.724457 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1323/2662] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:13:16 2022] DELETE /identity/v3/users/109d1278ccce42479d1d5ac0daff5ec7 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:13:16.724610 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce55ac-6ccc-4835-8bc8-468654a59eb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:16.726031 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce55ac-6ccc-4835-8bc8-468654a59eb4 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:16.736471 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1340/2663] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:13:16 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 21:13:17.249035 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0842917c-7928-471b-96bb-df77e332f1b0 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:17.249035 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-0842917c-7928-471b-96bb-df77e332f1b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:17.321409 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0842917c-7928-471b-96bb-df77e332f1b0 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:17.327857 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0cd31d-db58-4185-8c3b-eb939d6745ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:17.328822 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cd31d-db58-4185-8c3b-eb939d6745ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:17.329169 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cd31d-db58-4185-8c3b-eb939d6745ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:17.329597 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cd31d-db58-4185-8c3b-eb939d6745ee admin admin] PATH_INFO: `/v3/projects/dba3aaca53164f24ad1c1b64cd5db385` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:17.331632 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0cd31d-db58-4185-8c3b-eb939d6745ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=dba3aaca53164f24ad1c1b64cd5db385)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:17.333696 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0cd31d-db58-4185-8c3b-eb939d6745ee admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:17.343668 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce55ac-6ccc-4835-8bc8-468654a59eb4 service cinder] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:17.346294 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-6fce55ac-6ccc-4835-8bc8-468654a59eb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:17.361873 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:17.395091 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:17.414366 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce55ac-6ccc-4835-8bc8-468654a59eb4 service cinder] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:17.419628 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522a647-6df3-44db-978f-4e4edb9e57ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:17.420232 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522a647-6df3-44db-978f-4e4edb9e57ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:17.420594 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522a647-6df3-44db-978f-4e4edb9e57ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:17.420970 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522a647-6df3-44db-978f-4e4edb9e57ec admin admin] PATH_INFO: `/v3/users/2904aea9f6fe4af897dcb8395827fd48` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:17.422272 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6522a647-6df3-44db-978f-4e4edb9e57ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=2904aea9f6fe4af897dcb8395827fd48)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:17.425198 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6522a647-6df3-44db-978f-4e4edb9e57ec admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:17.442551 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-1c0cd31d-db58-4185-8c3b-eb939d6745ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dba3aaca53164f24ad1c1b64cd5db385', 'request_id': 'req-1c0cd31d-db58-4185-8c3b-eb939d6745ee'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:17.449311 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-1c0cd31d-db58-4185-8c3b-eb939d6745ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dba3aaca53164f24ad1c1b64cd5db385', 'request_id': 'req-1c0cd31d-db58-4185-8c3b-eb939d6745ee'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:17.460108 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-1c0cd31d-db58-4185-8c3b-eb939d6745ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dba3aaca53164f24ad1c1b64cd5db385', 'request_id': 'req-1c0cd31d-db58-4185-8c3b-eb939d6745ee'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:17.524782 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-1c0cd31d-db58-4185-8c3b-eb939d6745ee admin admin] The token cache is being invalidate because project dba3aaca53164f24ad1c1b64cd5db385 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:13:17.525194 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-1c0cd31d-db58-4185-8c3b-eb939d6745ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:17.525919 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-1c0cd31d-db58-4185-8c3b-eb939d6745ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:17.527526 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1324/2664] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:13:17 2022] DELETE /identity/v3/projects/dba3aaca53164f24ad1c1b64cd5db385 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:13:17.532314 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8f48b-589d-48e5-aff2-8687c9d188e2 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:17.533144 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8f48b-589d-48e5-aff2-8687c9d188e2 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:17.533476 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8f48b-589d-48e5-aff2-8687c9d188e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:17.553447 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-dbf8f48b-589d-48e5-aff2-8687c9d188e2 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:17.553854 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-6522a647-6df3-44db-978f-4e4edb9e57ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2904aea9f6fe4af897dcb8395827fd48'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:17.554937 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-dbf8f48b-589d-48e5-aff2-8687c9d188e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:17.561350 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-6522a647-6df3-44db-978f-4e4edb9e57ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2904aea9f6fe4af897dcb8395827fd48'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:17.562225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-6522a647-6df3-44db-978f-4e4edb9e57ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2904aea9f6fe4af897dcb8395827fd48'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:17.562937 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-6522a647-6df3-44db-978f-4e4edb9e57ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2904aea9f6fe4af897dcb8395827fd48'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:17.614368 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-6522a647-6df3-44db-978f-4e4edb9e57ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2904aea9f6fe4af897dcb8395827fd48'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:17.614615 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1325/2665] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:13:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:13:17.623302 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b5eae-f37e-45fb-95f0-6d054a1c7d00 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:17.623591 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b5eae-f37e-45fb-95f0-6d054a1c7d00 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:17.623871 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b5eae-f37e-45fb-95f0-6d054a1c7d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:17.633229 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1341/2666] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:13:17 2022] DELETE /identity/v3/users/2904aea9f6fe4af897dcb8395827fd48 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:13:17.637492 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b33190-4b8b-41a9-a93e-3518418075a9 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:17.637799 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b33190-4b8b-41a9-a93e-3518418075a9 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:17.638076 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b33190-4b8b-41a9-a93e-3518418075a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:17.643214 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-ae6b5eae-f37e-45fb-95f0-6d054a1c7d00 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:17.644457 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-ae6b5eae-f37e-45fb-95f0-6d054a1c7d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:17.655677 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-11b33190-4b8b-41a9-a93e-3518418075a9 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:17.656920 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-11b33190-4b8b-41a9-a93e-3518418075a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:17.710035 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1326/2667] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:13:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:13:17.714245 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b5eae-f37e-45fb-95f0-6d054a1c7d00 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:17.716709 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1342/2668] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:13:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:13:17.724140 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b5eae-f37e-45fb-95f0-6d054a1c7d00 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:17.726606 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b33190-4b8b-41a9-a93e-3518418075a9 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:17.727919 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-11b33190-4b8b-41a9-a93e-3518418075a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:17.729066 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c6bdb-3436-482d-8c58-99054c8e0e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:17.729777 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c6bdb-3436-482d-8c58-99054c8e0e0b admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:17.730066 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c6bdb-3436-482d-8c58-99054c8e0e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:17.730342 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c6bdb-3436-482d-8c58-99054c8e0e0b admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:17.731073 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c6bdb-3436-482d-8c58-99054c8e0e0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:13:17.731547 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c6bdb-3436-482d-8c58-99054c8e0e0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:17.733072 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c6bdb-3436-482d-8c58-99054c8e0e0b admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:17.745054 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1327/2669] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 21:13:17.750132 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c6bdb-3436-482d-8c58-99054c8e0e0b admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:17.761413 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c6bdb-3436-482d-8c58-99054c8e0e0b admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:17.766940 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bfdadd-ed86-472e-8140-2b2bf22559ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:17.768547 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfdadd-ed86-472e-8140-2b2bf22559ec admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:17.768940 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfdadd-ed86-472e-8140-2b2bf22559ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:17.769318 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfdadd-ed86-472e-8140-2b2bf22559ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:17.770155 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bfdadd-ed86-472e-8140-2b2bf22559ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:17.772456 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bfdadd-ed86-472e-8140-2b2bf22559ec admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:17.786745 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b33190-4b8b-41a9-a93e-3518418075a9 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:17.790435 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e0e32-031a-4057-bbde-480cb2ce5563 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:17.791089 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e0e32-031a-4057-bbde-480cb2ce5563 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:17.791374 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e0e32-031a-4057-bbde-480cb2ce5563 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:17.791652 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e0e32-031a-4057-bbde-480cb2ce5563 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:17.800845 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e0e32-031a-4057-bbde-480cb2ce5563 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:17.802268 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e0e32-031a-4057-bbde-480cb2ce5563 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:17.811633 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1343/2670] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:13:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 21:13:17.859790 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1328/2671] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:13:17 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 21:13:17.864483 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e0e32-031a-4057-bbde-480cb2ce5563 service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:17.870522 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:17.875246 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e0e32-031a-4057-bbde-480cb2ce5563 service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:17.932456 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77882b80-b82c-4c6a-ba35-0002ffb52faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:17.933129 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77882b80-b82c-4c6a-ba35-0002ffb52faf admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:17.933416 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77882b80-b82c-4c6a-ba35-0002ffb52faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:17.933695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77882b80-b82c-4c6a-ba35-0002ffb52faf admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:17.934377 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77882b80-b82c-4c6a-ba35-0002ffb52faf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:17.936320 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77882b80-b82c-4c6a-ba35-0002ffb52faf admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:18.041256 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1344/2672] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:13:17 2022] POST /identity/v3/users => generated 287 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:13:18.045300 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bfdadd-ed86-472e-8140-2b2bf22559ec admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:18.056488 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bfdadd-ed86-472e-8140-2b2bf22559ec admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:18.061179 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff3d8f-4dea-4fbe-a89c-a18c43d28087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:18.061859 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff3d8f-4dea-4fbe-a89c-a18c43d28087 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:18.069910 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff3d8f-4dea-4fbe-a89c-a18c43d28087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:18.069910 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff3d8f-4dea-4fbe-a89c-a18c43d28087 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:18.069910 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff3d8f-4dea-4fbe-a89c-a18c43d28087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:18.069910 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff3d8f-4dea-4fbe-a89c-a18c43d28087 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:18.075842 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1329/2673] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:13:18.080384 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77882b80-b82c-4c6a-ba35-0002ffb52faf admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:18.091187 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77882b80-b82c-4c6a-ba35-0002ffb52faf admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:18.096055 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3546186-c124-4353-9bfe-c14753a7404f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:18.098605 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3546186-c124-4353-9bfe-c14753a7404f admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:18.098605 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3546186-c124-4353-9bfe-c14753a7404f admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:18.098605 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3546186-c124-4353-9bfe-c14753a7404f admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:18.098605 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3546186-c124-4353-9bfe-c14753a7404f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:18.099763 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3546186-c124-4353-9bfe-c14753a7404f admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:18.110529 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1345/2674] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:13:18.115505 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff3d8f-4dea-4fbe-a89c-a18c43d28087 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:18.131154 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff3d8f-4dea-4fbe-a89c-a18c43d28087 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:18.137441 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c96a8-6805-45bb-9c33-983c30747124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:18.138835 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c96a8-6805-45bb-9c33-983c30747124 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:18.139753 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c96a8-6805-45bb-9c33-983c30747124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:18.139753 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c96a8-6805-45bb-9c33-983c30747124 admin admin] PATH_INFO: `/v3/projects/23d2795587df4c0aa151cc36516cd9c0/users/899ae10d2d0d48b997d76846ebcdc6ca/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:18.142405 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:18.158951 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c96a8-6805-45bb-9c33-983c30747124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23d2795587df4c0aa151cc36516cd9c0, user_id=899ae10d2d0d48b997d76846ebcdc6ca, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:18.161840 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c96a8-6805-45bb-9c33-983c30747124 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:18.243962 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1330/2675] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:13:18 2022] PUT /identity/v3/projects/23d2795587df4c0aa151cc36516cd9c0/users/899ae10d2d0d48b997d76846ebcdc6ca/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:13:18.245250 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3546186-c124-4353-9bfe-c14753a7404f admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:18.247505 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a3546186-c124-4353-9bfe-c14753a7404f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:18.261909 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3546186-c124-4353-9bfe-c14753a7404f admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:18.319048 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87665931-63b8-411c-843a-92382f54e5b2 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:18.320049 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87665931-63b8-411c-843a-92382f54e5b2 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:18.320518 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87665931-63b8-411c-843a-92382f54e5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:18.349369 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb1bc8-6036-4b65-b07c-21e49c3b1aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:18.350574 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb1bc8-6036-4b65-b07c-21e49c3b1aec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:18.355819 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb1bc8-6036-4b65-b07c-21e49c3b1aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:18.355819 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb1bc8-6036-4b65-b07c-21e49c3b1aec admin admin] PATH_INFO: `/v3/projects/831180059c1e47d9bf61acee6ba36602` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:18.355819 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb1bc8-6036-4b65-b07c-21e49c3b1aec admin admin] RBAC: Authorizing `identity:delete_project(project_id=831180059c1e47d9bf61acee6ba36602)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:18.356171 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-87665931-63b8-411c-843a-92382f54e5b2 None None] MFA Rules not processed for user `899ae10d2d0d48b997d76846ebcdc6ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:18.356171 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-87665931-63b8-411c-843a-92382f54e5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:18.356371 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb1bc8-6036-4b65-b07c-21e49c3b1aec admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:18.430909 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1331/2676] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:13:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:13:18.442310 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87665931-63b8-411c-843a-92382f54e5b2 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:18.443675 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-87665931-63b8-411c-843a-92382f54e5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:18.494843 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-5efb1bc8-6036-4b65-b07c-21e49c3b1aec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '831180059c1e47d9bf61acee6ba36602', 'request_id': 'req-5efb1bc8-6036-4b65-b07c-21e49c3b1aec'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:18.497096 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-5efb1bc8-6036-4b65-b07c-21e49c3b1aec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '831180059c1e47d9bf61acee6ba36602', 'request_id': 'req-5efb1bc8-6036-4b65-b07c-21e49c3b1aec'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:18.506366 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-5efb1bc8-6036-4b65-b07c-21e49c3b1aec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '831180059c1e47d9bf61acee6ba36602', 'request_id': 'req-5efb1bc8-6036-4b65-b07c-21e49c3b1aec'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:18.518065 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87665931-63b8-411c-843a-92382f54e5b2 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:18.569538 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53aed1a-e79d-407a-b688-f7915ed4af46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:18.570440 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53aed1a-e79d-407a-b688-f7915ed4af46 service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:18.570729 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53aed1a-e79d-407a-b688-f7915ed4af46 service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:18.571005 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53aed1a-e79d-407a-b688-f7915ed4af46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:18.584957 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-5efb1bc8-6036-4b65-b07c-21e49c3b1aec admin admin] The token cache is being invalidate because project 831180059c1e47d9bf61acee6ba36602 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:13:18.585890 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-5efb1bc8-6036-4b65-b07c-21e49c3b1aec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:18.586012 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-5efb1bc8-6036-4b65-b07c-21e49c3b1aec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:18.591218 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1346/2677] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:13:18 2022] DELETE /identity/v3/projects/831180059c1e47d9bf61acee6ba36602 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:13:18.592603 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb1bc8-6036-4b65-b07c-21e49c3b1aec admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:18.594063 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-5efb1bc8-6036-4b65-b07c-21e49c3b1aec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:18.609437 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:18.622087 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:18.637258 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53aed1a-e79d-407a-b688-f7915ed4af46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:18.638260 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53aed1a-e79d-407a-b688-f7915ed4af46 service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:18.650192 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1332/2678] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:13:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 21:13:18.675641 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb1bc8-6036-4b65-b07c-21e49c3b1aec admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:18.680544 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ced332-7eda-4606-bd3d-c266100df4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:18.685052 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ced332-7eda-4606-bd3d-c266100df4a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:18.685052 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ced332-7eda-4606-bd3d-c266100df4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:18.685052 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ced332-7eda-4606-bd3d-c266100df4a3 admin admin] PATH_INFO: `/v3/users/10c5d70d81334e78bac8240bac2d3a5a` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:18.685052 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ced332-7eda-4606-bd3d-c266100df4a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10c5d70d81334e78bac8240bac2d3a5a)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:18.685557 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ced332-7eda-4606-bd3d-c266100df4a3 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:18.895618 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-45ced332-7eda-4606-bd3d-c266100df4a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10c5d70d81334e78bac8240bac2d3a5a'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:18.902909 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-45ced332-7eda-4606-bd3d-c266100df4a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10c5d70d81334e78bac8240bac2d3a5a'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:18.903627 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-45ced332-7eda-4606-bd3d-c266100df4a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10c5d70d81334e78bac8240bac2d3a5a'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:18.904264 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-45ced332-7eda-4606-bd3d-c266100df4a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10c5d70d81334e78bac8240bac2d3a5a'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:18.966290 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-45ced332-7eda-4606-bd3d-c266100df4a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10c5d70d81334e78bac8240bac2d3a5a'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:18.988394 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1347/2679] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:13:18 2022] DELETE /identity/v3/users/10c5d70d81334e78bac8240bac2d3a5a => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:13:19.426319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53aed1a-e79d-407a-b688-f7915ed4af46 service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:19.444479 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53aed1a-e79d-407a-b688-f7915ed4af46 service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:19.525241 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa98ae-19c4-4fbe-bae8-3579c582eeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:19.526194 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa98ae-19c4-4fbe-bae8-3579c582eeb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:19.526484 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa98ae-19c4-4fbe-bae8-3579c582eeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:19.526761 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa98ae-19c4-4fbe-bae8-3579c582eeb0 admin admin] PATH_INFO: `/v3/projects/60a084569752436d889bb4a85bda2f9f` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:19.528083 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fa98ae-19c4-4fbe-bae8-3579c582eeb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60a084569752436d889bb4a85bda2f9f)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:19.530735 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fa98ae-19c4-4fbe-bae8-3579c582eeb0 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:19.636766 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-f7fa98ae-19c4-4fbe-bae8-3579c582eeb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60a084569752436d889bb4a85bda2f9f', 'request_id': 'req-f7fa98ae-19c4-4fbe-bae8-3579c582eeb0'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:19.643499 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-f7fa98ae-19c4-4fbe-bae8-3579c582eeb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60a084569752436d889bb4a85bda2f9f', 'request_id': 'req-f7fa98ae-19c4-4fbe-bae8-3579c582eeb0'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:19.649776 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-f7fa98ae-19c4-4fbe-bae8-3579c582eeb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60a084569752436d889bb4a85bda2f9f', 'request_id': 'req-f7fa98ae-19c4-4fbe-bae8-3579c582eeb0'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:19.738319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-f7fa98ae-19c4-4fbe-bae8-3579c582eeb0 admin admin] The token cache is being invalidate because project 60a084569752436d889bb4a85bda2f9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:13:19.738620 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-f7fa98ae-19c4-4fbe-bae8-3579c582eeb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:19.739260 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-f7fa98ae-19c4-4fbe-bae8-3579c582eeb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:19.740859 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1333/2680] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:13:19 2022] DELETE /identity/v3/projects/60a084569752436d889bb4a85bda2f9f => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:13:19.745754 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9ffec-fdb4-4cec-8e08-ef1d071693f3 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:19.746217 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9ffec-fdb4-4cec-8e08-ef1d071693f3 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:19.746327 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9ffec-fdb4-4cec-8e08-ef1d071693f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:19.764594 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-a7a9ffec-fdb4-4cec-8e08-ef1d071693f3 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:19.765891 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a7a9ffec-fdb4-4cec-8e08-ef1d071693f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:19.825738 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1348/2681] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:13:19.833766 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d987a-045b-46d7-9da4-579fcee6607b None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:19.834087 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d987a-045b-46d7-9da4-579fcee6607b None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:19.834375 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d987a-045b-46d7-9da4-579fcee6607b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:19.853021 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-ae0d987a-045b-46d7-9da4-579fcee6607b None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:19.854159 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-ae0d987a-045b-46d7-9da4-579fcee6607b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:19.862788 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1334/2682] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:13:19.867131 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9ffec-fdb4-4cec-8e08-ef1d071693f3 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:19.877037 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9ffec-fdb4-4cec-8e08-ef1d071693f3 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:19.883222 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d93b3-9a54-450b-8df5-a3f28df69846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:19.883222 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d93b3-9a54-450b-8df5-a3f28df69846 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:19.883222 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d93b3-9a54-450b-8df5-a3f28df69846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:19.883222 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d93b3-9a54-450b-8df5-a3f28df69846 admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:19.883615 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86d93b3-9a54-450b-8df5-a3f28df69846 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:13:19.883849 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86d93b3-9a54-450b-8df5-a3f28df69846 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:19.885476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86d93b3-9a54-450b-8df5-a3f28df69846 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:19.897167 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1349/2683] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:13:19.901599 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d987a-045b-46d7-9da4-579fcee6607b None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:19.911698 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d987a-045b-46d7-9da4-579fcee6607b None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:19.916459 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de3b269-f4f7-4980-90aa-d81e3059df27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:19.917116 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3b269-f4f7-4980-90aa-d81e3059df27 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:19.917405 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3b269-f4f7-4980-90aa-d81e3059df27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:19.917742 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3b269-f4f7-4980-90aa-d81e3059df27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:19.918452 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de3b269-f4f7-4980-90aa-d81e3059df27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:19.920433 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de3b269-f4f7-4980-90aa-d81e3059df27 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:20.039276 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1335/2684] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:13:19 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:13:20.043551 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d93b3-9a54-450b-8df5-a3f28df69846 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:20.054082 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d93b3-9a54-450b-8df5-a3f28df69846 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:20.070567 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:20.109232 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c28ed-3b16-4a33-8b06-925b4a482ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:20.109834 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c28ed-3b16-4a33-8b06-925b4a482ac8 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:20.110126 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c28ed-3b16-4a33-8b06-925b4a482ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:20.110410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c28ed-3b16-4a33-8b06-925b4a482ac8 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:20.111107 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610c28ed-3b16-4a33-8b06-925b4a482ac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:20.113187 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610c28ed-3b16-4a33-8b06-925b4a482ac8 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:20.226488 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1350/2685] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:13:20 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 21:13:20.230807 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de3b269-f4f7-4980-90aa-d81e3059df27 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:20.241505 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de3b269-f4f7-4980-90aa-d81e3059df27 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:20.246164 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d18e13-29c4-481b-bd00-a6b544081e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:20.246825 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d18e13-29c4-481b-bd00-a6b544081e20 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:20.247110 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d18e13-29c4-481b-bd00-a6b544081e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:20.247386 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d18e13-29c4-481b-bd00-a6b544081e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:20.248148 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d18e13-29c4-481b-bd00-a6b544081e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:20.249723 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d18e13-29c4-481b-bd00-a6b544081e20 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:20.260358 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1336/2686] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:13:20.264255 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c28ed-3b16-4a33-8b06-925b4a482ac8 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:20.274969 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c28ed-3b16-4a33-8b06-925b4a482ac8 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:20.279552 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df62a0-26c7-446a-bffe-527cb6fa111e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:20.280241 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df62a0-26c7-446a-bffe-527cb6fa111e admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:20.280532 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df62a0-26c7-446a-bffe-527cb6fa111e admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:20.280814 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df62a0-26c7-446a-bffe-527cb6fa111e admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:20.281535 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03df62a0-26c7-446a-bffe-527cb6fa111e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:20.283760 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03df62a0-26c7-446a-bffe-527cb6fa111e admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:20.294101 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1351/2687] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:13:20.298283 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d18e13-29c4-481b-bd00-a6b544081e20 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:20.308235 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d18e13-29c4-481b-bd00-a6b544081e20 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:20.312777 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec18b53-e9c4-4c87-8128-d23b0fe1286e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:20.313649 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec18b53-e9c4-4c87-8128-d23b0fe1286e admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:20.313956 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec18b53-e9c4-4c87-8128-d23b0fe1286e admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:20.314232 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec18b53-e9c4-4c87-8128-d23b0fe1286e admin admin] PATH_INFO: `/v3/projects/72b6e287e9f94ba58ddcf431cc9c7950/users/f33f2946a39b491797996098c049e24a/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:20.328341 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec18b53-e9c4-4c87-8128-d23b0fe1286e admin admin] RBAC: Authorizing `identity:create_grant(project_id=72b6e287e9f94ba58ddcf431cc9c7950, user_id=f33f2946a39b491797996098c049e24a, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:20.331646 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec18b53-e9c4-4c87-8128-d23b0fe1286e admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:20.406377 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1337/2688] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:13:20 2022] PUT /identity/v3/projects/72b6e287e9f94ba58ddcf431cc9c7950/users/f33f2946a39b491797996098c049e24a/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:13:20.418525 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a375617-95f7-4a4e-a3dd-0fff5c96045e None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:20.420882 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a375617-95f7-4a4e-a3dd-0fff5c96045e None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:20.420882 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a375617-95f7-4a4e-a3dd-0fff5c96045e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:20.447515 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-5a375617-95f7-4a4e-a3dd-0fff5c96045e None None] MFA Rules not processed for user `f33f2946a39b491797996098c049e24a`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:20.448763 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-5a375617-95f7-4a4e-a3dd-0fff5c96045e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:20.522830 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1352/2689] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:13:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:13:20.525053 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec18b53-e9c4-4c87-8128-d23b0fe1286e admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:20.535691 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:20.607356 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec18b53-e9c4-4c87-8128-d23b0fe1286e admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:20.613890 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd6560-0600-4370-a8e4-d70550c4139b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:20.618938 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd6560-0600-4370-a8e4-d70550c4139b admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:20.619245 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd6560-0600-4370-a8e4-d70550c4139b admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:20.619532 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd6560-0600-4370-a8e4-d70550c4139b admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:20.620289 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd6560-0600-4370-a8e4-d70550c4139b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:20.622438 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd6560-0600-4370-a8e4-d70550c4139b admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:20.740256 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1338/2690] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:13:20 2022] POST /identity/v3/projects => generated 385 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 21:13:20.744366 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a375617-95f7-4a4e-a3dd-0fff5c96045e None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:20.756307 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a375617-95f7-4a4e-a3dd-0fff5c96045e None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:20.828385 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807f166-ffb2-473f-be2d-311f7b416d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:20.829551 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807f166-ffb2-473f-be2d-311f7b416d41 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:20.830391 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807f166-ffb2-473f-be2d-311f7b416d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:20.830678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807f166-ffb2-473f-be2d-311f7b416d41 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:20.831408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a807f166-ffb2-473f-be2d-311f7b416d41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:20.833409 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a807f166-ffb2-473f-be2d-311f7b416d41 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:20.925062 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1353/2691] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:13:20 2022] POST /identity/v3/users => generated 299 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:13:20.927677 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd6560-0600-4370-a8e4-d70550c4139b admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:20.937911 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd6560-0600-4370-a8e4-d70550c4139b admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:20.943108 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee4c24-150c-4a8d-af8e-e3b3b043780f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:20.943768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee4c24-150c-4a8d-af8e-e3b3b043780f admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:20.944086 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee4c24-150c-4a8d-af8e-e3b3b043780f admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:20.944364 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee4c24-150c-4a8d-af8e-e3b3b043780f admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:20.947932 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee4c24-150c-4a8d-af8e-e3b3b043780f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:20.949563 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee4c24-150c-4a8d-af8e-e3b3b043780f admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:20.963174 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1339/2692] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:13:20.967690 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807f166-ffb2-473f-be2d-311f7b416d41 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:20.978321 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807f166-ffb2-473f-be2d-311f7b416d41 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:20.983005 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d5152-2250-4c00-bc7e-971bfbf0b78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:20.984121 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d5152-2250-4c00-bc7e-971bfbf0b78a admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:20.984250 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d5152-2250-4c00-bc7e-971bfbf0b78a admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:20.984479 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d5152-2250-4c00-bc7e-971bfbf0b78a admin admin] PATH_INFO: `/v3/projects/6234d6edb0f343b1baa8f93b9405101d/users/451e98c582734a7493d3934b1246efbd/roles/86273ff072f3438d822e870272491768` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:21.001320 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d5152-2250-4c00-bc7e-971bfbf0b78a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6234d6edb0f343b1baa8f93b9405101d, user_id=451e98c582734a7493d3934b1246efbd, role_id=86273ff072f3438d822e870272491768)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:21.004460 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d5152-2250-4c00-bc7e-971bfbf0b78a admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:21.006716 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:21.113282 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1354/2693] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:13:20 2022] PUT /identity/v3/projects/6234d6edb0f343b1baa8f93b9405101d/users/451e98c582734a7493d3934b1246efbd/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:13:21.117178 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee4c24-150c-4a8d-af8e-e3b3b043780f admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:21.128378 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee4c24-150c-4a8d-af8e-e3b3b043780f admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:21.187113 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adfc68f-499b-467b-8cc2-e65971b9d9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:21.187718 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfc68f-499b-467b-8cc2-e65971b9d9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:21.188059 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfc68f-499b-467b-8cc2-e65971b9d9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:21.188341 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfc68f-499b-467b-8cc2-e65971b9d9e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:21.189085 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adfc68f-499b-467b-8cc2-e65971b9d9e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:21.191299 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adfc68f-499b-467b-8cc2-e65971b9d9e5 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:21.201586 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1340/2694] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 21:13:21.205834 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d5152-2250-4c00-bc7e-971bfbf0b78a admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:21.216788 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d5152-2250-4c00-bc7e-971bfbf0b78a admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:21.222055 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa5714-8c01-4f32-aa8a-15dc3fa1a77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:21.223012 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa5714-8c01-4f32-aa8a-15dc3fa1a77b admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:21.223312 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa5714-8c01-4f32-aa8a-15dc3fa1a77b admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:21.223595 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa5714-8c01-4f32-aa8a-15dc3fa1a77b admin admin] PATH_INFO: `/v3/projects/6234d6edb0f343b1baa8f93b9405101d/users/451e98c582734a7493d3934b1246efbd/roles/86273ff072f3438d822e870272491768` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:21.225695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa5714-8c01-4f32-aa8a-15dc3fa1a77b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6234d6edb0f343b1baa8f93b9405101d, user_id=451e98c582734a7493d3934b1246efbd, role_id=86273ff072f3438d822e870272491768)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:21.230959 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa5714-8c01-4f32-aa8a-15dc3fa1a77b admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:21.243852 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1355/2695] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:13:21 2022] PUT /identity/v3/projects/6234d6edb0f343b1baa8f93b9405101d/users/451e98c582734a7493d3934b1246efbd/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:13:21.260310 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91493006-6d81-4094-9b71-46f6d3c7fcce None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:21.260615 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91493006-6d81-4094-9b71-46f6d3c7fcce None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:21.260887 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91493006-6d81-4094-9b71-46f6d3c7fcce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:21.290075 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-91493006-6d81-4094-9b71-46f6d3c7fcce None None] MFA Rules not processed for user `451e98c582734a7493d3934b1246efbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:21.291282 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-91493006-6d81-4094-9b71-46f6d3c7fcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:21.360029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1341/2696] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:13:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:13:21.373832 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa5714-8c01-4f32-aa8a-15dc3fa1a77b admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:21.377033 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-95fa5714-8c01-4f32-aa8a-15dc3fa1a77b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:21.440319 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa5714-8c01-4f32-aa8a-15dc3fa1a77b admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:21.444059 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc52fb0-4799-4a32-83b8-2f2a88fa3c49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:21.444717 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc52fb0-4799-4a32-83b8-2f2a88fa3c49 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:21.445018 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc52fb0-4799-4a32-83b8-2f2a88fa3c49 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:21.445309 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc52fb0-4799-4a32-83b8-2f2a88fa3c49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:21.503058 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc52fb0-4799-4a32-83b8-2f2a88fa3c49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:21.504550 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc52fb0-4799-4a32-83b8-2f2a88fa3c49 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:21.513539 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1356/2697] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:13:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:13:22.350541 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa3593-14f0-4e03-94f8-33216c66de4b None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:22.355157 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa3593-14f0-4e03-94f8-33216c66de4b None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:22.355157 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa3593-14f0-4e03-94f8-33216c66de4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:22.358373 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:22.369652 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-3efa3593-14f0-4e03-94f8-33216c66de4b None None] MFA Rules not processed for user `90ea5d52fd6d4068b7837d363eebb94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:22.370866 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-3efa3593-14f0-4e03-94f8-33216c66de4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:22.428188 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1342/2698] 10.222.0.40 () {58 vars in 967 bytes} [Mon Jul 11 21:13:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:13:22.440948 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc52fb0-4799-4a32-83b8-2f2a88fa3c49 service cinder] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:22.442539 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-8bc52fb0-4799-4a32-83b8-2f2a88fa3c49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:22.511795 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc52fb0-4799-4a32-83b8-2f2a88fa3c49 service cinder] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:22.516738 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f4bb2f-cd3d-4f81-9ea1-96ce2025c9cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc950dfb1d3b4308a33f3d430fe34c1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:22.517386 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4bb2f-cd3d-4f81-9ea1-96ce2025c9cb service swift] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:22.517673 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4bb2f-cd3d-4f81-9ea1-96ce2025c9cb service swift] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:22.518058 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4bb2f-cd3d-4f81-9ea1-96ce2025c9cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:22.526617 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f4bb2f-cd3d-4f81-9ea1-96ce2025c9cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:22.528222 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f4bb2f-cd3d-4f81-9ea1-96ce2025c9cb service swift] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:22.546068 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1357/2699] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jul 11 21:13:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 21:13:22.847226 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa3593-14f0-4e03-94f8-33216c66de4b None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:22.848913 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-3efa3593-14f0-4e03-94f8-33216c66de4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:22.921177 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa3593-14f0-4e03-94f8-33216c66de4b None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:22.926237 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e33e8-b023-492b-9929-6cae33c57415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:22.927250 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e33e8-b023-492b-9929-6cae33c57415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:22.927732 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e33e8-b023-492b-9929-6cae33c57415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:22.928078 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e33e8-b023-492b-9929-6cae33c57415 admin admin] PATH_INFO: `/v3/users/899ae10d2d0d48b997d76846ebcdc6ca` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:22.929338 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e33e8-b023-492b-9929-6cae33c57415 admin admin] RBAC: Authorizing `identity:delete_user(user_id=899ae10d2d0d48b997d76846ebcdc6ca)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:22.931320 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e33e8-b023-492b-9929-6cae33c57415 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:23.141824 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-1c2e33e8-b023-492b-9929-6cae33c57415 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '899ae10d2d0d48b997d76846ebcdc6ca'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:23.149834 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-1c2e33e8-b023-492b-9929-6cae33c57415 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '899ae10d2d0d48b997d76846ebcdc6ca'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:23.150512 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-1c2e33e8-b023-492b-9929-6cae33c57415 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '899ae10d2d0d48b997d76846ebcdc6ca'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:23.151128 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-1c2e33e8-b023-492b-9929-6cae33c57415 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '899ae10d2d0d48b997d76846ebcdc6ca'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:23.280357 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-1c2e33e8-b023-492b-9929-6cae33c57415 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '899ae10d2d0d48b997d76846ebcdc6ca'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:23.314625 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1343/2700] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:13:22 2022] DELETE /identity/v3/users/899ae10d2d0d48b997d76846ebcdc6ca => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:13:23.316398 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81eecf8-1bb3-4bec-8aa5-9afa88def83e None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:23.316621 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81eecf8-1bb3-4bec-8aa5-9afa88def83e None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:23.316920 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81eecf8-1bb3-4bec-8aa5-9afa88def83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:23.339378 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-f81eecf8-1bb3-4bec-8aa5-9afa88def83e None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:23.340633 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-f81eecf8-1bb3-4bec-8aa5-9afa88def83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:23.364643 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:23.413640 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1358/2701] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:13:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:13:23.430432 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e33e8-b023-492b-9929-6cae33c57415 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:23.431907 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-1c2e33e8-b023-492b-9929-6cae33c57415 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:23.470409 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:23.500402 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e33e8-b023-492b-9929-6cae33c57415 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:23.504532 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ece08-b9bf-4e20-ac2d-3b465147a3f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:23.505371 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ece08-b9bf-4e20-ac2d-3b465147a3f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:23.506390 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ece08-b9bf-4e20-ac2d-3b465147a3f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:23.506390 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ece08-b9bf-4e20-ac2d-3b465147a3f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:23.516474 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ece08-b9bf-4e20-ac2d-3b465147a3f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:23.518485 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ece08-b9bf-4e20-ac2d-3b465147a3f8 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:23.530481 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1344/2702] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:13:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:13:23.936663 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81eecf8-1bb3-4bec-8aa5-9afa88def83e None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:23.938227 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-f81eecf8-1bb3-4bec-8aa5-9afa88def83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:23.960167 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81eecf8-1bb3-4bec-8aa5-9afa88def83e None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:23.965359 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137ff53-d71e-4445-bd59-85c580b3bfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:23.966230 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137ff53-d71e-4445-bd59-85c580b3bfbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:23.966942 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137ff53-d71e-4445-bd59-85c580b3bfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:23.966942 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137ff53-d71e-4445-bd59-85c580b3bfbd admin admin] PATH_INFO: `/v3/projects/23d2795587df4c0aa151cc36516cd9c0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:23.968016 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1137ff53-d71e-4445-bd59-85c580b3bfbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=23d2795587df4c0aa151cc36516cd9c0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:23.969900 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1137ff53-d71e-4445-bd59-85c580b3bfbd admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:24.092976 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-1137ff53-d71e-4445-bd59-85c580b3bfbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23d2795587df4c0aa151cc36516cd9c0', 'request_id': 'req-1137ff53-d71e-4445-bd59-85c580b3bfbd'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:24.100805 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-1137ff53-d71e-4445-bd59-85c580b3bfbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23d2795587df4c0aa151cc36516cd9c0', 'request_id': 'req-1137ff53-d71e-4445-bd59-85c580b3bfbd'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:24.106980 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-1137ff53-d71e-4445-bd59-85c580b3bfbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23d2795587df4c0aa151cc36516cd9c0', 'request_id': 'req-1137ff53-d71e-4445-bd59-85c580b3bfbd'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:24.197343 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-1137ff53-d71e-4445-bd59-85c580b3bfbd admin admin] The token cache is being invalidate because project 23d2795587df4c0aa151cc36516cd9c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:13:24.201669 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-1137ff53-d71e-4445-bd59-85c580b3bfbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:24.201669 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-1137ff53-d71e-4445-bd59-85c580b3bfbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:24.201669 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1359/2703] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:13:23 2022] DELETE /identity/v3/projects/23d2795587df4c0aa151cc36516cd9c0 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:13:24.206030 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6985ee9-b635-4226-bbd7-815d25b4e43c None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:24.206566 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6985ee9-b635-4226-bbd7-815d25b4e43c None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:24.207089 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6985ee9-b635-4226-bbd7-815d25b4e43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:24.225461 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-c6985ee9-b635-4226-bbd7-815d25b4e43c None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:24.226693 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c6985ee9-b635-4226-bbd7-815d25b4e43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:24.291533 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1345/2704] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:13:24.299743 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93678a99-5b52-49c5-9f64-46d5f6c26b58 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:24.300063 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93678a99-5b52-49c5-9f64-46d5f6c26b58 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:24.300349 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93678a99-5b52-49c5-9f64-46d5f6c26b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:24.319234 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-93678a99-5b52-49c5-9f64-46d5f6c26b58 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:24.320488 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-93678a99-5b52-49c5-9f64-46d5f6c26b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:24.328572 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1360/2705] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:13:24.333878 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6985ee9-b635-4226-bbd7-815d25b4e43c None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:24.343628 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6985ee9-b635-4226-bbd7-815d25b4e43c None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:24.349149 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194510e0-c7c7-43f8-9023-2c2f57fe9a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:24.349877 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194510e0-c7c7-43f8-9023-2c2f57fe9a51 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:24.350165 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194510e0-c7c7-43f8-9023-2c2f57fe9a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:24.350444 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194510e0-c7c7-43f8-9023-2c2f57fe9a51 admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:24.351167 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194510e0-c7c7-43f8-9023-2c2f57fe9a51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:13:24.351478 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194510e0-c7c7-43f8-9023-2c2f57fe9a51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:24.353081 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194510e0-c7c7-43f8-9023-2c2f57fe9a51 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:24.365059 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1346/2706] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:13:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:13:24.369437 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93678a99-5b52-49c5-9f64-46d5f6c26b58 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:24.379036 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93678a99-5b52-49c5-9f64-46d5f6c26b58 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:24.383657 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc61019-be13-46cf-8355-7c32dbd953bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:24.384353 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc61019-be13-46cf-8355-7c32dbd953bf admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:24.384643 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc61019-be13-46cf-8355-7c32dbd953bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:24.391059 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc61019-be13-46cf-8355-7c32dbd953bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:24.391059 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc61019-be13-46cf-8355-7c32dbd953bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:24.391059 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc61019-be13-46cf-8355-7c32dbd953bf admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:24.479006 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1361/2707] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:13:24 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:13:24.483488 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194510e0-c7c7-43f8-9023-2c2f57fe9a51 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:24.493788 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194510e0-c7c7-43f8-9023-2c2f57fe9a51 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:24.552703 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8442c36-6068-40b6-ba6c-54ef83aff28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:24.553387 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8442c36-6068-40b6-ba6c-54ef83aff28b admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:24.553675 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8442c36-6068-40b6-ba6c-54ef83aff28b admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:24.554017 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8442c36-6068-40b6-ba6c-54ef83aff28b admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:24.554725 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8442c36-6068-40b6-ba6c-54ef83aff28b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:24.556671 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8442c36-6068-40b6-ba6c-54ef83aff28b admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:24.620078 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1347/2708] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:13:24 2022] POST /identity/v3/users => generated 292 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:13:24.624236 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc61019-be13-46cf-8355-7c32dbd953bf admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:24.636488 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc61019-be13-46cf-8355-7c32dbd953bf admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:24.641266 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f078425-23bf-4242-a603-f4a8cc7ce3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:24.642016 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f078425-23bf-4242-a603-f4a8cc7ce3dc admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:24.642373 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f078425-23bf-4242-a603-f4a8cc7ce3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:24.642727 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f078425-23bf-4242-a603-f4a8cc7ce3dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:24.644336 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f078425-23bf-4242-a603-f4a8cc7ce3dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:24.645987 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f078425-23bf-4242-a603-f4a8cc7ce3dc admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:24.660629 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1362/2709] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:13:24.663771 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8442c36-6068-40b6-ba6c-54ef83aff28b admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:24.674391 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8442c36-6068-40b6-ba6c-54ef83aff28b admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:24.679217 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c03730e-86a0-4ea9-aca6-d0e8a8c46577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:24.679901 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03730e-86a0-4ea9-aca6-d0e8a8c46577 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:24.680221 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03730e-86a0-4ea9-aca6-d0e8a8c46577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:24.680501 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03730e-86a0-4ea9-aca6-d0e8a8c46577 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:24.681285 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c03730e-86a0-4ea9-aca6-d0e8a8c46577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:24.682904 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c03730e-86a0-4ea9-aca6-d0e8a8c46577 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:24.706561 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1348/2710] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:13:24.707633 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f078425-23bf-4242-a603-f4a8cc7ce3dc admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:24.717873 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f078425-23bf-4242-a603-f4a8cc7ce3dc admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:24.722605 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ad32d-a697-46ba-ac0c-46232192bed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:24.723476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ad32d-a697-46ba-ac0c-46232192bed5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:24.726178 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ad32d-a697-46ba-ac0c-46232192bed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:24.726178 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ad32d-a697-46ba-ac0c-46232192bed5 admin admin] PATH_INFO: `/v3/projects/f1755c8ff1854dedb242ece9c45b1660/users/7ef6ee4ca83645f1bfe963bc5d90030b/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:24.739088 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ad32d-a697-46ba-ac0c-46232192bed5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1755c8ff1854dedb242ece9c45b1660, user_id=7ef6ee4ca83645f1bfe963bc5d90030b, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:24.741691 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ad32d-a697-46ba-ac0c-46232192bed5 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:24.815232 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1363/2711] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:13:24 2022] PUT /identity/v3/projects/f1755c8ff1854dedb242ece9c45b1660/users/7ef6ee4ca83645f1bfe963bc5d90030b/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:13:24.826915 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ebeae-7c00-4d1d-8241-648ea8a892c1 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:24.827214 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ebeae-7c00-4d1d-8241-648ea8a892c1 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:24.827500 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ebeae-7c00-4d1d-8241-648ea8a892c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:24.856454 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-ab6ebeae-7c00-4d1d-8241-648ea8a892c1 None None] MFA Rules not processed for user `7ef6ee4ca83645f1bfe963bc5d90030b`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:24.857648 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-ab6ebeae-7c00-4d1d-8241-648ea8a892c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:24.884396 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:24.924075 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1349/2712] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:13:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:13:24.936139 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ad32d-a697-46ba-ac0c-46232192bed5 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:24.937838 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-b15ad32d-a697-46ba-ac0c-46232192bed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:24.989579 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:24.999409 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ad32d-a697-46ba-ac0c-46232192bed5 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:25.003773 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d2f96-e45c-484a-82c1-348dadfab248 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:25.004463 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d2f96-e45c-484a-82c1-348dadfab248 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:25.004755 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d2f96-e45c-484a-82c1-348dadfab248 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:25.005040 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d2f96-e45c-484a-82c1-348dadfab248 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:25.013866 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d2f96-e45c-484a-82c1-348dadfab248 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:25.015268 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d2f96-e45c-484a-82c1-348dadfab248 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:25.024521 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1364/2713] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:13:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:13:26.716023 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ebeae-7c00-4d1d-8241-648ea8a892c1 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:26.727576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ebeae-7c00-4d1d-8241-648ea8a892c1 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:26.731653 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f38cb-eec7-41f2-a9f7-4a6e9acb138f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:26.732326 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f38cb-eec7-41f2-a9f7-4a6e9acb138f service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:26.732617 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f38cb-eec7-41f2-a9f7-4a6e9acb138f service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:26.732900 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f38cb-eec7-41f2-a9f7-4a6e9acb138f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:26.734720 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-2a4f38cb-eec7-41f2-a9f7-4a6e9acb138f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:26.803110 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f38cb-eec7-41f2-a9f7-4a6e9acb138f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:26.804684 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f38cb-eec7-41f2-a9f7-4a6e9acb138f service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:26.814223 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1350/2714] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:13:26 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:13:28.111450 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d2f96-e45c-484a-82c1-348dadfab248 service cinder] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:28.182794 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d2f96-e45c-484a-82c1-348dadfab248 service cinder] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:28.187326 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11453970-a091-4e91-860e-e39ae267cf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:28.188225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11453970-a091-4e91-860e-e39ae267cf56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:28.188511 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11453970-a091-4e91-860e-e39ae267cf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:28.188789 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11453970-a091-4e91-860e-e39ae267cf56 admin admin] PATH_INFO: `/v3/users/7ef6ee4ca83645f1bfe963bc5d90030b` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:28.190623 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11453970-a091-4e91-860e-e39ae267cf56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ef6ee4ca83645f1bfe963bc5d90030b)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:28.192588 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11453970-a091-4e91-860e-e39ae267cf56 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:28.421907 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-11453970-a091-4e91-860e-e39ae267cf56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ef6ee4ca83645f1bfe963bc5d90030b'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:28.429510 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-11453970-a091-4e91-860e-e39ae267cf56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ef6ee4ca83645f1bfe963bc5d90030b'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:28.430225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-11453970-a091-4e91-860e-e39ae267cf56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ef6ee4ca83645f1bfe963bc5d90030b'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:28.430846 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-11453970-a091-4e91-860e-e39ae267cf56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ef6ee4ca83645f1bfe963bc5d90030b'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:28.535015 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-11453970-a091-4e91-860e-e39ae267cf56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ef6ee4ca83645f1bfe963bc5d90030b'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:28.554481 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1365/2715] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:13:28 2022] DELETE /identity/v3/users/7ef6ee4ca83645f1bfe963bc5d90030b => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:13:28.559055 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0a1ab-4e25-4dc0-8d65-6407d3586cc3 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:28.559567 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0a1ab-4e25-4dc0-8d65-6407d3586cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:28.559665 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0a1ab-4e25-4dc0-8d65-6407d3586cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:28.582733 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-16f0a1ab-4e25-4dc0-8d65-6407d3586cc3 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:28.584162 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-16f0a1ab-4e25-4dc0-8d65-6407d3586cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:28.648100 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1351/2716] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:13:28.671029 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11453970-a091-4e91-860e-e39ae267cf56 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:28.672555 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-11453970-a091-4e91-860e-e39ae267cf56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:28.735271 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11453970-a091-4e91-860e-e39ae267cf56 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:28.739223 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74858925-a63b-4904-bfe0-6f380dce4aab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:28.739876 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74858925-a63b-4904-bfe0-6f380dce4aab service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:28.740196 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74858925-a63b-4904-bfe0-6f380dce4aab service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:28.740479 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74858925-a63b-4904-bfe0-6f380dce4aab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:28.749845 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74858925-a63b-4904-bfe0-6f380dce4aab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:28.751288 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74858925-a63b-4904-bfe0-6f380dce4aab service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:28.761962 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1366/2717] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:13:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:13:29.425854 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0a1ab-4e25-4dc0-8d65-6407d3586cc3 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:29.427445 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-16f0a1ab-4e25-4dc0-8d65-6407d3586cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:29.439712 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0a1ab-4e25-4dc0-8d65-6407d3586cc3 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:29.445290 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad874d-9622-4154-bc0e-a581e1dfde5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:29.447615 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad874d-9622-4154-bc0e-a581e1dfde5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:29.447615 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad874d-9622-4154-bc0e-a581e1dfde5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:29.447615 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad874d-9622-4154-bc0e-a581e1dfde5b admin admin] PATH_INFO: `/v3/projects/f1755c8ff1854dedb242ece9c45b1660` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:29.447952 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad874d-9622-4154-bc0e-a581e1dfde5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1755c8ff1854dedb242ece9c45b1660)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:29.449865 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad874d-9622-4154-bc0e-a581e1dfde5b admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:29.558041 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-9bad874d-9622-4154-bc0e-a581e1dfde5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1755c8ff1854dedb242ece9c45b1660', 'request_id': 'req-9bad874d-9622-4154-bc0e-a581e1dfde5b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:29.564212 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-9bad874d-9622-4154-bc0e-a581e1dfde5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1755c8ff1854dedb242ece9c45b1660', 'request_id': 'req-9bad874d-9622-4154-bc0e-a581e1dfde5b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:29.566295 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:29.570290 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-9bad874d-9622-4154-bc0e-a581e1dfde5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1755c8ff1854dedb242ece9c45b1660', 'request_id': 'req-9bad874d-9622-4154-bc0e-a581e1dfde5b'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:29.668951 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-9bad874d-9622-4154-bc0e-a581e1dfde5b admin admin] The token cache is being invalidate because project f1755c8ff1854dedb242ece9c45b1660 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:13:29.669236 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-9bad874d-9622-4154-bc0e-a581e1dfde5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:29.669897 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-9bad874d-9622-4154-bc0e-a581e1dfde5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:29.671521 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1352/2718] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:13:29 2022] DELETE /identity/v3/projects/f1755c8ff1854dedb242ece9c45b1660 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:13:29.676627 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5eb549-fe30-498e-8bda-a1dfefd21d95 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:29.677106 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5eb549-fe30-498e-8bda-a1dfefd21d95 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:29.677106 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5eb549-fe30-498e-8bda-a1dfefd21d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:29.697330 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-af5eb549-fe30-498e-8bda-a1dfefd21d95 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:29.699819 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-af5eb549-fe30-498e-8bda-a1dfefd21d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:29.703176 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:29.758292 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1367/2719] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:13:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:13:29.766299 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fd27f-1a88-40df-9129-8fdb52f30640 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:29.766587 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fd27f-1a88-40df-9129-8fdb52f30640 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:29.766893 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fd27f-1a88-40df-9129-8fdb52f30640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:29.787420 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-7b4fd27f-1a88-40df-9129-8fdb52f30640 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:29.788660 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-7b4fd27f-1a88-40df-9129-8fdb52f30640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:29.796660 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1353/2720] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:13:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:13:29.801580 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5eb549-fe30-498e-8bda-a1dfefd21d95 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:29.809774 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b13cbb-713f-4dfe-9256-17f66307263c None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:29.810062 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b13cbb-713f-4dfe-9256-17f66307263c None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:29.810341 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b13cbb-713f-4dfe-9256-17f66307263c None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:29.811410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5eb549-fe30-498e-8bda-a1dfefd21d95 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:29.811707 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1354/2721] 10.222.0.40 () {54 vars in 921 bytes} [Mon Jul 11 21:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 21:13:29.816696 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf888f-94d4-4466-93d3-ebfab4c27a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:29.817373 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf888f-94d4-4466-93d3-ebfab4c27a84 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:29.817663 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf888f-94d4-4466-93d3-ebfab4c27a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:29.817936 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f5950-5d98-40d9-a31b-9ef8c9aa885e None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:29.818058 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf888f-94d4-4466-93d3-ebfab4c27a84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:29.818388 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f5950-5d98-40d9-a31b-9ef8c9aa885e None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:29.818671 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf888f-94d4-4466-93d3-ebfab4c27a84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:13:29.818775 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f5950-5d98-40d9-a31b-9ef8c9aa885e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:29.818988 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf888f-94d4-4466-93d3-ebfab4c27a84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:29.820671 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf888f-94d4-4466-93d3-ebfab4c27a84 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:29.837472 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1368/2722] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:13:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:13:29.838857 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf888f-94d4-4466-93d3-ebfab4c27a84 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:29.845272 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-1e2f5950-5d98-40d9-a31b-9ef8c9aa885e None None] MFA Rules not processed for user `29046b079f1a4f4ea2244e69cbbaa805`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:29.847141 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-1e2f5950-5d98-40d9-a31b-9ef8c9aa885e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:29.850504 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf888f-94d4-4466-93d3-ebfab4c27a84 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:29.856546 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf06fa-b642-4101-8924-f40f1471a7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:29.857462 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf06fa-b642-4101-8924-f40f1471a7dc admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:29.857913 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf06fa-b642-4101-8924-f40f1471a7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:29.858219 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf06fa-b642-4101-8924-f40f1471a7dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:29.859328 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddf06fa-b642-4101-8924-f40f1471a7dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:29.864162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddf06fa-b642-4101-8924-f40f1471a7dc admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:29.903153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1355/2723] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Jul 11 21:13:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:13:29.915669 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f5950-5d98-40d9-a31b-9ef8c9aa885e None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:29.917213 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-1e2f5950-5d98-40d9-a31b-9ef8c9aa885e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:29.927783 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f5950-5d98-40d9-a31b-9ef8c9aa885e None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:29.931435 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98942e5-41fa-4ee8-bbf3-e8e22b7b65c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:29.932110 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98942e5-41fa-4ee8-bbf3-e8e22b7b65c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:29.932400 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98942e5-41fa-4ee8-bbf3-e8e22b7b65c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:29.932682 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98942e5-41fa-4ee8-bbf3-e8e22b7b65c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:29.940683 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98942e5-41fa-4ee8-bbf3-e8e22b7b65c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:29.942105 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98942e5-41fa-4ee8-bbf3-e8e22b7b65c9 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:29.942371 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1369/2724] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:13:29 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:13:29.946399 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf06fa-b642-4101-8924-f40f1471a7dc admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:29.952581 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1356/2725] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:13:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 21:13:30.010337 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf06fa-b642-4101-8924-f40f1471a7dc admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:30.015168 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b009f7-dfd6-4fc9-ab3a-24dbf63140b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:30.015846 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b009f7-dfd6-4fc9-ab3a-24dbf63140b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:30.016174 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b009f7-dfd6-4fc9-ab3a-24dbf63140b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:30.016456 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b009f7-dfd6-4fc9-ab3a-24dbf63140b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:30.017149 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b009f7-dfd6-4fc9-ab3a-24dbf63140b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:30.020500 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b009f7-dfd6-4fc9-ab3a-24dbf63140b7 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:30.036601 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40ec97-1a28-4b14-815d-9d003617c723 None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:30.036963 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40ec97-1a28-4b14-815d-9d003617c723 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:30.037521 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40ec97-1a28-4b14-815d-9d003617c723 None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:30.038657 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1357/2726] 10.222.0.40 () {54 vars in 921 bytes} [Mon Jul 11 21:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 21:13:30.043416 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401df7f-a32a-4741-89e2-03e9efa75029 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:30.043708 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401df7f-a32a-4741-89e2-03e9efa75029 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:30.044020 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401df7f-a32a-4741-89e2-03e9efa75029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:30.062592 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-c401df7f-a32a-4741-89e2-03e9efa75029 None None] MFA Rules not processed for user `8ac15411c75f4bd4a86f6753c9240a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:30.063826 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c401df7f-a32a-4741-89e2-03e9efa75029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:30.117938 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1370/2727] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:13:29 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 21:13:30.122062 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b009f7-dfd6-4fc9-ab3a-24dbf63140b7 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:30.131006 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1358/2728] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Jul 11 21:13:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:13:30.132513 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b009f7-dfd6-4fc9-ab3a-24dbf63140b7 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:30.137405 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ef5e1-366e-456d-ba57-97b8f9b6aa98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:30.138073 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ef5e1-366e-456d-ba57-97b8f9b6aa98 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:30.138363 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ef5e1-366e-456d-ba57-97b8f9b6aa98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:30.138646 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ef5e1-366e-456d-ba57-97b8f9b6aa98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:30.139372 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ef5e1-366e-456d-ba57-97b8f9b6aa98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:30.141221 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401df7f-a32a-4741-89e2-03e9efa75029 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:30.141340 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ef5e1-366e-456d-ba57-97b8f9b6aa98 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:30.142557 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-c401df7f-a32a-4741-89e2-03e9efa75029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:30.152493 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1371/2729] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 21:13:30.156268 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ef5e1-366e-456d-ba57-97b8f9b6aa98 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:30.167627 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ef5e1-366e-456d-ba57-97b8f9b6aa98 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:30.172381 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec57ca-542a-4124-8e08-9f96ef110c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:30.173094 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec57ca-542a-4124-8e08-9f96ef110c7e admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:30.173332 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec57ca-542a-4124-8e08-9f96ef110c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:30.173612 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec57ca-542a-4124-8e08-9f96ef110c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:30.174917 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec57ca-542a-4124-8e08-9f96ef110c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:30.176544 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec57ca-542a-4124-8e08-9f96ef110c7e admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:30.195886 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1372/2730] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 21:13:30.197097 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec57ca-542a-4124-8e08-9f96ef110c7e admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:30.205930 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401df7f-a32a-4741-89e2-03e9efa75029 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:30.208492 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec57ca-542a-4124-8e08-9f96ef110c7e admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:30.210495 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6154cf7c-9200-4e7c-977c-506d462fb8f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:30.211201 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154cf7c-9200-4e7c-977c-506d462fb8f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:30.211425 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154cf7c-9200-4e7c-977c-506d462fb8f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:30.211704 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154cf7c-9200-4e7c-977c-506d462fb8f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:30.213229 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e11229-3848-455b-aa4f-16c595c32bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:30.214116 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e11229-3848-455b-aa4f-16c595c32bcb admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:30.214408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e11229-3848-455b-aa4f-16c595c32bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:30.214692 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e11229-3848-455b-aa4f-16c595c32bcb admin admin] PATH_INFO: `/v3/projects/fa128785201d4957af3b43e67b89e9c1/users/e117f4a3320044139c202da2cf47a6e4/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:30.222302 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6154cf7c-9200-4e7c-977c-506d462fb8f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:30.223725 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6154cf7c-9200-4e7c-977c-506d462fb8f3 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:30.231737 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e11229-3848-455b-aa4f-16c595c32bcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa128785201d4957af3b43e67b89e9c1, user_id=e117f4a3320044139c202da2cf47a6e4, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:30.234459 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e11229-3848-455b-aa4f-16c595c32bcb admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:30.235065 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1359/2731] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:13:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 21:13:30.341015 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1373/2732] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:13:30 2022] PUT /identity/v3/projects/fa128785201d4957af3b43e67b89e9c1/users/e117f4a3320044139c202da2cf47a6e4/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:13:30.351684 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f7a95-e6c7-41da-8e03-d3446d7f35ff None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:30.352034 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f7a95-e6c7-41da-8e03-d3446d7f35ff None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:30.352321 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f7a95-e6c7-41da-8e03-d3446d7f35ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:30.371935 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:30.382898 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-298f7a95-e6c7-41da-8e03-d3446d7f35ff None None] MFA Rules not processed for user `e117f4a3320044139c202da2cf47a6e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:30.384184 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-298f7a95-e6c7-41da-8e03-d3446d7f35ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:30.469696 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1360/2733] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:13:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:13:30.480410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e11229-3848-455b-aa4f-16c595c32bcb admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:30.482173 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-40e11229-3848-455b-aa4f-16c595c32bcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:30.508416 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:30.549493 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e11229-3848-455b-aa4f-16c595c32bcb admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:30.553500 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab1906-b671-48b4-8551-7042de80a37e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:30.554162 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab1906-b671-48b4-8551-7042de80a37e service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:30.554477 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab1906-b671-48b4-8551-7042de80a37e service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:30.554756 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab1906-b671-48b4-8551-7042de80a37e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:30.563559 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab1906-b671-48b4-8551-7042de80a37e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:30.565694 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab1906-b671-48b4-8551-7042de80a37e service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:30.574355 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1374/2734] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:13:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:13:32.741318 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f7a95-e6c7-41da-8e03-d3446d7f35ff None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:32.742828 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-298f7a95-e6c7-41da-8e03-d3446d7f35ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:32.827994 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f7a95-e6c7-41da-8e03-d3446d7f35ff None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:32.833272 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f837a0-6790-4757-99e7-144b23dafda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:32.834809 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f837a0-6790-4757-99e7-144b23dafda3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:32.834809 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f837a0-6790-4757-99e7-144b23dafda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:32.835060 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f837a0-6790-4757-99e7-144b23dafda3 admin admin] PATH_INFO: `/v3/users/f33f2946a39b491797996098c049e24a` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:32.836901 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f837a0-6790-4757-99e7-144b23dafda3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f33f2946a39b491797996098c049e24a)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:32.838825 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f837a0-6790-4757-99e7-144b23dafda3 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:33.052741 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-58f837a0-6790-4757-99e7-144b23dafda3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f33f2946a39b491797996098c049e24a'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:33.060190 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-58f837a0-6790-4757-99e7-144b23dafda3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f33f2946a39b491797996098c049e24a'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:33.060874 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-58f837a0-6790-4757-99e7-144b23dafda3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f33f2946a39b491797996098c049e24a'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:33.062183 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-58f837a0-6790-4757-99e7-144b23dafda3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f33f2946a39b491797996098c049e24a'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:33.154632 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-58f837a0-6790-4757-99e7-144b23dafda3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f33f2946a39b491797996098c049e24a'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:33.173537 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1361/2735] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:13:32 2022] DELETE /identity/v3/users/f33f2946a39b491797996098c049e24a => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:13:33.178774 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562a06b-a11e-4f67-b9de-4c936059904a None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:33.179263 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562a06b-a11e-4f67-b9de-4c936059904a None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:33.179364 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562a06b-a11e-4f67-b9de-4c936059904a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:33.196588 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-4562a06b-a11e-4f67-b9de-4c936059904a None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:33.197795 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-4562a06b-a11e-4f67-b9de-4c936059904a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:33.259278 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1375/2736] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:13:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:13:33.269701 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f837a0-6790-4757-99e7-144b23dafda3 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:33.271214 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-58f837a0-6790-4757-99e7-144b23dafda3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:33.292176 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:33.336512 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f837a0-6790-4757-99e7-144b23dafda3 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:33.340501 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96583dbc-38ca-41fe-a3e7-b590cae670ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:33.341222 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96583dbc-38ca-41fe-a3e7-b590cae670ad service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:33.341631 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96583dbc-38ca-41fe-a3e7-b590cae670ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:33.341914 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96583dbc-38ca-41fe-a3e7-b590cae670ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:33.352340 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96583dbc-38ca-41fe-a3e7-b590cae670ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:33.353829 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96583dbc-38ca-41fe-a3e7-b590cae670ad service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:33.363566 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1362/2737] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:13:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 21:13:33.787274 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4562a06b-a11e-4f67-b9de-4c936059904a None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:33.788731 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-4562a06b-a11e-4f67-b9de-4c936059904a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:33.803544 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4562a06b-a11e-4f67-b9de-4c936059904a None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:33.808883 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74411ebb-0a6a-477f-8aad-483d9a94ceb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:33.813815 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74411ebb-0a6a-477f-8aad-483d9a94ceb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:33.813815 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74411ebb-0a6a-477f-8aad-483d9a94ceb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:33.813815 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74411ebb-0a6a-477f-8aad-483d9a94ceb7 admin admin] PATH_INFO: `/v3/projects/72b6e287e9f94ba58ddcf431cc9c7950` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:33.813815 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74411ebb-0a6a-477f-8aad-483d9a94ceb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72b6e287e9f94ba58ddcf431cc9c7950)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:33.813815 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74411ebb-0a6a-477f-8aad-483d9a94ceb7 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:33.938314 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-74411ebb-0a6a-477f-8aad-483d9a94ceb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72b6e287e9f94ba58ddcf431cc9c7950', 'request_id': 'req-74411ebb-0a6a-477f-8aad-483d9a94ceb7'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:33.946065 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-74411ebb-0a6a-477f-8aad-483d9a94ceb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72b6e287e9f94ba58ddcf431cc9c7950', 'request_id': 'req-74411ebb-0a6a-477f-8aad-483d9a94ceb7'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:33.952728 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-74411ebb-0a6a-477f-8aad-483d9a94ceb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72b6e287e9f94ba58ddcf431cc9c7950', 'request_id': 'req-74411ebb-0a6a-477f-8aad-483d9a94ceb7'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:34.038433 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-74411ebb-0a6a-477f-8aad-483d9a94ceb7 admin admin] The token cache is being invalidate because project 72b6e287e9f94ba58ddcf431cc9c7950 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:13:34.038433 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-74411ebb-0a6a-477f-8aad-483d9a94ceb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:34.038433 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-74411ebb-0a6a-477f-8aad-483d9a94ceb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:34.038433 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1376/2738] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:13:33 2022] DELETE /identity/v3/projects/72b6e287e9f94ba58ddcf431cc9c7950 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:13:34.038735 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96583dbc-38ca-41fe-a3e7-b590cae670ad service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:34.045382 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96583dbc-38ca-41fe-a3e7-b590cae670ad service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:34.109847 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1520ff1-5c97-45b0-a670-d32781bdbefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:34.110843 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1520ff1-5c97-45b0-a670-d32781bdbefc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:34.111270 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1520ff1-5c97-45b0-a670-d32781bdbefc admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:34.112161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1520ff1-5c97-45b0-a670-d32781bdbefc admin admin] PATH_INFO: `/v3/users/451e98c582734a7493d3934b1246efbd` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:34.113484 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1520ff1-5c97-45b0-a670-d32781bdbefc admin admin] RBAC: Authorizing `identity:delete_user(user_id=451e98c582734a7493d3934b1246efbd)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:34.115431 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1520ff1-5c97-45b0-a670-d32781bdbefc admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:34.331290 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c1520ff1-5c97-45b0-a670-d32781bdbefc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '451e98c582734a7493d3934b1246efbd'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:34.338121 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c1520ff1-5c97-45b0-a670-d32781bdbefc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '451e98c582734a7493d3934b1246efbd'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:34.338776 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c1520ff1-5c97-45b0-a670-d32781bdbefc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '451e98c582734a7493d3934b1246efbd'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:34.339379 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c1520ff1-5c97-45b0-a670-d32781bdbefc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '451e98c582734a7493d3934b1246efbd'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:34.409050 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-c1520ff1-5c97-45b0-a670-d32781bdbefc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '451e98c582734a7493d3934b1246efbd'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:34.427580 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1363/2739] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:13:34 2022] DELETE /identity/v3/users/451e98c582734a7493d3934b1246efbd => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:13:34.948427 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74411ebb-0a6a-477f-8aad-483d9a94ceb7 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:34.949879 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-74411ebb-0a6a-477f-8aad-483d9a94ceb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:34.964048 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74411ebb-0a6a-477f-8aad-483d9a94ceb7 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:35.006845 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:35.022296 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5e093-cb7b-429d-ba1f-8a5598642d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:35.023174 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5e093-cb7b-429d-ba1f-8a5598642d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:35.023466 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5e093-cb7b-429d-ba1f-8a5598642d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:35.023746 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5e093-cb7b-429d-ba1f-8a5598642d7c admin admin] PATH_INFO: `/v3/projects/6234d6edb0f343b1baa8f93b9405101d` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:35.025038 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5e093-cb7b-429d-ba1f-8a5598642d7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6234d6edb0f343b1baa8f93b9405101d)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:35.026951 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5e093-cb7b-429d-ba1f-8a5598642d7c admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:35.119880 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-01d5e093-cb7b-429d-ba1f-8a5598642d7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6234d6edb0f343b1baa8f93b9405101d', 'request_id': 'req-01d5e093-cb7b-429d-ba1f-8a5598642d7c'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:35.126210 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-01d5e093-cb7b-429d-ba1f-8a5598642d7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6234d6edb0f343b1baa8f93b9405101d', 'request_id': 'req-01d5e093-cb7b-429d-ba1f-8a5598642d7c'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:35.133115 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-01d5e093-cb7b-429d-ba1f-8a5598642d7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6234d6edb0f343b1baa8f93b9405101d', 'request_id': 'req-01d5e093-cb7b-429d-ba1f-8a5598642d7c'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:35.208736 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-01d5e093-cb7b-429d-ba1f-8a5598642d7c admin admin] The token cache is being invalidate because project 6234d6edb0f343b1baa8f93b9405101d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:13:35.209032 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-01d5e093-cb7b-429d-ba1f-8a5598642d7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:35.209655 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-01d5e093-cb7b-429d-ba1f-8a5598642d7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:35.211208 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1377/2740] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:13:34 2022] DELETE /identity/v3/projects/6234d6edb0f343b1baa8f93b9405101d => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:13:35.217360 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd949b75-fa55-420f-8e12-bf88dff3588a None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:35.217818 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd949b75-fa55-420f-8e12-bf88dff3588a None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:35.217941 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd949b75-fa55-420f-8e12-bf88dff3588a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:35.235703 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-bd949b75-fa55-420f-8e12-bf88dff3588a None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:35.236998 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-bd949b75-fa55-420f-8e12-bf88dff3588a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:35.272964 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:35.298786 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1364/2741] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:13:35.307289 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8a1b4-bbf9-48b0-a8fb-6a6a63860211 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:35.307585 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8a1b4-bbf9-48b0-a8fb-6a6a63860211 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:35.307868 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8a1b4-bbf9-48b0-a8fb-6a6a63860211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:35.328184 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-5ce8a1b4-bbf9-48b0-a8fb-6a6a63860211 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:35.329417 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-5ce8a1b4-bbf9-48b0-a8fb-6a6a63860211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:35.338165 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1378/2742] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:13:35.342355 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd949b75-fa55-420f-8e12-bf88dff3588a None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:35.352317 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd949b75-fa55-420f-8e12-bf88dff3588a None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:35.357269 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8cf452-d889-4f50-9c1b-932f73b00f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:35.357939 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8cf452-d889-4f50-9c1b-932f73b00f9e admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:35.358492 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8cf452-d889-4f50-9c1b-932f73b00f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:35.358778 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8cf452-d889-4f50-9c1b-932f73b00f9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:35.359522 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8cf452-d889-4f50-9c1b-932f73b00f9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:13:35.360269 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8cf452-d889-4f50-9c1b-932f73b00f9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:35.361971 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8cf452-d889-4f50-9c1b-932f73b00f9e admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:35.373588 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1365/2743] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:13:35.378656 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8a1b4-bbf9-48b0-a8fb-6a6a63860211 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:35.387804 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8a1b4-bbf9-48b0-a8fb-6a6a63860211 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:35.392509 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce61dd-2642-4b1a-948a-020a92e66587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:35.393786 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce61dd-2642-4b1a-948a-020a92e66587 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:35.396164 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce61dd-2642-4b1a-948a-020a92e66587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:35.396164 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce61dd-2642-4b1a-948a-020a92e66587 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:35.396164 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce61dd-2642-4b1a-948a-020a92e66587 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:35.397362 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce61dd-2642-4b1a-948a-020a92e66587 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:35.479815 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1379/2744] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:13:35 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:13:35.484928 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8cf452-d889-4f50-9c1b-932f73b00f9e admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:35.496245 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8cf452-d889-4f50-9c1b-932f73b00f9e admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:35.552919 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444b71a4-08ea-40fb-b408-cfcca12a6d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:35.553604 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b71a4-08ea-40fb-b408-cfcca12a6d7f admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:35.553895 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b71a4-08ea-40fb-b408-cfcca12a6d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:35.554180 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b71a4-08ea-40fb-b408-cfcca12a6d7f admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:35.554871 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444b71a4-08ea-40fb-b408-cfcca12a6d7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:35.556855 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444b71a4-08ea-40fb-b408-cfcca12a6d7f admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:35.631587 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1366/2745] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:13:35 2022] POST /identity/v3/users => generated 288 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 21:13:35.634011 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce61dd-2642-4b1a-948a-020a92e66587 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:35.644707 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce61dd-2642-4b1a-948a-020a92e66587 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:35.649854 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad4354-0c4a-4bca-bcc8-374b0a8ca99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:35.650524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad4354-0c4a-4bca-bcc8-374b0a8ca99e admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:35.650809 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad4354-0c4a-4bca-bcc8-374b0a8ca99e admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:35.651095 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad4354-0c4a-4bca-bcc8-374b0a8ca99e admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:35.656694 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad4354-0c4a-4bca-bcc8-374b0a8ca99e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:35.656694 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad4354-0c4a-4bca-bcc8-374b0a8ca99e admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:35.672819 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1380/2746] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:13:35.674517 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444b71a4-08ea-40fb-b408-cfcca12a6d7f admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:35.684719 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444b71a4-08ea-40fb-b408-cfcca12a6d7f admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:35.691683 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3698b-2ce5-4d3b-a269-b1ce9b78592a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:35.692143 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3698b-2ce5-4d3b-a269-b1ce9b78592a admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:35.692440 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3698b-2ce5-4d3b-a269-b1ce9b78592a admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:35.692729 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3698b-2ce5-4d3b-a269-b1ce9b78592a admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:35.693517 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3698b-2ce5-4d3b-a269-b1ce9b78592a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:35.695244 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3698b-2ce5-4d3b-a269-b1ce9b78592a admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:35.709894 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1367/2747] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:13:35.711045 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad4354-0c4a-4bca-bcc8-374b0a8ca99e admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:35.722348 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad4354-0c4a-4bca-bcc8-374b0a8ca99e admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:35.727650 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f99d4b-5283-4ce4-a1d6-491bacbb8131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:35.728826 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f99d4b-5283-4ce4-a1d6-491bacbb8131 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:35.729115 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f99d4b-5283-4ce4-a1d6-491bacbb8131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:35.729391 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f99d4b-5283-4ce4-a1d6-491bacbb8131 admin admin] PATH_INFO: `/v3/projects/45fca8497d274de89714d9a3d5b1b398/users/1b01f1f4f27945f8b7ecb036c3e08c46/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:35.754328 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f99d4b-5283-4ce4-a1d6-491bacbb8131 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45fca8497d274de89714d9a3d5b1b398, user_id=1b01f1f4f27945f8b7ecb036c3e08c46, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:35.757217 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f99d4b-5283-4ce4-a1d6-491bacbb8131 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:35.826589 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1381/2748] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:13:35 2022] PUT /identity/v3/projects/45fca8497d274de89714d9a3d5b1b398/users/1b01f1f4f27945f8b7ecb036c3e08c46/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:13:35.839914 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd15124-5767-4b0c-aac2-b51ea9377d3c None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:35.840253 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd15124-5767-4b0c-aac2-b51ea9377d3c None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:35.840543 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd15124-5767-4b0c-aac2-b51ea9377d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:35.870014 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-3dd15124-5767-4b0c-aac2-b51ea9377d3c None None] MFA Rules not processed for user `1b01f1f4f27945f8b7ecb036c3e08c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:35.871233 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-3dd15124-5767-4b0c-aac2-b51ea9377d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:35.942142 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1368/2749] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:13:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:13:35.953400 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f99d4b-5283-4ce4-a1d6-491bacbb8131 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:35.955102 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-70f99d4b-5283-4ce4-a1d6-491bacbb8131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:36.015933 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f99d4b-5283-4ce4-a1d6-491bacbb8131 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:36.023066 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689d165-d9d2-4021-a40a-fc64a5ab9631 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da488c75631e4e5992304ff6c0579aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:36.023725 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689d165-d9d2-4021-a40a-fc64a5ab9631 service glance] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:36.024045 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689d165-d9d2-4021-a40a-fc64a5ab9631 service glance] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:36.024938 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689d165-d9d2-4021-a40a-fc64a5ab9631 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:36.034360 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689d165-d9d2-4021-a40a-fc64a5ab9631 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:36.035788 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689d165-d9d2-4021-a40a-fc64a5ab9631 service glance] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:36.044780 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1382/2750] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:13:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:13:41.921267 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd15124-5767-4b0c-aac2-b51ea9377d3c None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:41.922710 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-3dd15124-5767-4b0c-aac2-b51ea9377d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:41.963277 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:41.987843 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd15124-5767-4b0c-aac2-b51ea9377d3c None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:41.993195 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36cc56-5297-4d80-98b3-9f01804b383b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:41.994127 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36cc56-5297-4d80-98b3-9f01804b383b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:41.994417 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36cc56-5297-4d80-98b3-9f01804b383b admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:41.994706 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36cc56-5297-4d80-98b3-9f01804b383b admin admin] PATH_INFO: `/v3/users/e117f4a3320044139c202da2cf47a6e4` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:41.995910 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36cc56-5297-4d80-98b3-9f01804b383b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e117f4a3320044139c202da2cf47a6e4)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:41.997888 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36cc56-5297-4d80-98b3-9f01804b383b admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:42.183742 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-5f36cc56-5297-4d80-98b3-9f01804b383b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e117f4a3320044139c202da2cf47a6e4'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:42.191839 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-5f36cc56-5297-4d80-98b3-9f01804b383b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e117f4a3320044139c202da2cf47a6e4'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:42.192533 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-5f36cc56-5297-4d80-98b3-9f01804b383b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e117f4a3320044139c202da2cf47a6e4'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:42.196271 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-5f36cc56-5297-4d80-98b3-9f01804b383b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e117f4a3320044139c202da2cf47a6e4'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:42.265898 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-5f36cc56-5297-4d80-98b3-9f01804b383b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e117f4a3320044139c202da2cf47a6e4'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:42.284965 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1369/2751] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:13:41 2022] DELETE /identity/v3/users/e117f4a3320044139c202da2cf47a6e4 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:13:42.289566 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ea548-292d-45ec-878a-16569c3bb5ae None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:42.290057 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ea548-292d-45ec-878a-16569c3bb5ae None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:42.290154 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ea548-292d-45ec-878a-16569c3bb5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:42.308505 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-637ea548-292d-45ec-878a-16569c3bb5ae None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:42.309725 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-637ea548-292d-45ec-878a-16569c3bb5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:42.318723 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:42.370922 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1383/2752] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:13:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:13:42.381486 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36cc56-5297-4d80-98b3-9f01804b383b admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:42.382902 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-5f36cc56-5297-4d80-98b3-9f01804b383b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:42.441694 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36cc56-5297-4d80-98b3-9f01804b383b admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:42.445214 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3151d-0803-4120-acfe-b99e1a565b9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:42.445860 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3151d-0803-4120-acfe-b99e1a565b9a service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:42.446144 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3151d-0803-4120-acfe-b99e1a565b9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:42.446422 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3151d-0803-4120-acfe-b99e1a565b9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:42.455309 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be3151d-0803-4120-acfe-b99e1a565b9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:42.456756 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be3151d-0803-4120-acfe-b99e1a565b9a service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:42.466368 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1370/2753] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:13:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:13:42.887563 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ea548-292d-45ec-878a-16569c3bb5ae None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:42.889018 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-637ea548-292d-45ec-878a-16569c3bb5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:42.902059 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ea548-292d-45ec-878a-16569c3bb5ae None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:42.910638 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68604191-0b70-4d3d-8c97-fbb616c8c45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:42.913979 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68604191-0b70-4d3d-8c97-fbb616c8c45d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:42.913979 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68604191-0b70-4d3d-8c97-fbb616c8c45d admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:42.913979 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68604191-0b70-4d3d-8c97-fbb616c8c45d admin admin] PATH_INFO: `/v3/projects/fa128785201d4957af3b43e67b89e9c1` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:42.914576 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68604191-0b70-4d3d-8c97-fbb616c8c45d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa128785201d4957af3b43e67b89e9c1)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:42.916518 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68604191-0b70-4d3d-8c97-fbb616c8c45d admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:43.042949 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-68604191-0b70-4d3d-8c97-fbb616c8c45d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa128785201d4957af3b43e67b89e9c1', 'request_id': 'req-68604191-0b70-4d3d-8c97-fbb616c8c45d'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:43.049184 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-68604191-0b70-4d3d-8c97-fbb616c8c45d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa128785201d4957af3b43e67b89e9c1', 'request_id': 'req-68604191-0b70-4d3d-8c97-fbb616c8c45d'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:43.055021 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-68604191-0b70-4d3d-8c97-fbb616c8c45d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa128785201d4957af3b43e67b89e9c1', 'request_id': 'req-68604191-0b70-4d3d-8c97-fbb616c8c45d'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:43.132060 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-68604191-0b70-4d3d-8c97-fbb616c8c45d admin admin] The token cache is being invalidate because project fa128785201d4957af3b43e67b89e9c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:13:43.132359 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-68604191-0b70-4d3d-8c97-fbb616c8c45d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:43.132985 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-68604191-0b70-4d3d-8c97-fbb616c8c45d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:43.134568 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1384/2754] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:13:42 2022] DELETE /identity/v3/projects/fa128785201d4957af3b43e67b89e9c1 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:13:52.037962 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3151d-0803-4120-acfe-b99e1a565b9a service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:52.039506 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-7be3151d-0803-4120-acfe-b99e1a565b9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:52.053093 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3151d-0803-4120-acfe-b99e1a565b9a service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:52.107061 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:52.113595 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e7c20-e38c-43df-8572-791759176194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:52.118973 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e7c20-e38c-43df-8572-791759176194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:52.118973 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e7c20-e38c-43df-8572-791759176194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:52.118973 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e7c20-e38c-43df-8572-791759176194 admin admin] PATH_INFO: `/v3/users/1b01f1f4f27945f8b7ecb036c3e08c46` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:52.118973 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e7c20-e38c-43df-8572-791759176194 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b01f1f4f27945f8b7ecb036c3e08c46)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:52.118973 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e7c20-e38c-43df-8572-791759176194 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:52.313256 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-998e7c20-e38c-43df-8572-791759176194 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b01f1f4f27945f8b7ecb036c3e08c46'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:52.319828 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-998e7c20-e38c-43df-8572-791759176194 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b01f1f4f27945f8b7ecb036c3e08c46'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:52.320628 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-998e7c20-e38c-43df-8572-791759176194 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b01f1f4f27945f8b7ecb036c3e08c46'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:52.321259 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-998e7c20-e38c-43df-8572-791759176194 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b01f1f4f27945f8b7ecb036c3e08c46'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:52.396635 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-998e7c20-e38c-43df-8572-791759176194 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b01f1f4f27945f8b7ecb036c3e08c46'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:52.415018 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1371/2755] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:13:52 2022] DELETE /identity/v3/users/1b01f1f4f27945f8b7ecb036c3e08c46 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:13:52.419527 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad3597-23b4-4796-b4d9-bc413328eb0a None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:52.420052 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad3597-23b4-4796-b4d9-bc413328eb0a None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:52.420163 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad3597-23b4-4796-b4d9-bc413328eb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:52.437627 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-63ad3597-23b4-4796-b4d9-bc413328eb0a None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:13:52.438946 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-63ad3597-23b4-4796-b4d9-bc413328eb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:52.496856 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1385/2756] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:13:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:13:52.506616 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e7c20-e38c-43df-8572-791759176194 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:52.508141 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-998e7c20-e38c-43df-8572-791759176194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:52.569353 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e7c20-e38c-43df-8572-791759176194 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:52.573819 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b88706-0363-45bd-a6db-45269db03ca8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:52.574497 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b88706-0363-45bd-a6db-45269db03ca8 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:52.574785 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b88706-0363-45bd-a6db-45269db03ca8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:52.575062 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b88706-0363-45bd-a6db-45269db03ca8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:52.584140 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b88706-0363-45bd-a6db-45269db03ca8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:52.585557 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b88706-0363-45bd-a6db-45269db03ca8 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:52.595069 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1372/2757] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:13:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:13:52.992939 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad3597-23b4-4796-b4d9-bc413328eb0a None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:13:52.994518 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-63ad3597-23b4-4796-b4d9-bc413328eb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:13:53.006782 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad3597-23b4-4796-b4d9-bc413328eb0a None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:13:53.012468 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3a672-5229-4686-8798-4518adb704d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:13:53.013342 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3a672-5229-4686-8798-4518adb704d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:13:53.013705 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3a672-5229-4686-8798-4518adb704d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:13:53.013920 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3a672-5229-4686-8798-4518adb704d6 admin admin] PATH_INFO: `/v3/projects/45fca8497d274de89714d9a3d5b1b398` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:13:53.015461 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3a672-5229-4686-8798-4518adb704d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45fca8497d274de89714d9a3d5b1b398)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:13:53.017063 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3a672-5229-4686-8798-4518adb704d6 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:13:53.137525 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:13:53.149521 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-29a3a672-5229-4686-8798-4518adb704d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45fca8497d274de89714d9a3d5b1b398', 'request_id': 'req-29a3a672-5229-4686-8798-4518adb704d6'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:53.156814 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-29a3a672-5229-4686-8798-4518adb704d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45fca8497d274de89714d9a3d5b1b398', 'request_id': 'req-29a3a672-5229-4686-8798-4518adb704d6'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:53.165352 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-29a3a672-5229-4686-8798-4518adb704d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45fca8497d274de89714d9a3d5b1b398', 'request_id': 'req-29a3a672-5229-4686-8798-4518adb704d6'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:53.256545 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-29a3a672-5229-4686-8798-4518adb704d6 admin admin] The token cache is being invalidate because project 45fca8497d274de89714d9a3d5b1b398 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:13:53.256842 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-29a3a672-5229-4686-8798-4518adb704d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:53.257477 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-29a3a672-5229-4686-8798-4518adb704d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:13:53.259695 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1386/2758] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:13:52 2022] DELETE /identity/v3/projects/45fca8497d274de89714d9a3d5b1b398 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:14:02.590988 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:14:03.326110 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:14:05.892835 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a9512-706f-4f2e-9234-b300045d7f59 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:14:05.893385 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a9512-706f-4f2e-9234-b300045d7f59 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:14:05.893497 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a9512-706f-4f2e-9234-b300045d7f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:14:05.911289 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-945a9512-706f-4f2e-9234-b300045d7f59 None None] MFA Rules not processed for user `12a5d06d3eeb4dde9bd96df742dc719c`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:14:05.912509 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-945a9512-706f-4f2e-9234-b300045d7f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:14:05.967498 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1373/2759] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:14:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:14:06.271089 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3a672-5229-4686-8798-4518adb704d6 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:14:06.272825 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-29a3a672-5229-4686-8798-4518adb704d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:14:06.332326 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3a672-5229-4686-8798-4518adb704d6 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:14:06.337089 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9cd4a-884a-4139-9d48-6d81eabd6fc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:14:06.337789 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9cd4a-884a-4139-9d48-6d81eabd6fc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:14:06.338074 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9cd4a-884a-4139-9d48-6d81eabd6fc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:14:06.338358 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9cd4a-884a-4139-9d48-6d81eabd6fc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:14:06.340561 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-efe9cd4a-884a-4139-9d48-6d81eabd6fc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:14:06.351753 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe9cd4a-884a-4139-9d48-6d81eabd6fc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:14:06.353281 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe9cd4a-884a-4139-9d48-6d81eabd6fc5 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:14:06.363746 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1387/2760] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:14:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:14:15.960175 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=25 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:14:16.358638 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=26 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:14:20.840165 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a9512-706f-4f2e-9234-b300045d7f59 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:14:20.841658 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-945a9512-706f-4f2e-9234-b300045d7f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:14:20.935633 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a9512-706f-4f2e-9234-b300045d7f59 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:14:20.941640 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26f6fa-0d10-49e2-9dae-d69c70717b2a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '177a912380ad43b6a5e31b787a07ce7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:14:20.941640 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26f6fa-0d10-49e2-9dae-d69c70717b2a service placement] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:14:20.941910 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26f6fa-0d10-49e2-9dae-d69c70717b2a service placement] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:14:20.942172 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26f6fa-0d10-49e2-9dae-d69c70717b2a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:14:20.944176 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-6a26f6fa-0d10-49e2-9dae-d69c70717b2a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:14:20.956709 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a26f6fa-0d10-49e2-9dae-d69c70717b2a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:14:20.958921 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a26f6fa-0d10-49e2-9dae-d69c70717b2a service placement] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:14:20.970012 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1374/2761] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:14:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:14:30.965965 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=41 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:14:50.054180 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9cd4a-884a-4139-9d48-6d81eabd6fc5 service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:14:50.058237 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-efe9cd4a-884a-4139-9d48-6d81eabd6fc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:14:50.169014 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9cd4a-884a-4139-9d48-6d81eabd6fc5 service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:14:50.175515 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaee967-3488-48bc-a746-97489de889d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ac15411c75f4bd4a86f6753c9240a5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:14:50.176193 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaee967-3488-48bc-a746-97489de889d3 service nova] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:14:50.176483 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaee967-3488-48bc-a746-97489de889d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:14:50.176763 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaee967-3488-48bc-a746-97489de889d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:14:50.178521 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-6aaee967-3488-48bc-a746-97489de889d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:14:50.191604 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaee967-3488-48bc-a746-97489de889d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:14:50.193445 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaee967-3488-48bc-a746-97489de889d3 service nova] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:14:50.205524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1388/2762] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:14:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:15:00.199804 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=46 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:15:01.787954 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26f6fa-0d10-49e2-9dae-d69c70717b2a service placement] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:15:01.791838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-6a26f6fa-0d10-49e2-9dae-d69c70717b2a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:15:01.862728 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26f6fa-0d10-49e2-9dae-d69c70717b2a service placement] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:15:01.867529 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d309935-3d89-46b9-8b63-de6c96784b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:15:01.868479 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d309935-3d89-46b9-8b63-de6c96784b31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:15:01.868768 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d309935-3d89-46b9-8b63-de6c96784b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:15:01.869049 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d309935-3d89-46b9-8b63-de6c96784b31 admin admin] PATH_INFO: `/v3/users/d010d926f1d3454495478913094d87cb` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:15:01.870247 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d309935-3d89-46b9-8b63-de6c96784b31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d010d926f1d3454495478913094d87cb)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:15:01.872347 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d309935-3d89-46b9-8b63-de6c96784b31 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:15:02.056128 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-2d309935-3d89-46b9-8b63-de6c96784b31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd010d926f1d3454495478913094d87cb'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:15:02.063999 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-2d309935-3d89-46b9-8b63-de6c96784b31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd010d926f1d3454495478913094d87cb'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:15:02.064698 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-2d309935-3d89-46b9-8b63-de6c96784b31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd010d926f1d3454495478913094d87cb'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:15:02.065338 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-2d309935-3d89-46b9-8b63-de6c96784b31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd010d926f1d3454495478913094d87cb'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:15:02.133892 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-2d309935-3d89-46b9-8b63-de6c96784b31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd010d926f1d3454495478913094d87cb'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:15:02.151991 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1375/2763] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:15:01 2022] DELETE /identity/v3/users/d010d926f1d3454495478913094d87cb => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:15:02.375476 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaee967-3488-48bc-a746-97489de889d3 service nova] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:15:02.388223 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaee967-3488-48bc-a746-97489de889d3 service nova] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:15:02.446412 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e09fba-b872-4f03-82e9-fa0b36a151e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:15:02.447282 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e09fba-b872-4f03-82e9-fa0b36a151e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:15:02.447571 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e09fba-b872-4f03-82e9-fa0b36a151e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:15:02.447850 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e09fba-b872-4f03-82e9-fa0b36a151e6 admin admin] PATH_INFO: `/v3/projects/e301c3c4aae441a5950a91e1833284b0` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:15:02.449084 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e09fba-b872-4f03-82e9-fa0b36a151e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e301c3c4aae441a5950a91e1833284b0)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:15:02.451024 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e09fba-b872-4f03-82e9-fa0b36a151e6 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:15:02.542052 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-15e09fba-b872-4f03-82e9-fa0b36a151e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e301c3c4aae441a5950a91e1833284b0', 'request_id': 'req-15e09fba-b872-4f03-82e9-fa0b36a151e6'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:15:02.548150 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-15e09fba-b872-4f03-82e9-fa0b36a151e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e301c3c4aae441a5950a91e1833284b0', 'request_id': 'req-15e09fba-b872-4f03-82e9-fa0b36a151e6'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:15:02.553732 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-15e09fba-b872-4f03-82e9-fa0b36a151e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e301c3c4aae441a5950a91e1833284b0', 'request_id': 'req-15e09fba-b872-4f03-82e9-fa0b36a151e6'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:15:02.626539 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-15e09fba-b872-4f03-82e9-fa0b36a151e6 admin admin] The token cache is being invalidate because project e301c3c4aae441a5950a91e1833284b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:15:02.626830 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-15e09fba-b872-4f03-82e9-fa0b36a151e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:15:02.627453 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-15e09fba-b872-4f03-82e9-fa0b36a151e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:15:02.629023 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1389/2764] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:15:02 2022] DELETE /identity/v3/projects/e301c3c4aae441a5950a91e1833284b0 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:15:02.632952 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d309935-3d89-46b9-8b63-de6c96784b31 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:15:02.634509 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-2d309935-3d89-46b9-8b63-de6c96784b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:15:02.647991 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d309935-3d89-46b9-8b63-de6c96784b31 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:15:02.705494 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e492cad-4010-4533-8511-3fb24e42a64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:15:02.706385 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e492cad-4010-4533-8511-3fb24e42a64a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:15:02.706689 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e492cad-4010-4533-8511-3fb24e42a64a admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:15:02.706954 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e492cad-4010-4533-8511-3fb24e42a64a admin admin] PATH_INFO: `/v3/users/2d694ad41b0d456485f83d3251265f74` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:15:02.708220 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e492cad-4010-4533-8511-3fb24e42a64a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d694ad41b0d456485f83d3251265f74)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:15:02.710135 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e492cad-4010-4533-8511-3fb24e42a64a admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:15:02.733175 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:15:02.921607 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-3e492cad-4010-4533-8511-3fb24e42a64a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d694ad41b0d456485f83d3251265f74'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:15:02.928387 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-3e492cad-4010-4533-8511-3fb24e42a64a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d694ad41b0d456485f83d3251265f74'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:15:02.929084 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-3e492cad-4010-4533-8511-3fb24e42a64a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d694ad41b0d456485f83d3251265f74'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:15:02.929687 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-3e492cad-4010-4533-8511-3fb24e42a64a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d694ad41b0d456485f83d3251265f74'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:15:02.987554 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-3e492cad-4010-4533-8511-3fb24e42a64a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d694ad41b0d456485f83d3251265f74'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:15:03.006536 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1376/2765] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:15:02 2022] DELETE /identity/v3/users/2d694ad41b0d456485f83d3251265f74 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:15:03.244366 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e09fba-b872-4f03-82e9-fa0b36a151e6 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:15:03.246108 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-15e09fba-b872-4f03-82e9-fa0b36a151e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:15:03.259449 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e09fba-b872-4f03-82e9-fa0b36a151e6 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:15:03.318907 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252473e-7b76-4852-80e2-9fbd856df47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:15:03.319771 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252473e-7b76-4852-80e2-9fbd856df47c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:15:03.320097 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252473e-7b76-4852-80e2-9fbd856df47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:15:03.320384 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252473e-7b76-4852-80e2-9fbd856df47c admin admin] PATH_INFO: `/v3/projects/47922420541e4ece9338113b0bf86abc` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:15:03.321561 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252473e-7b76-4852-80e2-9fbd856df47c admin admin] RBAC: Authorizing `identity:delete_project(project_id=47922420541e4ece9338113b0bf86abc)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:15:03.323492 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252473e-7b76-4852-80e2-9fbd856df47c admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:15:03.414600 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:15:03.426238 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b252473e-7b76-4852-80e2-9fbd856df47c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47922420541e4ece9338113b0bf86abc', 'request_id': 'req-b252473e-7b76-4852-80e2-9fbd856df47c'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:15:03.432563 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b252473e-7b76-4852-80e2-9fbd856df47c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47922420541e4ece9338113b0bf86abc', 'request_id': 'req-b252473e-7b76-4852-80e2-9fbd856df47c'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:15:03.438017 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b252473e-7b76-4852-80e2-9fbd856df47c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47922420541e4ece9338113b0bf86abc', 'request_id': 'req-b252473e-7b76-4852-80e2-9fbd856df47c'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:15:03.522458 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b252473e-7b76-4852-80e2-9fbd856df47c admin admin] The token cache is being invalidate because project 47922420541e4ece9338113b0bf86abc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:15:03.522683 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b252473e-7b76-4852-80e2-9fbd856df47c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:15:03.523558 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b252473e-7b76-4852-80e2-9fbd856df47c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:15:03.525142 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1390/2766] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:15:03 2022] DELETE /identity/v3/projects/47922420541e4ece9338113b0bf86abc => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:15:10.810825 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f54e9-b1d9-4a46-a64d-0fbd693c3e22 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:15:10.811312 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f54e9-b1d9-4a46-a64d-0fbd693c3e22 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:15:10.811437 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f54e9-b1d9-4a46-a64d-0fbd693c3e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:15:10.830263 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-404f54e9-b1d9-4a46-a64d-0fbd693c3e22 None None] MFA Rules not processed for user `90ea5d52fd6d4068b7837d363eebb94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:15:10.831480 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-404f54e9-b1d9-4a46-a64d-0fbd693c3e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:15:10.886830 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1377/2767] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Jul 11 21:15:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:15:11.035529 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252473e-7b76-4852-80e2-9fbd856df47c admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:15:11.037052 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-b252473e-7b76-4852-80e2-9fbd856df47c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:15:11.106754 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252473e-7b76-4852-80e2-9fbd856df47c admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:15:11.112492 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7dbcd-be8c-40ae-8fc8-acb3e09edcf3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc950dfb1d3b4308a33f3d430fe34c1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:15:11.113199 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7dbcd-be8c-40ae-8fc8-acb3e09edcf3 service swift] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:15:11.119457 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7dbcd-be8c-40ae-8fc8-acb3e09edcf3 service swift] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:15:11.119457 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7dbcd-be8c-40ae-8fc8-acb3e09edcf3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:15:11.122337 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e7dbcd-be8c-40ae-8fc8-acb3e09edcf3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:15:11.123934 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e7dbcd-be8c-40ae-8fc8-acb3e09edcf3 service swift] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:15:11.133326 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1391/2768] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jul 11 21:15:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 21:15:20.880189 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:DELETE=7,keystone:SELECT=45,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:15:21.130010 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=44,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:15:26.713599 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a95d19-5896-4435-94b9-58ab3f4a45fa None None] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:15:26.714167 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a95d19-5896-4435-94b9-58ab3f4a45fa None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:15:26.714279 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a95d19-5896-4435-94b9-58ab3f4a45fa None None] PATH_INFO: `/` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:15:26.715614 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1378/2769] 10.222.0.40 () {54 vars in 921 bytes} [Mon Jul 11 21:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 21:15:26.721471 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c11886-cf1f-4989-b0e5-15f7598219c2 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:15:26.721930 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c11886-cf1f-4989-b0e5-15f7598219c2 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:15:26.722056 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c11886-cf1f-4989-b0e5-15f7598219c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:15:26.740860 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-06c11886-cf1f-4989-b0e5-15f7598219c2 None None] MFA Rules not processed for user `8ac15411c75f4bd4a86f6753c9240a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:15:26.742203 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-06c11886-cf1f-4989-b0e5-15f7598219c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:15:26.811367 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1392/2770] 10.222.0.40 () {58 vars in 1018 bytes} [Mon Jul 11 21:15:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:15:26.822718 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a95d19-5896-4435-94b9-58ab3f4a45fa None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:15:26.824480 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-41a95d19-5896-4435-94b9-58ab3f4a45fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:15:26.883133 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a95d19-5896-4435-94b9-58ab3f4a45fa None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:15:26.886624 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9bcb53-272a-4903-821e-99aa688ea23b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da488c75631e4e5992304ff6c0579aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:15:26.887278 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9bcb53-272a-4903-821e-99aa688ea23b service glance] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:15:26.887568 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9bcb53-272a-4903-821e-99aa688ea23b service glance] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:15:26.887854 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9bcb53-272a-4903-821e-99aa688ea23b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:15:26.898621 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9bcb53-272a-4903-821e-99aa688ea23b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:15:26.900336 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9bcb53-272a-4903-821e-99aa688ea23b service glance] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:15:26.911540 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1379/2771] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:15:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:15:29.153027 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196db7d-9742-466c-bb14-0d4dda50d98c None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:15:29.153509 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196db7d-9742-466c-bb14-0d4dda50d98c None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:15:29.153605 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196db7d-9742-466c-bb14-0d4dda50d98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:15:29.171371 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-e196db7d-9742-466c-bb14-0d4dda50d98c None None] MFA Rules not processed for user `90ea5d52fd6d4068b7837d363eebb94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:15:29.173243 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-e196db7d-9742-466c-bb14-0d4dda50d98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:15:29.180650 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1393/2772] 10.222.0.40 () {58 vars in 1009 bytes} [Mon Jul 11 21:15:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:15:29.193702 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9bcb53-272a-4903-821e-99aa688ea23b service glance] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:15:29.205032 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9bcb53-272a-4903-821e-99aa688ea23b service glance] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:15:29.209947 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab448f9-7bd9-499c-895e-4b53b597890f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc950dfb1d3b4308a33f3d430fe34c1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:15:29.210583 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab448f9-7bd9-499c-895e-4b53b597890f service swift] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:15:29.210868 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab448f9-7bd9-499c-895e-4b53b597890f service swift] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:15:29.211146 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab448f9-7bd9-499c-895e-4b53b597890f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:15:29.219850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab448f9-7bd9-499c-895e-4b53b597890f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:15:29.221455 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab448f9-7bd9-499c-895e-4b53b597890f service swift] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:15:29.229479 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1380/2773] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jul 11 21:15:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 21:15:39.166166 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=34 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:15:39.226177 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=32 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:15:47.072031 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2e82c-b8b8-4096-8291-42a583db78c7 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:15:47.072478 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2e82c-b8b8-4096-8291-42a583db78c7 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:15:47.072711 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2e82c-b8b8-4096-8291-42a583db78c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:15:47.090094 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-4ec2e82c-b8b8-4096-8291-42a583db78c7 None None] MFA Rules not processed for user `90ea5d52fd6d4068b7837d363eebb94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:15:47.091628 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-4ec2e82c-b8b8-4096-8291-42a583db78c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:15:47.098930 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1394/2774] 10.222.0.40 () {58 vars in 967 bytes} [Mon Jul 11 21:15:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:15:47.111628 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab448f9-7bd9-499c-895e-4b53b597890f service swift] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:15:47.122115 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab448f9-7bd9-499c-895e-4b53b597890f service swift] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:15:47.127809 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dccaceb-422e-4367-bd41-34631e06ff86 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc950dfb1d3b4308a33f3d430fe34c1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:15:47.128475 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dccaceb-422e-4367-bd41-34631e06ff86 service swift] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:15:47.128763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dccaceb-422e-4367-bd41-34631e06ff86 service swift] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:15:47.129041 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dccaceb-422e-4367-bd41-34631e06ff86 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:15:47.136885 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dccaceb-422e-4367-bd41-34631e06ff86 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:15:47.138440 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dccaceb-422e-4367-bd41-34631e06ff86 service swift] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:15:47.146558 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1381/2775] 10.222.0.40 () {60 vars in 1384 bytes} [Mon Jul 11 21:15:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 21:15:57.086697 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:15:57.143270 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=6 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:16:19.354298 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec2e82c-b8b8-4096-8291-42a583db78c7 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:19.355681 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-4ec2e82c-b8b8-4096-8291-42a583db78c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:16:19.411524 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec2e82c-b8b8-4096-8291-42a583db78c7 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:19.415034 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b595a7f-b91c-4afd-848d-1de976d5a1bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:19.415681 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b595a7f-b91c-4afd-848d-1de976d5a1bb service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:19.415993 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b595a7f-b91c-4afd-848d-1de976d5a1bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:19.416270 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b595a7f-b91c-4afd-848d-1de976d5a1bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:19.417978 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-7b595a7f-b91c-4afd-848d-1de976d5a1bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:16:19.431228 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b595a7f-b91c-4afd-848d-1de976d5a1bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:19.432678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b595a7f-b91c-4afd-848d-1de976d5a1bb service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:19.444055 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1395/2776] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:16:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:16:20.629841 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dccaceb-422e-4367-bd41-34631e06ff86 service swift] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:20.640487 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dccaceb-422e-4367-bd41-34631e06ff86 service swift] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:20.644980 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df5476-2faa-44f5-8957-1ac5019a9d17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:20.645645 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df5476-2faa-44f5-8957-1ac5019a9d17 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:20.645933 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df5476-2faa-44f5-8957-1ac5019a9d17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:20.646212 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df5476-2faa-44f5-8957-1ac5019a9d17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:20.648041 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-01df5476-2faa-44f5-8957-1ac5019a9d17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:16:20.666793 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df5476-2faa-44f5-8957-1ac5019a9d17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:20.668202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df5476-2faa-44f5-8957-1ac5019a9d17 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:20.680280 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1382/2777] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:16:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:16:28.060760 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b595a7f-b91c-4afd-848d-1de976d5a1bb service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:28.069349 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b595a7f-b91c-4afd-848d-1de976d5a1bb service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:28.072954 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc6a96-9750-4d16-a040-8dd844434449 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:28.073595 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc6a96-9750-4d16-a040-8dd844434449 service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:28.073881 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc6a96-9750-4d16-a040-8dd844434449 service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:28.074160 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc6a96-9750-4d16-a040-8dd844434449 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:28.075923 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-89cc6a96-9750-4d16-a040-8dd844434449 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:16:28.139066 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc6a96-9750-4d16-a040-8dd844434449 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:28.140566 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc6a96-9750-4d16-a040-8dd844434449 service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:28.152425 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1396/2778] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:16:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:16:29.919771 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df5476-2faa-44f5-8957-1ac5019a9d17 service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:29.921858 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-01df5476-2faa-44f5-8957-1ac5019a9d17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:16:30.009270 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df5476-2faa-44f5-8957-1ac5019a9d17 service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:30.014288 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abdc642-00e1-4c91-a19b-88e4e6ff67a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '177a912380ad43b6a5e31b787a07ce7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:30.016004 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abdc642-00e1-4c91-a19b-88e4e6ff67a1 service placement] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:30.016004 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abdc642-00e1-4c91-a19b-88e4e6ff67a1 service placement] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:30.016004 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abdc642-00e1-4c91-a19b-88e4e6ff67a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:30.017893 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-0abdc642-00e1-4c91-a19b-88e4e6ff67a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:16:30.029989 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abdc642-00e1-4c91-a19b-88e4e6ff67a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:30.031698 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abdc642-00e1-4c91-a19b-88e4e6ff67a1 service placement] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:30.052056 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1383/2779] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:16:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:16:30.057169 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc6a96-9750-4d16-a040-8dd844434449 service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:30.059389 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-89cc6a96-9750-4d16-a040-8dd844434449 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:16:30.075488 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc6a96-9750-4d16-a040-8dd844434449 service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:30.081340 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f275a0-ed80-483b-9d9d-b1e4e6861aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:30.082169 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f275a0-ed80-483b-9d9d-b1e4e6861aea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:30.082464 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f275a0-ed80-483b-9d9d-b1e4e6861aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:30.082746 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f275a0-ed80-483b-9d9d-b1e4e6861aea admin admin] PATH_INFO: `/v3/users/12a5d06d3eeb4dde9bd96df742dc719c` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:30.084000 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f275a0-ed80-483b-9d9d-b1e4e6861aea admin admin] RBAC: Authorizing `identity:delete_user(user_id=12a5d06d3eeb4dde9bd96df742dc719c)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:30.085926 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f275a0-ed80-483b-9d9d-b1e4e6861aea admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:30.211350 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-31f275a0-ed80-483b-9d9d-b1e4e6861aea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12a5d06d3eeb4dde9bd96df742dc719c'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:30.218121 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-31f275a0-ed80-483b-9d9d-b1e4e6861aea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12a5d06d3eeb4dde9bd96df742dc719c'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:30.218784 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-31f275a0-ed80-483b-9d9d-b1e4e6861aea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12a5d06d3eeb4dde9bd96df742dc719c'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:30.219387 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-31f275a0-ed80-483b-9d9d-b1e4e6861aea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12a5d06d3eeb4dde9bd96df742dc719c'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:30.260195 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-31f275a0-ed80-483b-9d9d-b1e4e6861aea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12a5d06d3eeb4dde9bd96df742dc719c'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:30.278238 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1397/2780] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:16:30 2022] DELETE /identity/v3/users/12a5d06d3eeb4dde9bd96df742dc719c => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:16:30.540848 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abdc642-00e1-4c91-a19b-88e4e6ff67a1 service placement] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:30.552911 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abdc642-00e1-4c91-a19b-88e4e6ff67a1 service placement] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:30.612456 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858afd95-da14-426b-bfdd-1b945f8a95fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:30.613357 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858afd95-da14-426b-bfdd-1b945f8a95fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:30.613645 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858afd95-da14-426b-bfdd-1b945f8a95fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:30.613922 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858afd95-da14-426b-bfdd-1b945f8a95fc admin admin] PATH_INFO: `/v3/projects/e21816ca02bb4663af970879e4d1044e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:30.615093 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858afd95-da14-426b-bfdd-1b945f8a95fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e21816ca02bb4663af970879e4d1044e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:30.617021 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858afd95-da14-426b-bfdd-1b945f8a95fc admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:30.737440 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-858afd95-da14-426b-bfdd-1b945f8a95fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e21816ca02bb4663af970879e4d1044e', 'request_id': 'req-858afd95-da14-426b-bfdd-1b945f8a95fc'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:30.743755 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-858afd95-da14-426b-bfdd-1b945f8a95fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e21816ca02bb4663af970879e4d1044e', 'request_id': 'req-858afd95-da14-426b-bfdd-1b945f8a95fc'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:30.749477 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-858afd95-da14-426b-bfdd-1b945f8a95fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e21816ca02bb4663af970879e4d1044e', 'request_id': 'req-858afd95-da14-426b-bfdd-1b945f8a95fc'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:30.797150 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-858afd95-da14-426b-bfdd-1b945f8a95fc admin admin] The token cache is being invalidate because project e21816ca02bb4663af970879e4d1044e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:16:30.797453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-858afd95-da14-426b-bfdd-1b945f8a95fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:30.798638 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-858afd95-da14-426b-bfdd-1b945f8a95fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:30.800593 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1384/2781] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:16:30 2022] DELETE /identity/v3/projects/e21816ca02bb4663af970879e4d1044e => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:16:30.805641 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a405f-4781-47f3-82eb-8d9b5ba74e96 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:30.805933 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a405f-4781-47f3-82eb-8d9b5ba74e96 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:30.806215 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a405f-4781-47f3-82eb-8d9b5ba74e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:30.824600 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-251a405f-4781-47f3-82eb-8d9b5ba74e96 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:16:30.825796 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-251a405f-4781-47f3-82eb-8d9b5ba74e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:16:30.830358 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:16:30.888138 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1398/2782] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:16:30.897057 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84a1d2-c1b6-4191-9809-b2817238bcc1 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:30.897349 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84a1d2-c1b6-4191-9809-b2817238bcc1 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:30.897632 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84a1d2-c1b6-4191-9809-b2817238bcc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:30.910944 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:16:30.917294 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-fe84a1d2-c1b6-4191-9809-b2817238bcc1 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:16:30.918515 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-fe84a1d2-c1b6-4191-9809-b2817238bcc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:16:30.927433 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1385/2783] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 21:16:30.931599 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a405f-4781-47f3-82eb-8d9b5ba74e96 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:30.941263 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a405f-4781-47f3-82eb-8d9b5ba74e96 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:30.945880 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afeaca-b49e-472b-8d56-16ee065a22a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:30.946534 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afeaca-b49e-472b-8d56-16ee065a22a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:30.946819 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afeaca-b49e-472b-8d56-16ee065a22a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:30.947094 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afeaca-b49e-472b-8d56-16ee065a22a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:30.947822 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58afeaca-b49e-472b-8d56-16ee065a22a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:16:30.948173 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58afeaca-b49e-472b-8d56-16ee065a22a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:30.949793 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58afeaca-b49e-472b-8d56-16ee065a22a3 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:30.961383 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1399/2784] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:16:30.965640 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84a1d2-c1b6-4191-9809-b2817238bcc1 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:30.975589 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84a1d2-c1b6-4191-9809-b2817238bcc1 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:30.980500 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58455205-ec1e-447a-8fbf-ed743d719fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:30.981167 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58455205-ec1e-447a-8fbf-ed743d719fab admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:30.983296 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58455205-ec1e-447a-8fbf-ed743d719fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:30.983296 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58455205-ec1e-447a-8fbf-ed743d719fab admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:30.983296 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58455205-ec1e-447a-8fbf-ed743d719fab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:30.984488 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58455205-ec1e-447a-8fbf-ed743d719fab admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:31.067080 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1386/2785] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:16:30 2022] POST /identity/v3/projects => generated 369 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 21:16:31.071097 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afeaca-b49e-472b-8d56-16ee065a22a3 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:31.082170 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afeaca-b49e-472b-8d56-16ee065a22a3 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:31.136840 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d28c0f-d268-4e94-b0df-43ac2bec3513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:31.137517 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d28c0f-d268-4e94-b0df-43ac2bec3513 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:31.137833 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d28c0f-d268-4e94-b0df-43ac2bec3513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:31.138088 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d28c0f-d268-4e94-b0df-43ac2bec3513 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:31.138776 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d28c0f-d268-4e94-b0df-43ac2bec3513 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:31.140720 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d28c0f-d268-4e94-b0df-43ac2bec3513 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:31.202632 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1400/2786] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:16:31 2022] POST /identity/v3/users => generated 285 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 21:16:31.207376 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58455205-ec1e-447a-8fbf-ed743d719fab admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:31.217646 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58455205-ec1e-447a-8fbf-ed743d719fab admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:31.223379 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a890da1-937c-4c8f-892a-c36591d52d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:31.224110 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a890da1-937c-4c8f-892a-c36591d52d88 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:31.224403 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a890da1-937c-4c8f-892a-c36591d52d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:31.224678 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a890da1-937c-4c8f-892a-c36591d52d88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:31.225438 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a890da1-937c-4c8f-892a-c36591d52d88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:31.227043 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a890da1-937c-4c8f-892a-c36591d52d88 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:31.238029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1387/2787] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:16:31.241975 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d28c0f-d268-4e94-b0df-43ac2bec3513 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:31.252192 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d28c0f-d268-4e94-b0df-43ac2bec3513 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:31.256841 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36709a8f-348e-437e-b0c5-798d605d4671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:31.257513 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36709a8f-348e-437e-b0c5-798d605d4671 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:31.257803 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36709a8f-348e-437e-b0c5-798d605d4671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:31.258065 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36709a8f-348e-437e-b0c5-798d605d4671 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:31.258836 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36709a8f-348e-437e-b0c5-798d605d4671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:31.260487 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36709a8f-348e-437e-b0c5-798d605d4671 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:31.271928 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1401/2788] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 21:16:31.275699 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a890da1-937c-4c8f-892a-c36591d52d88 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:31.286664 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a890da1-937c-4c8f-892a-c36591d52d88 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:31.291551 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff16727-bb1c-4e31-b97d-874c9720f40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:31.292501 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff16727-bb1c-4e31-b97d-874c9720f40a admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:31.296629 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff16727-bb1c-4e31-b97d-874c9720f40a admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:31.296629 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff16727-bb1c-4e31-b97d-874c9720f40a admin admin] PATH_INFO: `/v3/projects/27d8b33914d54e3f9b3538fac7a0e7ee/users/33195602bb7d4dc888b5c3823470780d/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:31.308046 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff16727-bb1c-4e31-b97d-874c9720f40a admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d8b33914d54e3f9b3538fac7a0e7ee, user_id=33195602bb7d4dc888b5c3823470780d, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:31.310718 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff16727-bb1c-4e31-b97d-874c9720f40a admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:31.419202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1388/2789] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:16:31 2022] PUT /identity/v3/projects/27d8b33914d54e3f9b3538fac7a0e7ee/users/33195602bb7d4dc888b5c3823470780d/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:16:31.429410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5ca0c-7d98-401e-8fa3-05fe3ab67993 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:31.429714 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5ca0c-7d98-401e-8fa3-05fe3ab67993 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:31.430005 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5ca0c-7d98-401e-8fa3-05fe3ab67993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:31.456902 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-61c5ca0c-7d98-401e-8fa3-05fe3ab67993 None None] MFA Rules not processed for user `33195602bb7d4dc888b5c3823470780d`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:16:31.458093 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-61c5ca0c-7d98-401e-8fa3-05fe3ab67993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:16:31.522400 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1402/2790] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:16:31 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:16:31.527087 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff16727-bb1c-4e31-b97d-874c9720f40a admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:31.590090 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff16727-bb1c-4e31-b97d-874c9720f40a admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:31.594857 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418660f-af61-417b-8088-2cd9a212cff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:31.596170 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418660f-af61-417b-8088-2cd9a212cff3 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:31.596467 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418660f-af61-417b-8088-2cd9a212cff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:31.596756 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418660f-af61-417b-8088-2cd9a212cff3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:31.597485 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8418660f-af61-417b-8088-2cd9a212cff3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:31.599373 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8418660f-af61-417b-8088-2cd9a212cff3 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:31.702272 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1389/2791] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:16:31 2022] POST /identity/v3/projects => generated 371 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:16:31.706735 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5ca0c-7d98-401e-8fa3-05fe3ab67993 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:31.713462 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:16:31.717706 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5ca0c-7d98-401e-8fa3-05fe3ab67993 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:31.773644 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987d04c-a589-46d7-ac26-5f35d0adff0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:31.774315 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987d04c-a589-46d7-ac26-5f35d0adff0c admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:31.774603 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987d04c-a589-46d7-ac26-5f35d0adff0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:31.775136 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987d04c-a589-46d7-ac26-5f35d0adff0c admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:31.775821 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987d04c-a589-46d7-ac26-5f35d0adff0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:31.777821 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987d04c-a589-46d7-ac26-5f35d0adff0c admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:31.853459 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1403/2792] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:16:31 2022] POST /identity/v3/users => generated 292 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:16:31.857366 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418660f-af61-417b-8088-2cd9a212cff3 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:31.868341 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418660f-af61-417b-8088-2cd9a212cff3 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:31.873023 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df3ede-6bd0-4c5c-a1a6-9232b17c592d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:31.873715 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df3ede-6bd0-4c5c-a1a6-9232b17c592d admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:31.874005 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df3ede-6bd0-4c5c-a1a6-9232b17c592d admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:31.874284 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df3ede-6bd0-4c5c-a1a6-9232b17c592d admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:31.875010 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df3ede-6bd0-4c5c-a1a6-9232b17c592d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:31.876849 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df3ede-6bd0-4c5c-a1a6-9232b17c592d admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:31.887283 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1390/2793] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:16:31.891186 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987d04c-a589-46d7-ac26-5f35d0adff0c admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:31.901889 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987d04c-a589-46d7-ac26-5f35d0adff0c admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:31.906362 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728adf94-b11f-45ed-92f1-a2395457e243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:31.907239 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728adf94-b11f-45ed-92f1-a2395457e243 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:31.908261 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728adf94-b11f-45ed-92f1-a2395457e243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:31.908557 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728adf94-b11f-45ed-92f1-a2395457e243 admin admin] PATH_INFO: `/v3/projects/ee237a4d154d4aaf8e5332d887f37815/users/d7f35bf2e0bb4644b08c8cdf4971bfc1/roles/86273ff072f3438d822e870272491768` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:31.923160 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728adf94-b11f-45ed-92f1-a2395457e243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee237a4d154d4aaf8e5332d887f37815, user_id=d7f35bf2e0bb4644b08c8cdf4971bfc1, role_id=86273ff072f3438d822e870272491768)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:31.925828 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728adf94-b11f-45ed-92f1-a2395457e243 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:32.014603 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1404/2794] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:16:31 2022] PUT /identity/v3/projects/ee237a4d154d4aaf8e5332d887f37815/users/d7f35bf2e0bb4644b08c8cdf4971bfc1/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:16:32.019043 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df3ede-6bd0-4c5c-a1a6-9232b17c592d admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:32.029327 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df3ede-6bd0-4c5c-a1a6-9232b17c592d admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:32.084435 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf26cd-1e69-48a3-8ad9-62c95d905abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:32.085101 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf26cd-1e69-48a3-8ad9-62c95d905abb admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:32.085388 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf26cd-1e69-48a3-8ad9-62c95d905abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:32.085664 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf26cd-1e69-48a3-8ad9-62c95d905abb admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:32.086378 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbf26cd-1e69-48a3-8ad9-62c95d905abb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:32.087955 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbf26cd-1e69-48a3-8ad9-62c95d905abb admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:32.098125 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1391/2795] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:16:32.102182 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728adf94-b11f-45ed-92f1-a2395457e243 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:32.112283 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728adf94-b11f-45ed-92f1-a2395457e243 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:32.116878 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555bf88-8e36-4273-868a-488a3a3b9497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:32.117755 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555bf88-8e36-4273-868a-488a3a3b9497 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:32.118038 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555bf88-8e36-4273-868a-488a3a3b9497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:32.118315 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555bf88-8e36-4273-868a-488a3a3b9497 admin admin] PATH_INFO: `/v3/projects/ee237a4d154d4aaf8e5332d887f37815/users/d7f35bf2e0bb4644b08c8cdf4971bfc1/roles/86273ff072f3438d822e870272491768` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:32.120313 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7555bf88-8e36-4273-868a-488a3a3b9497 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee237a4d154d4aaf8e5332d887f37815, user_id=d7f35bf2e0bb4644b08c8cdf4971bfc1, role_id=86273ff072f3438d822e870272491768)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:32.122913 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7555bf88-8e36-4273-868a-488a3a3b9497 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:32.133087 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1405/2796] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:16:32 2022] PUT /identity/v3/projects/ee237a4d154d4aaf8e5332d887f37815/users/d7f35bf2e0bb4644b08c8cdf4971bfc1/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:16:32.145504 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99d022-c685-4b99-96ad-5f3eb140ca6a None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:32.147494 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99d022-c685-4b99-96ad-5f3eb140ca6a None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:32.147494 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99d022-c685-4b99-96ad-5f3eb140ca6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:32.169928 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:16:32.173096 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-dc99d022-c685-4b99-96ad-5f3eb140ca6a None None] MFA Rules not processed for user `d7f35bf2e0bb4644b08c8cdf4971bfc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:16:32.174503 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-dc99d022-c685-4b99-96ad-5f3eb140ca6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:16:32.242825 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1392/2797] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:16:32 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:16:32.254503 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555bf88-8e36-4273-868a-488a3a3b9497 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:32.256232 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-7555bf88-8e36-4273-868a-488a3a3b9497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:16:32.311875 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555bf88-8e36-4273-868a-488a3a3b9497 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:32.316071 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c00701-1892-4c31-82fc-0cfce30fb077 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:32.316712 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c00701-1892-4c31-82fc-0cfce30fb077 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:32.317001 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c00701-1892-4c31-82fc-0cfce30fb077 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:32.317282 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c00701-1892-4c31-82fc-0cfce30fb077 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:32.326102 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c00701-1892-4c31-82fc-0cfce30fb077 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:32.327527 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c00701-1892-4c31-82fc-0cfce30fb077 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:32.337371 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1406/2798] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:16:32 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:16:33.178696 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc99d022-c685-4b99-96ad-5f3eb140ca6a None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:33.242281 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc99d022-c685-4b99-96ad-5f3eb140ca6a None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:33.246706 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8bc6d-bc32-46ea-8264-e2827e14e25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:33.247572 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8bc6d-bc32-46ea-8264-e2827e14e25b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:33.247859 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8bc6d-bc32-46ea-8264-e2827e14e25b admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:33.248172 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8bc6d-bc32-46ea-8264-e2827e14e25b admin admin] PATH_INFO: `/v3/users/33195602bb7d4dc888b5c3823470780d` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:33.249342 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8bc6d-bc32-46ea-8264-e2827e14e25b admin admin] RBAC: Authorizing `identity:delete_user(user_id=33195602bb7d4dc888b5c3823470780d)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:33.251778 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8bc6d-bc32-46ea-8264-e2827e14e25b admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:33.427651 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-3ce8bc6d-bc32-46ea-8264-e2827e14e25b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33195602bb7d4dc888b5c3823470780d'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:33.435020 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-3ce8bc6d-bc32-46ea-8264-e2827e14e25b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33195602bb7d4dc888b5c3823470780d'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:33.435719 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-3ce8bc6d-bc32-46ea-8264-e2827e14e25b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33195602bb7d4dc888b5c3823470780d'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:33.436342 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-3ce8bc6d-bc32-46ea-8264-e2827e14e25b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33195602bb7d4dc888b5c3823470780d'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:33.517243 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-3ce8bc6d-bc32-46ea-8264-e2827e14e25b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33195602bb7d4dc888b5c3823470780d'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:33.535932 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1393/2799] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:16:33 2022] DELETE /identity/v3/users/33195602bb7d4dc888b5c3823470780d => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:16:33.540554 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad48004-dd70-43f8-aeb9-79051c55d285 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:33.541037 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad48004-dd70-43f8-aeb9-79051c55d285 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:33.541145 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad48004-dd70-43f8-aeb9-79051c55d285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:33.558948 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-3ad48004-dd70-43f8-aeb9-79051c55d285 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:16:33.560197 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-3ad48004-dd70-43f8-aeb9-79051c55d285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:16:33.612470 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:16:33.620648 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1407/2800] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:16:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:16:33.631345 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8bc6d-bc32-46ea-8264-e2827e14e25b admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:33.633122 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-3ce8bc6d-bc32-46ea-8264-e2827e14e25b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:16:33.655556 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:16:33.693204 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8bc6d-bc32-46ea-8264-e2827e14e25b admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:33.696864 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12894528-8624-406a-9c29-6d21fd995360 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:33.697511 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12894528-8624-406a-9c29-6d21fd995360 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:33.697795 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12894528-8624-406a-9c29-6d21fd995360 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:33.698070 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12894528-8624-406a-9c29-6d21fd995360 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:33.707599 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12894528-8624-406a-9c29-6d21fd995360 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:33.709041 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12894528-8624-406a-9c29-6d21fd995360 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:33.718236 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1394/2801] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:16:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:16:34.429594 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad48004-dd70-43f8-aeb9-79051c55d285 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:34.429594 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-3ad48004-dd70-43f8-aeb9-79051c55d285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:16:34.442858 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad48004-dd70-43f8-aeb9-79051c55d285 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:34.447637 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933d887-671c-4459-af44-9febf97920d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:34.448575 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933d887-671c-4459-af44-9febf97920d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:34.448862 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933d887-671c-4459-af44-9febf97920d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:34.449143 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933d887-671c-4459-af44-9febf97920d9 admin admin] PATH_INFO: `/v3/projects/27d8b33914d54e3f9b3538fac7a0e7ee` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:34.450980 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933d887-671c-4459-af44-9febf97920d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27d8b33914d54e3f9b3538fac7a0e7ee)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:34.458677 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933d887-671c-4459-af44-9febf97920d9 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:34.557577 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-5933d887-671c-4459-af44-9febf97920d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27d8b33914d54e3f9b3538fac7a0e7ee', 'request_id': 'req-5933d887-671c-4459-af44-9febf97920d9'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:34.564274 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-5933d887-671c-4459-af44-9febf97920d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27d8b33914d54e3f9b3538fac7a0e7ee', 'request_id': 'req-5933d887-671c-4459-af44-9febf97920d9'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:34.569834 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-5933d887-671c-4459-af44-9febf97920d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27d8b33914d54e3f9b3538fac7a0e7ee', 'request_id': 'req-5933d887-671c-4459-af44-9febf97920d9'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:34.637204 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-5933d887-671c-4459-af44-9febf97920d9 admin admin] The token cache is being invalidate because project 27d8b33914d54e3f9b3538fac7a0e7ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:16:34.637496 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-5933d887-671c-4459-af44-9febf97920d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:34.638119 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-5933d887-671c-4459-af44-9febf97920d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:34.639707 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1408/2802] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:16:34 2022] DELETE /identity/v3/projects/27d8b33914d54e3f9b3538fac7a0e7ee => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:16:34.644571 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12894528-8624-406a-9c29-6d21fd995360 service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:34.654654 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12894528-8624-406a-9c29-6d21fd995360 service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:34.711711 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9028b038-6452-4d6f-a734-4a41004712fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:34.712626 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028b038-6452-4d6f-a734-4a41004712fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:34.712919 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028b038-6452-4d6f-a734-4a41004712fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:34.713202 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028b038-6452-4d6f-a734-4a41004712fc admin admin] PATH_INFO: `/v3/users/d7f35bf2e0bb4644b08c8cdf4971bfc1` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:34.714379 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9028b038-6452-4d6f-a734-4a41004712fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7f35bf2e0bb4644b08c8cdf4971bfc1)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:34.716307 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9028b038-6452-4d6f-a734-4a41004712fc admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:34.913962 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-9028b038-6452-4d6f-a734-4a41004712fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7f35bf2e0bb4644b08c8cdf4971bfc1'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:34.920844 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-9028b038-6452-4d6f-a734-4a41004712fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7f35bf2e0bb4644b08c8cdf4971bfc1'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:34.921503 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-9028b038-6452-4d6f-a734-4a41004712fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7f35bf2e0bb4644b08c8cdf4971bfc1'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:34.922107 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-9028b038-6452-4d6f-a734-4a41004712fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7f35bf2e0bb4644b08c8cdf4971bfc1'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:34.986136 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-9028b038-6452-4d6f-a734-4a41004712fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7f35bf2e0bb4644b08c8cdf4971bfc1'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:35.004225 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1395/2803] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:16:34 2022] DELETE /identity/v3/users/d7f35bf2e0bb4644b08c8cdf4971bfc1 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:16:35.443129 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933d887-671c-4459-af44-9febf97920d9 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:35.444586 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-5933d887-671c-4459-af44-9febf97920d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:16:35.459072 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933d887-671c-4459-af44-9febf97920d9 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:35.517751 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a57be-1e20-4b7c-91e4-ba8af32df9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:35.518623 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a57be-1e20-4b7c-91e4-ba8af32df9f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:35.518917 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a57be-1e20-4b7c-91e4-ba8af32df9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:35.519202 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a57be-1e20-4b7c-91e4-ba8af32df9f2 admin admin] PATH_INFO: `/v3/projects/ee237a4d154d4aaf8e5332d887f37815` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:35.520444 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a57be-1e20-4b7c-91e4-ba8af32df9f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee237a4d154d4aaf8e5332d887f37815)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:35.522371 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a57be-1e20-4b7c-91e4-ba8af32df9f2 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:35.625691 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-607a57be-1e20-4b7c-91e4-ba8af32df9f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee237a4d154d4aaf8e5332d887f37815', 'request_id': 'req-607a57be-1e20-4b7c-91e4-ba8af32df9f2'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:35.632288 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-607a57be-1e20-4b7c-91e4-ba8af32df9f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee237a4d154d4aaf8e5332d887f37815', 'request_id': 'req-607a57be-1e20-4b7c-91e4-ba8af32df9f2'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:35.638148 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-607a57be-1e20-4b7c-91e4-ba8af32df9f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee237a4d154d4aaf8e5332d887f37815', 'request_id': 'req-607a57be-1e20-4b7c-91e4-ba8af32df9f2'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:35.723287 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-607a57be-1e20-4b7c-91e4-ba8af32df9f2 admin admin] The token cache is being invalidate because project ee237a4d154d4aaf8e5332d887f37815 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:16:35.723581 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-607a57be-1e20-4b7c-91e4-ba8af32df9f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:35.724235 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-607a57be-1e20-4b7c-91e4-ba8af32df9f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:35.725839 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1409/2804] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:16:35 2022] DELETE /identity/v3/projects/ee237a4d154d4aaf8e5332d887f37815 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:16:35.730805 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add35a8-aad2-4983-b7a0-024930fba2cd None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:35.731272 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add35a8-aad2-4983-b7a0-024930fba2cd None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:35.731370 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add35a8-aad2-4983-b7a0-024930fba2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:35.749917 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-6add35a8-aad2-4983-b7a0-024930fba2cd None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:16:35.751713 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-6add35a8-aad2-4983-b7a0-024930fba2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:16:35.785605 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:16:35.810871 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1396/2805] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:16:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:16:35.819413 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21b91c-03d8-4349-9840-f18032ec70c2 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:35.819708 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21b91c-03d8-4349-9840-f18032ec70c2 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:35.820020 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21b91c-03d8-4349-9840-f18032ec70c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:35.838082 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-ac21b91c-03d8-4349-9840-f18032ec70c2 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:16:35.842345 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-ac21b91c-03d8-4349-9840-f18032ec70c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:16:35.847593 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1410/2806] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:16:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:16:35.851763 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add35a8-aad2-4983-b7a0-024930fba2cd None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:35.862062 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add35a8-aad2-4983-b7a0-024930fba2cd None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:35.866616 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ad2d3-51d4-41b6-9b5c-c5fb2864a02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:35.871227 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ad2d3-51d4-41b6-9b5c-c5fb2864a02c admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:35.871227 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ad2d3-51d4-41b6-9b5c-c5fb2864a02c admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:35.871227 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ad2d3-51d4-41b6-9b5c-c5fb2864a02c admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:35.871227 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ad2d3-51d4-41b6-9b5c-c5fb2864a02c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:16:35.871227 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ad2d3-51d4-41b6-9b5c-c5fb2864a02c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:35.871227 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ad2d3-51d4-41b6-9b5c-c5fb2864a02c admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:35.882566 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1397/2807] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:16:35.886548 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21b91c-03d8-4349-9840-f18032ec70c2 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:35.896447 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21b91c-03d8-4349-9840-f18032ec70c2 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:35.901313 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e00eb3-b3e9-49f6-b0a1-11a6dcd7a5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:35.901966 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e00eb3-b3e9-49f6-b0a1-11a6dcd7a5ea admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:35.902256 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e00eb3-b3e9-49f6-b0a1-11a6dcd7a5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:35.902540 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e00eb3-b3e9-49f6-b0a1-11a6dcd7a5ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:35.903252 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e00eb3-b3e9-49f6-b0a1-11a6dcd7a5ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:35.905174 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e00eb3-b3e9-49f6-b0a1-11a6dcd7a5ea admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:35.908484 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:16:35.993786 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1411/2808] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:16:35 2022] POST /identity/v3/projects => generated 365 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:16:35.997814 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ad2d3-51d4-41b6-9b5c-c5fb2864a02c admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:36.008270 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ad2d3-51d4-41b6-9b5c-c5fb2864a02c admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:36.063221 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3802ad-dfae-4abc-8aae-87f120a50a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:36.064431 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3802ad-dfae-4abc-8aae-87f120a50a26 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:36.064891 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3802ad-dfae-4abc-8aae-87f120a50a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:36.065174 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3802ad-dfae-4abc-8aae-87f120a50a26 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:36.065862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3802ad-dfae-4abc-8aae-87f120a50a26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:36.067801 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3802ad-dfae-4abc-8aae-87f120a50a26 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:36.129196 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1398/2809] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:16:35 2022] POST /identity/v3/users => generated 283 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:16:36.133259 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e00eb3-b3e9-49f6-b0a1-11a6dcd7a5ea admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:36.145888 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e00eb3-b3e9-49f6-b0a1-11a6dcd7a5ea admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:36.150869 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9771c2-0e06-4d88-a6eb-f3a072a13a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:36.151526 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9771c2-0e06-4d88-a6eb-f3a072a13a8b admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:36.151813 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9771c2-0e06-4d88-a6eb-f3a072a13a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:36.152129 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9771c2-0e06-4d88-a6eb-f3a072a13a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:36.152950 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9771c2-0e06-4d88-a6eb-f3a072a13a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:36.154536 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9771c2-0e06-4d88-a6eb-f3a072a13a8b admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:36.164692 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1412/2810] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:16:36.168517 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3802ad-dfae-4abc-8aae-87f120a50a26 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:36.178651 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3802ad-dfae-4abc-8aae-87f120a50a26 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:36.183299 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8db82a-4b8e-49e9-bac5-5ca4cafbaf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:36.183959 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8db82a-4b8e-49e9-bac5-5ca4cafbaf8d admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:36.184275 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8db82a-4b8e-49e9-bac5-5ca4cafbaf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:36.184555 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8db82a-4b8e-49e9-bac5-5ca4cafbaf8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:36.185281 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8db82a-4b8e-49e9-bac5-5ca4cafbaf8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:36.186854 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8db82a-4b8e-49e9-bac5-5ca4cafbaf8d admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:36.197384 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1399/2811] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:16:36.201289 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9771c2-0e06-4d88-a6eb-f3a072a13a8b admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:36.211872 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9771c2-0e06-4d88-a6eb-f3a072a13a8b admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:36.216460 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a36bb01-b1bf-4e3d-ab9e-32f4229f3cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:36.217342 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36bb01-b1bf-4e3d-ab9e-32f4229f3cb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:36.217634 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36bb01-b1bf-4e3d-ab9e-32f4229f3cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:36.217922 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36bb01-b1bf-4e3d-ab9e-32f4229f3cb3 admin admin] PATH_INFO: `/v3/projects/182dfc3847a8407f85cd77d06131b22a/users/d94daf8e7d6f4e8485986f6967463d08/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:36.232329 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a36bb01-b1bf-4e3d-ab9e-32f4229f3cb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=182dfc3847a8407f85cd77d06131b22a, user_id=d94daf8e7d6f4e8485986f6967463d08, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:36.234941 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a36bb01-b1bf-4e3d-ab9e-32f4229f3cb3 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:36.317654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1413/2812] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:16:36 2022] PUT /identity/v3/projects/182dfc3847a8407f85cd77d06131b22a/users/d94daf8e7d6f4e8485986f6967463d08/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:16:36.328431 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2827b26-c1fe-48ff-9a33-ea473cbb0219 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:36.328725 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2827b26-c1fe-48ff-9a33-ea473cbb0219 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:36.329011 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2827b26-c1fe-48ff-9a33-ea473cbb0219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:36.355285 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-b2827b26-c1fe-48ff-9a33-ea473cbb0219 None None] MFA Rules not processed for user `d94daf8e7d6f4e8485986f6967463d08`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:16:36.356521 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b2827b26-c1fe-48ff-9a33-ea473cbb0219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:16:36.418447 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1400/2813] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:16:36 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:16:36.423504 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a36bb01-b1bf-4e3d-ab9e-32f4229f3cb3 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:36.483027 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a36bb01-b1bf-4e3d-ab9e-32f4229f3cb3 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:36.487638 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbe5b9-376d-467b-95ba-96c03b08b863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:36.488315 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbe5b9-376d-467b-95ba-96c03b08b863 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:36.488603 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbe5b9-376d-467b-95ba-96c03b08b863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:36.488886 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbe5b9-376d-467b-95ba-96c03b08b863 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:36.489567 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edbe5b9-376d-467b-95ba-96c03b08b863 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:36.491460 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edbe5b9-376d-467b-95ba-96c03b08b863 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:36.552576 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1414/2814] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:16:36 2022] POST /identity/v3/projects => generated 365 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:16:36.556620 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2827b26-c1fe-48ff-9a33-ea473cbb0219 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:36.567412 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2827b26-c1fe-48ff-9a33-ea473cbb0219 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:36.599820 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:16:36.623870 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb6f27-971e-4479-9802-f08f21105e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:36.624586 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb6f27-971e-4479-9802-f08f21105e8b admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:36.624875 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb6f27-971e-4479-9802-f08f21105e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:36.625159 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb6f27-971e-4479-9802-f08f21105e8b admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:36.625893 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb6f27-971e-4479-9802-f08f21105e8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:36.628152 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb6f27-971e-4479-9802-f08f21105e8b admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:36.712380 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1401/2815] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:16:36 2022] POST /identity/v3/users => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:16:36.716014 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbe5b9-376d-467b-95ba-96c03b08b863 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:36.726567 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbe5b9-376d-467b-95ba-96c03b08b863 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:36.731201 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f2a8e-035f-4c50-8d53-061cb0625358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:36.731929 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f2a8e-035f-4c50-8d53-061cb0625358 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:36.732251 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f2a8e-035f-4c50-8d53-061cb0625358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:36.732534 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f2a8e-035f-4c50-8d53-061cb0625358 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:36.733266 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f2a8e-035f-4c50-8d53-061cb0625358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:36.734900 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f2a8e-035f-4c50-8d53-061cb0625358 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:36.745661 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1415/2816] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:16:36.752197 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb6f27-971e-4479-9802-f08f21105e8b admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:36.764029 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb6f27-971e-4479-9802-f08f21105e8b admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:36.769097 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0d2e5-a776-4c95-ac16-501b02444a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:36.769974 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0d2e5-a776-4c95-ac16-501b02444a0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:36.770261 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0d2e5-a776-4c95-ac16-501b02444a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:36.770546 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0d2e5-a776-4c95-ac16-501b02444a0a admin admin] PATH_INFO: `/v3/projects/005a3cebe7464e439030881bf02051f4/users/defebefaac954710836161646048637d/roles/86273ff072f3438d822e870272491768` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:36.785535 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0d2e5-a776-4c95-ac16-501b02444a0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=005a3cebe7464e439030881bf02051f4, user_id=defebefaac954710836161646048637d, role_id=86273ff072f3438d822e870272491768)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:36.788177 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0d2e5-a776-4c95-ac16-501b02444a0a admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:36.883442 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1402/2817] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:16:36 2022] PUT /identity/v3/projects/005a3cebe7464e439030881bf02051f4/users/defebefaac954710836161646048637d/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:16:36.887489 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f2a8e-035f-4c50-8d53-061cb0625358 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:36.898316 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f2a8e-035f-4c50-8d53-061cb0625358 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:36.956443 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf9d9b-39cf-4f47-bf68-8345ff9da094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:36.957120 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf9d9b-39cf-4f47-bf68-8345ff9da094 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:36.957406 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf9d9b-39cf-4f47-bf68-8345ff9da094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:36.957686 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf9d9b-39cf-4f47-bf68-8345ff9da094 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:36.958410 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf9d9b-39cf-4f47-bf68-8345ff9da094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:36.960027 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf9d9b-39cf-4f47-bf68-8345ff9da094 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:36.970087 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1416/2818] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:16:36.974557 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0d2e5-a776-4c95-ac16-501b02444a0a admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:36.985287 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0d2e5-a776-4c95-ac16-501b02444a0a admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:36.989919 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05efddf-c3f6-4e7a-a68d-27d76d4378fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:36.995150 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05efddf-c3f6-4e7a-a68d-27d76d4378fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:36.995150 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05efddf-c3f6-4e7a-a68d-27d76d4378fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:36.995150 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05efddf-c3f6-4e7a-a68d-27d76d4378fd admin admin] PATH_INFO: `/v3/projects/005a3cebe7464e439030881bf02051f4/users/defebefaac954710836161646048637d/roles/86273ff072f3438d822e870272491768` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:36.995150 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05efddf-c3f6-4e7a-a68d-27d76d4378fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=005a3cebe7464e439030881bf02051f4, user_id=defebefaac954710836161646048637d, role_id=86273ff072f3438d822e870272491768)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:36.995935 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05efddf-c3f6-4e7a-a68d-27d76d4378fd admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:37.007077 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1403/2819] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:16:36 2022] PUT /identity/v3/projects/005a3cebe7464e439030881bf02051f4/users/defebefaac954710836161646048637d/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:16:37.025970 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d1e65-608c-4502-ac1e-d1c8275b2a5e None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:37.026263 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d1e65-608c-4502-ac1e-d1c8275b2a5e None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:37.026544 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d1e65-608c-4502-ac1e-d1c8275b2a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:37.052617 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-a63d1e65-608c-4502-ac1e-d1c8275b2a5e None None] MFA Rules not processed for user `defebefaac954710836161646048637d`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:16:37.053860 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a63d1e65-608c-4502-ac1e-d1c8275b2a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:16:37.061731 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:16:37.120950 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1417/2820] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:16:37 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:16:37.132713 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05efddf-c3f6-4e7a-a68d-27d76d4378fd admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:37.134453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-b05efddf-c3f6-4e7a-a68d-27d76d4378fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:16:37.191581 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05efddf-c3f6-4e7a-a68d-27d76d4378fd admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:37.195153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23769c8-d7cf-4ecb-a28c-4f7bff01fa20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:37.195790 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23769c8-d7cf-4ecb-a28c-4f7bff01fa20 service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:37.196109 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23769c8-d7cf-4ecb-a28c-4f7bff01fa20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:37.196391 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23769c8-d7cf-4ecb-a28c-4f7bff01fa20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:37.205412 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23769c8-d7cf-4ecb-a28c-4f7bff01fa20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:37.206824 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23769c8-d7cf-4ecb-a28c-4f7bff01fa20 service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:37.216045 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1404/2821] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:16:37 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:16:38.100618 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d1e65-608c-4502-ac1e-d1c8275b2a5e None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:38.163658 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d1e65-608c-4502-ac1e-d1c8275b2a5e None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:38.168408 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce964f7d-c86e-40ce-add8-b9ece97e375f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:38.169316 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce964f7d-c86e-40ce-add8-b9ece97e375f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:38.172781 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce964f7d-c86e-40ce-add8-b9ece97e375f admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:38.172781 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce964f7d-c86e-40ce-add8-b9ece97e375f admin admin] PATH_INFO: `/v3/users/d94daf8e7d6f4e8485986f6967463d08` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:38.172781 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce964f7d-c86e-40ce-add8-b9ece97e375f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d94daf8e7d6f4e8485986f6967463d08)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:38.173258 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce964f7d-c86e-40ce-add8-b9ece97e375f admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:38.358709 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ce964f7d-c86e-40ce-add8-b9ece97e375f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd94daf8e7d6f4e8485986f6967463d08'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:38.365845 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ce964f7d-c86e-40ce-add8-b9ece97e375f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd94daf8e7d6f4e8485986f6967463d08'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:38.366507 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ce964f7d-c86e-40ce-add8-b9ece97e375f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd94daf8e7d6f4e8485986f6967463d08'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:38.367140 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ce964f7d-c86e-40ce-add8-b9ece97e375f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd94daf8e7d6f4e8485986f6967463d08'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:38.442681 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-ce964f7d-c86e-40ce-add8-b9ece97e375f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd94daf8e7d6f4e8485986f6967463d08'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:38.461216 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1418/2822] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:16:38 2022] DELETE /identity/v3/users/d94daf8e7d6f4e8485986f6967463d08 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:16:38.465805 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29967a6-7176-4d35-864b-6e8200ac2fb4 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:38.466260 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29967a6-7176-4d35-864b-6e8200ac2fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:38.466361 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29967a6-7176-4d35-864b-6e8200ac2fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:38.485190 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-a29967a6-7176-4d35-864b-6e8200ac2fb4 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:16:38.486385 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-a29967a6-7176-4d35-864b-6e8200ac2fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:16:38.544116 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1405/2823] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:16:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:16:38.554747 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce964f7d-c86e-40ce-add8-b9ece97e375f admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:38.556205 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-ce964f7d-c86e-40ce-add8-b9ece97e375f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:16:38.584595 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:16:38.622896 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce964f7d-c86e-40ce-add8-b9ece97e375f admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:38.627028 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b336c2-0c7a-4621-a474-3b7d27a8d8dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:38.627678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b336c2-0c7a-4621-a474-3b7d27a8d8dd service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:38.627993 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b336c2-0c7a-4621-a474-3b7d27a8d8dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:38.628274 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b336c2-0c7a-4621-a474-3b7d27a8d8dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:38.637267 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b336c2-0c7a-4621-a474-3b7d27a8d8dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:38.638691 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b336c2-0c7a-4621-a474-3b7d27a8d8dd service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:38.648450 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1419/2824] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:16:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:16:39.272454 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29967a6-7176-4d35-864b-6e8200ac2fb4 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:39.273995 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-a29967a6-7176-4d35-864b-6e8200ac2fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:16:39.286267 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29967a6-7176-4d35-864b-6e8200ac2fb4 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:39.291414 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa80258-f467-4716-b325-18c801d96027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:39.292325 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa80258-f467-4716-b325-18c801d96027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:39.292612 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa80258-f467-4716-b325-18c801d96027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:39.293016 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa80258-f467-4716-b325-18c801d96027 admin admin] PATH_INFO: `/v3/projects/182dfc3847a8407f85cd77d06131b22a` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:39.294178 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa80258-f467-4716-b325-18c801d96027 admin admin] RBAC: Authorizing `identity:delete_project(project_id=182dfc3847a8407f85cd77d06131b22a)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:39.296195 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa80258-f467-4716-b325-18c801d96027 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:39.358316 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:16:39.374615 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-2fa80258-f467-4716-b325-18c801d96027 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '182dfc3847a8407f85cd77d06131b22a', 'request_id': 'req-2fa80258-f467-4716-b325-18c801d96027'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:39.381354 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-2fa80258-f467-4716-b325-18c801d96027 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '182dfc3847a8407f85cd77d06131b22a', 'request_id': 'req-2fa80258-f467-4716-b325-18c801d96027'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:39.386998 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-2fa80258-f467-4716-b325-18c801d96027 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '182dfc3847a8407f85cd77d06131b22a', 'request_id': 'req-2fa80258-f467-4716-b325-18c801d96027'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:39.441074 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-2fa80258-f467-4716-b325-18c801d96027 admin admin] The token cache is being invalidate because project 182dfc3847a8407f85cd77d06131b22a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:16:39.441479 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-2fa80258-f467-4716-b325-18c801d96027 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:39.442106 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-2fa80258-f467-4716-b325-18c801d96027 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:39.443651 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1406/2825] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:16:39 2022] DELETE /identity/v3/projects/182dfc3847a8407f85cd77d06131b22a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:16:39.447656 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b336c2-0c7a-4621-a474-3b7d27a8d8dd service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:39.458430 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b336c2-0c7a-4621-a474-3b7d27a8d8dd service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:39.515523 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0627c19-03b2-49d3-874e-22d2d552a7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:39.516435 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0627c19-03b2-49d3-874e-22d2d552a7ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:39.517215 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0627c19-03b2-49d3-874e-22d2d552a7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:39.517504 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0627c19-03b2-49d3-874e-22d2d552a7ee admin admin] PATH_INFO: `/v3/users/defebefaac954710836161646048637d` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:39.518746 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0627c19-03b2-49d3-874e-22d2d552a7ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=defebefaac954710836161646048637d)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:39.520730 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0627c19-03b2-49d3-874e-22d2d552a7ee admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:39.669200 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a0627c19-03b2-49d3-874e-22d2d552a7ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'defebefaac954710836161646048637d'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:39.676501 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a0627c19-03b2-49d3-874e-22d2d552a7ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'defebefaac954710836161646048637d'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:39.679452 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a0627c19-03b2-49d3-874e-22d2d552a7ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'defebefaac954710836161646048637d'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:39.679452 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a0627c19-03b2-49d3-874e-22d2d552a7ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'defebefaac954710836161646048637d'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:39.853960 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-a0627c19-03b2-49d3-874e-22d2d552a7ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'defebefaac954710836161646048637d'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:39.872101 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1420/2826] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:16:39 2022] DELETE /identity/v3/users/defebefaac954710836161646048637d => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:16:40.255161 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa80258-f467-4716-b325-18c801d96027 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:40.257454 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-2fa80258-f467-4716-b325-18c801d96027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:16:40.272044 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa80258-f467-4716-b325-18c801d96027 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:40.328825 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c283c-064b-4fb4-8dff-b046d6c44e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:40.329716 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c283c-064b-4fb4-8dff-b046d6c44e09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:40.330000 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c283c-064b-4fb4-8dff-b046d6c44e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:40.330278 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c283c-064b-4fb4-8dff-b046d6c44e09 admin admin] PATH_INFO: `/v3/projects/005a3cebe7464e439030881bf02051f4` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:40.331452 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c283c-064b-4fb4-8dff-b046d6c44e09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=005a3cebe7464e439030881bf02051f4)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:40.333367 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c283c-064b-4fb4-8dff-b046d6c44e09 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:40.459447 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-5d5c283c-064b-4fb4-8dff-b046d6c44e09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '005a3cebe7464e439030881bf02051f4', 'request_id': 'req-5d5c283c-064b-4fb4-8dff-b046d6c44e09'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:40.465684 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-5d5c283c-064b-4fb4-8dff-b046d6c44e09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '005a3cebe7464e439030881bf02051f4', 'request_id': 'req-5d5c283c-064b-4fb4-8dff-b046d6c44e09'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:40.471836 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-5d5c283c-064b-4fb4-8dff-b046d6c44e09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '005a3cebe7464e439030881bf02051f4', 'request_id': 'req-5d5c283c-064b-4fb4-8dff-b046d6c44e09'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:40.544562 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-5d5c283c-064b-4fb4-8dff-b046d6c44e09 admin admin] The token cache is being invalidate because project 005a3cebe7464e439030881bf02051f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:16:40.544795 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-5d5c283c-064b-4fb4-8dff-b046d6c44e09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:40.545414 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-5d5c283c-064b-4fb4-8dff-b046d6c44e09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:40.547013 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1407/2827] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:16:40 2022] DELETE /identity/v3/projects/005a3cebe7464e439030881bf02051f4 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:16:40.552607 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1098aa-6c5e-4832-abd4-93ef37f67551 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:40.553107 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1098aa-6c5e-4832-abd4-93ef37f67551 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:40.553232 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1098aa-6c5e-4832-abd4-93ef37f67551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:40.571093 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-cf1098aa-6c5e-4832-abd4-93ef37f67551 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:16:40.572341 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-cf1098aa-6c5e-4832-abd4-93ef37f67551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:16:40.613660 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:16:40.630196 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1421/2828] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:16:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:16:40.638046 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6349b-f970-4a5b-bd67-def2181506c0 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:40.638339 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6349b-f970-4a5b-bd67-def2181506c0 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:40.638624 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6349b-f970-4a5b-bd67-def2181506c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:40.657948 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-86c6349b-f970-4a5b-bd67-def2181506c0 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:16:40.659364 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-86c6349b-f970-4a5b-bd67-def2181506c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:16:40.667524 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1408/2829] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:16:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:16:40.671772 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1098aa-6c5e-4832-abd4-93ef37f67551 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:40.682120 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1098aa-6c5e-4832-abd4-93ef37f67551 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:40.686690 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088e45a-ddf3-40d5-99d5-5c69a50415db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:40.687348 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088e45a-ddf3-40d5-99d5-5c69a50415db admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:40.687635 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088e45a-ddf3-40d5-99d5-5c69a50415db admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:40.687915 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088e45a-ddf3-40d5-99d5-5c69a50415db admin admin] PATH_INFO: `/v3/domains` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:40.688884 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8088e45a-ddf3-40d5-99d5-5c69a50415db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:16:40.689199 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8088e45a-ddf3-40d5-99d5-5c69a50415db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:40.690801 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8088e45a-ddf3-40d5-99d5-5c69a50415db admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:40.702242 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1422/2830] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:16:40.706430 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6349b-f970-4a5b-bd67-def2181506c0 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:40.715941 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6349b-f970-4a5b-bd67-def2181506c0 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:40.721154 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dcf8f4-4ab2-44e6-94b8-ae4b7a2f53f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:40.721813 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcf8f4-4ab2-44e6-94b8-ae4b7a2f53f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:40.722101 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcf8f4-4ab2-44e6-94b8-ae4b7a2f53f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:40.722378 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcf8f4-4ab2-44e6-94b8-ae4b7a2f53f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:40.723064 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dcf8f4-4ab2-44e6-94b8-ae4b7a2f53f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:40.724976 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dcf8f4-4ab2-44e6-94b8-ae4b7a2f53f8 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:40.855874 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1409/2831] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:16:40 2022] POST /identity/v3/projects => generated 389 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:16:40.860084 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088e45a-ddf3-40d5-99d5-5c69a50415db admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:40.870704 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088e45a-ddf3-40d5-99d5-5c69a50415db admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:40.927766 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9db87c-b5e0-491f-b061-37550e9eaf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:40.928477 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9db87c-b5e0-491f-b061-37550e9eaf70 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:40.928765 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9db87c-b5e0-491f-b061-37550e9eaf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:40.929046 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9db87c-b5e0-491f-b061-37550e9eaf70 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:40.929748 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9db87c-b5e0-491f-b061-37550e9eaf70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:40.931651 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9db87c-b5e0-491f-b061-37550e9eaf70 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:41.031526 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1423/2832] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:16:40 2022] POST /identity/v3/users => generated 295 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:16:41.035869 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dcf8f4-4ab2-44e6-94b8-ae4b7a2f53f8 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:41.052471 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dcf8f4-4ab2-44e6-94b8-ae4b7a2f53f8 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:41.052471 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b5a56-fbdf-4e18-bfd5-b51a8acd37a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:41.052471 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b5a56-fbdf-4e18-bfd5-b51a8acd37a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:41.052936 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b5a56-fbdf-4e18-bfd5-b51a8acd37a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:41.053221 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b5a56-fbdf-4e18-bfd5-b51a8acd37a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:41.053949 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2b5a56-fbdf-4e18-bfd5-b51a8acd37a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:41.055592 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2b5a56-fbdf-4e18-bfd5-b51a8acd37a3 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:41.066840 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1410/2833] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:16:41.070797 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9db87c-b5e0-491f-b061-37550e9eaf70 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:41.080645 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9db87c-b5e0-491f-b061-37550e9eaf70 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:41.085829 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9b46d-44ac-4e37-aa49-17f4fd226e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:41.086530 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9b46d-44ac-4e37-aa49-17f4fd226e4a admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:41.086832 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9b46d-44ac-4e37-aa49-17f4fd226e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:41.087189 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9b46d-44ac-4e37-aa49-17f4fd226e4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:41.087953 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9b46d-44ac-4e37-aa49-17f4fd226e4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:41.089567 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9b46d-44ac-4e37-aa49-17f4fd226e4a admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:41.100326 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1424/2834] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:16:41.104373 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b5a56-fbdf-4e18-bfd5-b51a8acd37a3 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:41.110737 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:16:41.115000 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b5a56-fbdf-4e18-bfd5-b51a8acd37a3 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:41.119649 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b766ca-bef6-4220-abd7-86a68d725972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:41.120559 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b766ca-bef6-4220-abd7-86a68d725972 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:41.120847 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b766ca-bef6-4220-abd7-86a68d725972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:41.121121 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b766ca-bef6-4220-abd7-86a68d725972 admin admin] PATH_INFO: `/v3/projects/6c647af5aff947cbaf77106c960b0174/users/07cde132557b4c42a0e0ffe46384bce5/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:41.135469 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b766ca-bef6-4220-abd7-86a68d725972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c647af5aff947cbaf77106c960b0174, user_id=07cde132557b4c42a0e0ffe46384bce5, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:41.138685 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b766ca-bef6-4220-abd7-86a68d725972 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:41.214162 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1411/2835] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:16:41 2022] PUT /identity/v3/projects/6c647af5aff947cbaf77106c960b0174/users/07cde132557b4c42a0e0ffe46384bce5/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:16:41.225228 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80a0e1-b4c6-4665-8980-dd0b62b3ef76 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:41.225527 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80a0e1-b4c6-4665-8980-dd0b62b3ef76 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:41.225812 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80a0e1-b4c6-4665-8980-dd0b62b3ef76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:41.252703 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-af80a0e1-b4c6-4665-8980-dd0b62b3ef76 None None] MFA Rules not processed for user `07cde132557b4c42a0e0ffe46384bce5`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:16:41.254020 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-af80a0e1-b4c6-4665-8980-dd0b62b3ef76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:16:41.317751 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1425/2836] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:16:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:16:41.322190 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b766ca-bef6-4220-abd7-86a68d725972 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:41.383879 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b766ca-bef6-4220-abd7-86a68d725972 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:41.388786 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09389c-2663-439b-84e6-25e352470b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:41.389455 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09389c-2663-439b-84e6-25e352470b4a admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:41.389750 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09389c-2663-439b-84e6-25e352470b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:41.390040 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09389c-2663-439b-84e6-25e352470b4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:41.390790 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c09389c-2663-439b-84e6-25e352470b4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:41.392749 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c09389c-2663-439b-84e6-25e352470b4a admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:41.454932 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1412/2837] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:16:41 2022] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:16:41.459099 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80a0e1-b4c6-4665-8980-dd0b62b3ef76 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:41.469954 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80a0e1-b4c6-4665-8980-dd0b62b3ef76 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:41.510446 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:16:41.526772 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7f2fd-bc87-4fce-bddb-633b7fdc0a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:41.527446 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7f2fd-bc87-4fce-bddb-633b7fdc0a46 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:41.527733 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7f2fd-bc87-4fce-bddb-633b7fdc0a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:41.528044 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7f2fd-bc87-4fce-bddb-633b7fdc0a46 admin admin] PATH_INFO: `/v3/users` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:41.528741 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7f2fd-bc87-4fce-bddb-633b7fdc0a46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:41.530640 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7f2fd-bc87-4fce-bddb-633b7fdc0a46 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:41.608398 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1426/2838] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:16:41 2022] POST /identity/v3/users => generated 300 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:16:41.612311 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09389c-2663-439b-84e6-25e352470b4a admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:41.622662 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09389c-2663-439b-84e6-25e352470b4a admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:41.627328 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd986cc9-d54c-4bb1-915a-7b87ea8dd0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:41.628239 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd986cc9-d54c-4bb1-915a-7b87ea8dd0f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:41.628638 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd986cc9-d54c-4bb1-915a-7b87ea8dd0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:41.628921 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd986cc9-d54c-4bb1-915a-7b87ea8dd0f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:41.629648 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd986cc9-d54c-4bb1-915a-7b87ea8dd0f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:41.631237 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd986cc9-d54c-4bb1-915a-7b87ea8dd0f7 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:41.641676 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1413/2839] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:16:41.646251 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7f2fd-bc87-4fce-bddb-633b7fdc0a46 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:41.656678 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7f2fd-bc87-4fce-bddb-633b7fdc0a46 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:41.661975 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3985428-4b5f-4c93-bbf8-69a6c8c81d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:41.666227 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3985428-4b5f-4c93-bbf8-69a6c8c81d38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:41.666227 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3985428-4b5f-4c93-bbf8-69a6c8c81d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:41.666227 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3985428-4b5f-4c93-bbf8-69a6c8c81d38 admin admin] PATH_INFO: `/v3/projects/6ba8cafac75a465bb39e81931c17e6fc/users/d6a43b9844844e5aa985bb6dbb2ceb00/roles/86273ff072f3438d822e870272491768` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:41.678747 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3985428-4b5f-4c93-bbf8-69a6c8c81d38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ba8cafac75a465bb39e81931c17e6fc, user_id=d6a43b9844844e5aa985bb6dbb2ceb00, role_id=86273ff072f3438d822e870272491768)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:41.681528 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3985428-4b5f-4c93-bbf8-69a6c8c81d38 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:41.745518 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1427/2840] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:16:41 2022] PUT /identity/v3/projects/6ba8cafac75a465bb39e81931c17e6fc/users/d6a43b9844844e5aa985bb6dbb2ceb00/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:16:41.749437 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd986cc9-d54c-4bb1-915a-7b87ea8dd0f7 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:41.759465 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd986cc9-d54c-4bb1-915a-7b87ea8dd0f7 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:41.815349 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffbcb64-fcc1-4820-9a1a-33b30b85da3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:41.816152 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffbcb64-fcc1-4820-9a1a-33b30b85da3d admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:41.816444 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffbcb64-fcc1-4820-9a1a-33b30b85da3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:41.816721 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffbcb64-fcc1-4820-9a1a-33b30b85da3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:41.817451 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffbcb64-fcc1-4820-9a1a-33b30b85da3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:41.819042 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffbcb64-fcc1-4820-9a1a-33b30b85da3d admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:41.828943 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1414/2841] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:16:41.833574 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3985428-4b5f-4c93-bbf8-69a6c8c81d38 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:41.843886 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3985428-4b5f-4c93-bbf8-69a6c8c81d38 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:41.849331 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800405e-fdc5-4d10-9acf-232074b350db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:41.850216 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800405e-fdc5-4d10-9acf-232074b350db admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:41.850503 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800405e-fdc5-4d10-9acf-232074b350db admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:41.850784 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800405e-fdc5-4d10-9acf-232074b350db admin admin] PATH_INFO: `/v3/projects/6ba8cafac75a465bb39e81931c17e6fc/users/d6a43b9844844e5aa985bb6dbb2ceb00/roles/86273ff072f3438d822e870272491768` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:41.852992 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8800405e-fdc5-4d10-9acf-232074b350db admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ba8cafac75a465bb39e81931c17e6fc, user_id=d6a43b9844844e5aa985bb6dbb2ceb00, role_id=86273ff072f3438d822e870272491768)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:41.855673 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8800405e-fdc5-4d10-9acf-232074b350db admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:41.866421 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1428/2842] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:16:41 2022] PUT /identity/v3/projects/6ba8cafac75a465bb39e81931c17e6fc/users/d6a43b9844844e5aa985bb6dbb2ceb00/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:16:41.927693 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233745ec-8868-4378-bbb2-df7fa1de663e None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:41.928017 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233745ec-8868-4378-bbb2-df7fa1de663e None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:41.928428 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233745ec-8868-4378-bbb2-df7fa1de663e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:41.954415 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-233745ec-8868-4378-bbb2-df7fa1de663e None None] MFA Rules not processed for user `d6a43b9844844e5aa985bb6dbb2ceb00`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:16:41.955620 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-233745ec-8868-4378-bbb2-df7fa1de663e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:16:41.996730 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:16:42.026453 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1415/2843] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:16:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:16:42.036994 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800405e-fdc5-4d10-9acf-232074b350db admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:42.038923 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-8800405e-fdc5-4d10-9acf-232074b350db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:16:42.097196 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800405e-fdc5-4d10-9acf-232074b350db admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:42.100797 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0c404-d9cd-4ea2-8c6f-e4b9a3819283 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:42.101435 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0c404-d9cd-4ea2-8c6f-e4b9a3819283 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:42.101720 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0c404-d9cd-4ea2-8c6f-e4b9a3819283 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:42.101999 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0c404-d9cd-4ea2-8c6f-e4b9a3819283 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:42.110832 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d0c404-d9cd-4ea2-8c6f-e4b9a3819283 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:42.112282 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d0c404-d9cd-4ea2-8c6f-e4b9a3819283 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:42.121604 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1429/2844] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:16:42 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:16:42.254351 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233745ec-8868-4378-bbb2-df7fa1de663e None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:42.316189 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233745ec-8868-4378-bbb2-df7fa1de663e None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:42.320745 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976c98b-79be-4295-a289-d3ea7a3a81b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:42.321622 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976c98b-79be-4295-a289-d3ea7a3a81b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:42.321911 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976c98b-79be-4295-a289-d3ea7a3a81b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:42.322193 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976c98b-79be-4295-a289-d3ea7a3a81b6 admin admin] PATH_INFO: `/v3/users/07cde132557b4c42a0e0ffe46384bce5` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:42.323412 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976c98b-79be-4295-a289-d3ea7a3a81b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07cde132557b4c42a0e0ffe46384bce5)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:42.325364 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976c98b-79be-4295-a289-d3ea7a3a81b6 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:42.467860 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-5976c98b-79be-4295-a289-d3ea7a3a81b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07cde132557b4c42a0e0ffe46384bce5'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:42.475714 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-5976c98b-79be-4295-a289-d3ea7a3a81b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07cde132557b4c42a0e0ffe46384bce5'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:42.476421 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-5976c98b-79be-4295-a289-d3ea7a3a81b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07cde132557b4c42a0e0ffe46384bce5'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:42.477023 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-5976c98b-79be-4295-a289-d3ea7a3a81b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07cde132557b4c42a0e0ffe46384bce5'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:42.532952 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-5976c98b-79be-4295-a289-d3ea7a3a81b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07cde132557b4c42a0e0ffe46384bce5'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:42.551286 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1416/2845] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:16:42 2022] DELETE /identity/v3/users/07cde132557b4c42a0e0ffe46384bce5 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:16:42.555906 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e7eae-c287-4964-aae4-de93db4204d2 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:42.556286 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e7eae-c287-4964-aae4-de93db4204d2 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:42.556574 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e7eae-c287-4964-aae4-de93db4204d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:42.573742 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-f04e7eae-c287-4964-aae4-de93db4204d2 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:16:42.575511 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-f04e7eae-c287-4964-aae4-de93db4204d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:16:42.634706 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1430/2846] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:16:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:16:42.644988 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976c98b-79be-4295-a289-d3ea7a3a81b6 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:42.646396 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-5976c98b-79be-4295-a289-d3ea7a3a81b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:16:42.703667 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976c98b-79be-4295-a289-d3ea7a3a81b6 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:42.708128 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260cf4a5-7389-4794-a2a8-494efd6570c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:42.708782 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260cf4a5-7389-4794-a2a8-494efd6570c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:42.709069 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260cf4a5-7389-4794-a2a8-494efd6570c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:42.709348 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260cf4a5-7389-4794-a2a8-494efd6570c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:42.718505 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260cf4a5-7389-4794-a2a8-494efd6570c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:42.719862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260cf4a5-7389-4794-a2a8-494efd6570c0 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:42.723924 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:16:42.729969 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1417/2847] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:16:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 21:16:43.130987 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e7eae-c287-4964-aae4-de93db4204d2 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:43.132865 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-f04e7eae-c287-4964-aae4-de93db4204d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:16:43.147169 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e7eae-c287-4964-aae4-de93db4204d2 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:43.152432 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439af13-e0f4-4608-a742-51ccd87cc92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:43.153295 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439af13-e0f4-4608-a742-51ccd87cc92a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:43.153592 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439af13-e0f4-4608-a742-51ccd87cc92a admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:43.153839 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439af13-e0f4-4608-a742-51ccd87cc92a admin admin] PATH_INFO: `/v3/projects/6c647af5aff947cbaf77106c960b0174` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:43.155233 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2439af13-e0f4-4608-a742-51ccd87cc92a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c647af5aff947cbaf77106c960b0174)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:43.162157 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2439af13-e0f4-4608-a742-51ccd87cc92a admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:43.254426 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:16:43.265953 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-2439af13-e0f4-4608-a742-51ccd87cc92a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c647af5aff947cbaf77106c960b0174', 'request_id': 'req-2439af13-e0f4-4608-a742-51ccd87cc92a'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:43.272118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-2439af13-e0f4-4608-a742-51ccd87cc92a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c647af5aff947cbaf77106c960b0174', 'request_id': 'req-2439af13-e0f4-4608-a742-51ccd87cc92a'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:43.277820 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-2439af13-e0f4-4608-a742-51ccd87cc92a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c647af5aff947cbaf77106c960b0174', 'request_id': 'req-2439af13-e0f4-4608-a742-51ccd87cc92a'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:43.344431 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-2439af13-e0f4-4608-a742-51ccd87cc92a admin admin] The token cache is being invalidate because project 6c647af5aff947cbaf77106c960b0174 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:16:43.344722 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-2439af13-e0f4-4608-a742-51ccd87cc92a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:43.345339 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-2439af13-e0f4-4608-a742-51ccd87cc92a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:43.347474 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1431/2848] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:16:43 2022] DELETE /identity/v3/projects/6c647af5aff947cbaf77106c960b0174 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:16:43.351470 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260cf4a5-7389-4794-a2a8-494efd6570c0 service neutron] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:43.361003 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260cf4a5-7389-4794-a2a8-494efd6570c0 service neutron] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:43.421871 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69bd3b-4d02-401d-b0a9-95951f007f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:43.422814 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69bd3b-4d02-401d-b0a9-95951f007f6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:43.423079 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69bd3b-4d02-401d-b0a9-95951f007f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:43.423352 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69bd3b-4d02-401d-b0a9-95951f007f6b admin admin] PATH_INFO: `/v3/users/d6a43b9844844e5aa985bb6dbb2ceb00` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:43.424567 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa69bd3b-4d02-401d-b0a9-95951f007f6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6a43b9844844e5aa985bb6dbb2ceb00)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:43.427077 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa69bd3b-4d02-401d-b0a9-95951f007f6b admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:43.587338 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-fa69bd3b-4d02-401d-b0a9-95951f007f6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6a43b9844844e5aa985bb6dbb2ceb00'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:43.594145 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-fa69bd3b-4d02-401d-b0a9-95951f007f6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6a43b9844844e5aa985bb6dbb2ceb00'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:43.594795 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-fa69bd3b-4d02-401d-b0a9-95951f007f6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6a43b9844844e5aa985bb6dbb2ceb00'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:43.595396 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-fa69bd3b-4d02-401d-b0a9-95951f007f6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6a43b9844844e5aa985bb6dbb2ceb00'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:43.683325 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-fa69bd3b-4d02-401d-b0a9-95951f007f6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6a43b9844844e5aa985bb6dbb2ceb00'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:43.702498 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1418/2849] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:16:43 2022] DELETE /identity/v3/users/d6a43b9844844e5aa985bb6dbb2ceb00 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:16:44.106263 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439af13-e0f4-4608-a742-51ccd87cc92a admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:44.107729 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-2439af13-e0f4-4608-a742-51ccd87cc92a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:16:44.121009 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439af13-e0f4-4608-a742-51ccd87cc92a admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:44.180046 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7bc49-1812-4655-9047-d0226535e80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:44.180847 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7bc49-1812-4655-9047-d0226535e80d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:44.181134 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7bc49-1812-4655-9047-d0226535e80d admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:44.181415 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7bc49-1812-4655-9047-d0226535e80d admin admin] PATH_INFO: `/v3/projects/6ba8cafac75a465bb39e81931c17e6fc` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:44.182602 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f7bc49-1812-4655-9047-d0226535e80d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ba8cafac75a465bb39e81931c17e6fc)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:44.184636 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f7bc49-1812-4655-9047-d0226535e80d admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:44.294209 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b2f7bc49-1812-4655-9047-d0226535e80d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ba8cafac75a465bb39e81931c17e6fc', 'request_id': 'req-b2f7bc49-1812-4655-9047-d0226535e80d'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:44.302068 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b2f7bc49-1812-4655-9047-d0226535e80d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ba8cafac75a465bb39e81931c17e6fc', 'request_id': 'req-b2f7bc49-1812-4655-9047-d0226535e80d'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:44.307651 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b2f7bc49-1812-4655-9047-d0226535e80d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ba8cafac75a465bb39e81931c17e6fc', 'request_id': 'req-b2f7bc49-1812-4655-9047-d0226535e80d'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:44.390668 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b2f7bc49-1812-4655-9047-d0226535e80d admin admin] The token cache is being invalidate because project 6ba8cafac75a465bb39e81931c17e6fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:16:44.390889 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b2f7bc49-1812-4655-9047-d0226535e80d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:44.391504 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b2f7bc49-1812-4655-9047-d0226535e80d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:44.393081 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1432/2850] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:16:44 2022] DELETE /identity/v3/projects/6ba8cafac75a465bb39e81931c17e6fc => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 21:16:44.398575 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17e04c-aa85-418c-ab12-3abd4083486f None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:44.401512 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17e04c-aa85-418c-ab12-3abd4083486f None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:44.401512 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17e04c-aa85-418c-ab12-3abd4083486f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:44.417222 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-cf17e04c-aa85-418c-ab12-3abd4083486f None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:16:44.418520 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-cf17e04c-aa85-418c-ab12-3abd4083486f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:16:44.476592 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1419/2851] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:16:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:16:44.484210 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bb14e-bce9-4691-bdcc-9504bd74e74f None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:44.484506 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bb14e-bce9-4691-bdcc-9504bd74e74f None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:44.484789 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bb14e-bce9-4691-bdcc-9504bd74e74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:44.503797 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-606bb14e-bce9-4691-bdcc-9504bd74e74f None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:16:44.505079 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-606bb14e-bce9-4691-bdcc-9504bd74e74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:16:44.512854 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1433/2852] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:16:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:16:44.516787 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17e04c-aa85-418c-ab12-3abd4083486f None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:44.526719 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17e04c-aa85-418c-ab12-3abd4083486f None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:44.531274 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea0dcb6-0abb-4f35-a7da-9e9e8f776620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:44.531929 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0dcb6-0abb-4f35-a7da-9e9e8f776620 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:44.532258 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0dcb6-0abb-4f35-a7da-9e9e8f776620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:44.532540 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0dcb6-0abb-4f35-a7da-9e9e8f776620 admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:44.533264 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea0dcb6-0abb-4f35-a7da-9e9e8f776620 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:16:44.533581 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea0dcb6-0abb-4f35-a7da-9e9e8f776620 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:44.535280 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea0dcb6-0abb-4f35-a7da-9e9e8f776620 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:44.546739 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1420/2853] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:16:44.551210 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606bb14e-bce9-4691-bdcc-9504bd74e74f None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:44.560586 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606bb14e-bce9-4691-bdcc-9504bd74e74f None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:44.565137 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b856472-63bf-4872-b7e3-d76c044c148d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:44.566395 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b856472-63bf-4872-b7e3-d76c044c148d admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:44.570136 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b856472-63bf-4872-b7e3-d76c044c148d admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:44.570136 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b856472-63bf-4872-b7e3-d76c044c148d admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:44.570136 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b856472-63bf-4872-b7e3-d76c044c148d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:44.570136 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b856472-63bf-4872-b7e3-d76c044c148d admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:44.644327 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1434/2854] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:16:44 2022] POST /identity/v3/projects => generated 371 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 21:16:44.648367 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea0dcb6-0abb-4f35-a7da-9e9e8f776620 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:44.654888 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:16:44.658798 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea0dcb6-0abb-4f35-a7da-9e9e8f776620 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:44.714458 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e360f42-852b-418a-b2b8-2ce56497a942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:44.715140 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e360f42-852b-418a-b2b8-2ce56497a942 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:44.715428 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e360f42-852b-418a-b2b8-2ce56497a942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:44.715706 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e360f42-852b-418a-b2b8-2ce56497a942 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:44.716422 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e360f42-852b-418a-b2b8-2ce56497a942 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:44.718300 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e360f42-852b-418a-b2b8-2ce56497a942 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:44.814910 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1421/2855] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:16:44 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:16:44.819548 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b856472-63bf-4872-b7e3-d76c044c148d admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:44.830788 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b856472-63bf-4872-b7e3-d76c044c148d admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:44.835619 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10bf78-92e7-4cc8-b432-333397dc5289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:44.836355 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10bf78-92e7-4cc8-b432-333397dc5289 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:44.836645 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10bf78-92e7-4cc8-b432-333397dc5289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:44.836927 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10bf78-92e7-4cc8-b432-333397dc5289 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:44.837662 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d10bf78-92e7-4cc8-b432-333397dc5289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:44.839259 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d10bf78-92e7-4cc8-b432-333397dc5289 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:44.850403 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1435/2856] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:16:44.855121 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e360f42-852b-418a-b2b8-2ce56497a942 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:44.865806 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e360f42-852b-418a-b2b8-2ce56497a942 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:44.870398 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a66a3-36ea-4055-b082-03c473b0e9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:44.871057 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a66a3-36ea-4055-b082-03c473b0e9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:44.871349 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a66a3-36ea-4055-b082-03c473b0e9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:44.871632 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a66a3-36ea-4055-b082-03c473b0e9f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:44.872392 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a66a3-36ea-4055-b082-03c473b0e9f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:44.873975 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a66a3-36ea-4055-b082-03c473b0e9f1 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:44.883897 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1422/2857] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:16:44.887903 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10bf78-92e7-4cc8-b432-333397dc5289 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:44.897904 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10bf78-92e7-4cc8-b432-333397dc5289 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:44.902899 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a62736-a1b2-4cba-9baa-b5ddcd5c261c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:44.903789 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a62736-a1b2-4cba-9baa-b5ddcd5c261c admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:44.904108 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a62736-a1b2-4cba-9baa-b5ddcd5c261c admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:44.904393 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a62736-a1b2-4cba-9baa-b5ddcd5c261c admin admin] PATH_INFO: `/v3/projects/2ee572fa5aaf4b0da52af6f4c7bf6bfd/users/85099bb9bd304f02a10580024dda15f4/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:44.912974 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:16:44.919436 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a62736-a1b2-4cba-9baa-b5ddcd5c261c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ee572fa5aaf4b0da52af6f4c7bf6bfd, user_id=85099bb9bd304f02a10580024dda15f4, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:44.922091 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a62736-a1b2-4cba-9baa-b5ddcd5c261c admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:44.996768 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1436/2858] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:16:44 2022] PUT /identity/v3/projects/2ee572fa5aaf4b0da52af6f4c7bf6bfd/users/85099bb9bd304f02a10580024dda15f4/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:16:45.007192 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352eb7df-3e89-4aa5-87f7-d4b147490e83 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:45.007490 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352eb7df-3e89-4aa5-87f7-d4b147490e83 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:45.007774 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352eb7df-3e89-4aa5-87f7-d4b147490e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:45.034635 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-352eb7df-3e89-4aa5-87f7-d4b147490e83 None None] MFA Rules not processed for user `85099bb9bd304f02a10580024dda15f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:16:45.035951 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-352eb7df-3e89-4aa5-87f7-d4b147490e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:16:45.097972 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1423/2859] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:16:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:16:45.109656 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a62736-a1b2-4cba-9baa-b5ddcd5c261c admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:45.111362 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-33a62736-a1b2-4cba-9baa-b5ddcd5c261c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:16:45.167210 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a62736-a1b2-4cba-9baa-b5ddcd5c261c admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:45.170762 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9419c6a-e2fa-442c-b9c4-2afdede4aff4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:45.171403 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9419c6a-e2fa-442c-b9c4-2afdede4aff4 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:45.171688 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9419c6a-e2fa-442c-b9c4-2afdede4aff4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:45.171989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9419c6a-e2fa-442c-b9c4-2afdede4aff4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:45.181095 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9419c6a-e2fa-442c-b9c4-2afdede4aff4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:45.182530 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9419c6a-e2fa-442c-b9c4-2afdede4aff4 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:45.191771 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1437/2860] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:16:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:16:45.210984 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352eb7df-3e89-4aa5-87f7-d4b147490e83 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:45.272770 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352eb7df-3e89-4aa5-87f7-d4b147490e83 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:45.277627 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ac47f-93d4-45a9-ac52-7927954acb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:45.278494 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ac47f-93d4-45a9-ac52-7927954acb54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:45.278784 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ac47f-93d4-45a9-ac52-7927954acb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:45.279072 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ac47f-93d4-45a9-ac52-7927954acb54 admin admin] PATH_INFO: `/v3/users/85099bb9bd304f02a10580024dda15f4` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:45.280300 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ac47f-93d4-45a9-ac52-7927954acb54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85099bb9bd304f02a10580024dda15f4)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:45.282204 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ac47f-93d4-45a9-ac52-7927954acb54 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:45.295936 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:16:45.467819 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-af0ac47f-93d4-45a9-ac52-7927954acb54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85099bb9bd304f02a10580024dda15f4'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:45.475608 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-af0ac47f-93d4-45a9-ac52-7927954acb54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85099bb9bd304f02a10580024dda15f4'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:45.476309 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-af0ac47f-93d4-45a9-ac52-7927954acb54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85099bb9bd304f02a10580024dda15f4'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:45.476937 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-af0ac47f-93d4-45a9-ac52-7927954acb54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85099bb9bd304f02a10580024dda15f4'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:45.539904 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-af0ac47f-93d4-45a9-ac52-7927954acb54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85099bb9bd304f02a10580024dda15f4'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:45.557719 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1424/2861] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:16:45 2022] DELETE /identity/v3/users/85099bb9bd304f02a10580024dda15f4 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:16:45.562433 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad615f-35e2-4a0a-bb60-51f677f5aee4 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:45.562740 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad615f-35e2-4a0a-bb60-51f677f5aee4 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:45.563028 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad615f-35e2-4a0a-bb60-51f677f5aee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:45.581428 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-01ad615f-35e2-4a0a-bb60-51f677f5aee4 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:16:45.582682 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-01ad615f-35e2-4a0a-bb60-51f677f5aee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:16:45.642387 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1438/2862] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:16:45.653157 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ac47f-93d4-45a9-ac52-7927954acb54 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:45.654707 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-af0ac47f-93d4-45a9-ac52-7927954acb54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:16:45.714262 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ac47f-93d4-45a9-ac52-7927954acb54 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:45.718190 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527b995-23fb-4916-b901-e1dbeb8cdb05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:45.718790 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527b995-23fb-4916-b901-e1dbeb8cdb05 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:45.719080 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527b995-23fb-4916-b901-e1dbeb8cdb05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:45.719362 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527b995-23fb-4916-b901-e1dbeb8cdb05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:45.728832 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527b995-23fb-4916-b901-e1dbeb8cdb05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:45.730305 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527b995-23fb-4916-b901-e1dbeb8cdb05 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:45.739733 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1425/2863] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:16:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:16:46.141491 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad615f-35e2-4a0a-bb60-51f677f5aee4 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:46.143125 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-01ad615f-35e2-4a0a-bb60-51f677f5aee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:16:46.156952 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad615f-35e2-4a0a-bb60-51f677f5aee4 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:46.162792 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00139864-43b1-4eaa-b670-6c294160ac30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:46.163668 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00139864-43b1-4eaa-b670-6c294160ac30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:46.163955 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00139864-43b1-4eaa-b670-6c294160ac30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:46.164326 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00139864-43b1-4eaa-b670-6c294160ac30 admin admin] PATH_INFO: `/v3/projects/2ee572fa5aaf4b0da52af6f4c7bf6bfd` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:46.165516 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00139864-43b1-4eaa-b670-6c294160ac30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ee572fa5aaf4b0da52af6f4c7bf6bfd)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:46.167539 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00139864-43b1-4eaa-b670-6c294160ac30 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:46.271016 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-00139864-43b1-4eaa-b670-6c294160ac30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ee572fa5aaf4b0da52af6f4c7bf6bfd', 'request_id': 'req-00139864-43b1-4eaa-b670-6c294160ac30'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:46.277209 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-00139864-43b1-4eaa-b670-6c294160ac30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ee572fa5aaf4b0da52af6f4c7bf6bfd', 'request_id': 'req-00139864-43b1-4eaa-b670-6c294160ac30'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:46.282841 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-00139864-43b1-4eaa-b670-6c294160ac30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ee572fa5aaf4b0da52af6f4c7bf6bfd', 'request_id': 'req-00139864-43b1-4eaa-b670-6c294160ac30'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:46.355244 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-00139864-43b1-4eaa-b670-6c294160ac30 admin admin] The token cache is being invalidate because project 2ee572fa5aaf4b0da52af6f4c7bf6bfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:16:46.355538 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-00139864-43b1-4eaa-b670-6c294160ac30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:46.356247 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-00139864-43b1-4eaa-b670-6c294160ac30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:16:46.359813 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1439/2864] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:16:46 2022] DELETE /identity/v3/projects/2ee572fa5aaf4b0da52af6f4c7bf6bfd => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:16:46.362841 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d458481-266a-4fb4-98fd-c50718deb6a4 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:46.363127 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d458481-266a-4fb4-98fd-c50718deb6a4 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:46.363438 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d458481-266a-4fb4-98fd-c50718deb6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:46.381153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-1d458481-266a-4fb4-98fd-c50718deb6a4 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:16:46.382393 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-1d458481-266a-4fb4-98fd-c50718deb6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:16:46.443547 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1426/2865] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:16:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:16:46.452477 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2846c-dcb2-48d3-9d5f-b836897364d3 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:46.452898 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2846c-dcb2-48d3-9d5f-b836897364d3 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:46.453204 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2846c-dcb2-48d3-9d5f-b836897364d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:46.472549 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-19c2846c-dcb2-48d3-9d5f-b836897364d3 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:16:46.473761 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-19c2846c-dcb2-48d3-9d5f-b836897364d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:16:46.481772 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1440/2866] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:16:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:16:46.485897 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d458481-266a-4fb4-98fd-c50718deb6a4 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:46.495648 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d458481-266a-4fb4-98fd-c50718deb6a4 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:46.500243 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c0200-2cd9-42ea-af04-91772d928636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:46.500901 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c0200-2cd9-42ea-af04-91772d928636 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:46.501198 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c0200-2cd9-42ea-af04-91772d928636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:46.501481 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c0200-2cd9-42ea-af04-91772d928636 admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:46.502205 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4c0200-2cd9-42ea-af04-91772d928636 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:16:46.502522 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4c0200-2cd9-42ea-af04-91772d928636 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:46.504782 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4c0200-2cd9-42ea-af04-91772d928636 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:46.515952 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1427/2867] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:16:46.520610 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2846c-dcb2-48d3-9d5f-b836897364d3 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:46.530074 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2846c-dcb2-48d3-9d5f-b836897364d3 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:46.534855 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c853819-8451-420f-bd40-7947a7ccbd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:46.535501 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c853819-8451-420f-bd40-7947a7ccbd57 admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:46.535785 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c853819-8451-420f-bd40-7947a7ccbd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:46.536100 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c853819-8451-420f-bd40-7947a7ccbd57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:46.536824 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c853819-8451-420f-bd40-7947a7ccbd57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:46.538699 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c853819-8451-420f-bd40-7947a7ccbd57 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:46.541870 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:16:46.626585 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1441/2868] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:16:46 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:16:46.631584 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c0200-2cd9-42ea-af04-91772d928636 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:46.641583 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c0200-2cd9-42ea-af04-91772d928636 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:46.661525 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:16:46.698656 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ae4de-7e1d-4664-b5fd-3fb8eecfa641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:46.699338 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ae4de-7e1d-4664-b5fd-3fb8eecfa641 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:46.699626 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ae4de-7e1d-4664-b5fd-3fb8eecfa641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:46.699910 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ae4de-7e1d-4664-b5fd-3fb8eecfa641 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:46.700643 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ae4de-7e1d-4664-b5fd-3fb8eecfa641 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:46.702536 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ae4de-7e1d-4664-b5fd-3fb8eecfa641 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:46.791358 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1428/2869] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:16:46 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:16:46.795350 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c853819-8451-420f-bd40-7947a7ccbd57 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:46.806654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c853819-8451-420f-bd40-7947a7ccbd57 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:46.811255 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa96c4-2fed-4f68-9126-d2cb67d20599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:46.811923 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa96c4-2fed-4f68-9126-d2cb67d20599 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:46.812252 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa96c4-2fed-4f68-9126-d2cb67d20599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:46.812537 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa96c4-2fed-4f68-9126-d2cb67d20599 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:46.813279 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa96c4-2fed-4f68-9126-d2cb67d20599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:46.814876 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa96c4-2fed-4f68-9126-d2cb67d20599 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:46.825760 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1442/2870] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:16:46.829704 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ae4de-7e1d-4664-b5fd-3fb8eecfa641 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:46.841850 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ae4de-7e1d-4664-b5fd-3fb8eecfa641 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:46.847289 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7968305f-8b54-47f1-901c-9d27ab12be86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:46.853302 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968305f-8b54-47f1-901c-9d27ab12be86 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:46.853302 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968305f-8b54-47f1-901c-9d27ab12be86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:46.853302 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968305f-8b54-47f1-901c-9d27ab12be86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:46.853302 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7968305f-8b54-47f1-901c-9d27ab12be86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:46.853302 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7968305f-8b54-47f1-901c-9d27ab12be86 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:46.861475 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1429/2871] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:16:46.866071 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa96c4-2fed-4f68-9126-d2cb67d20599 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:46.876126 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa96c4-2fed-4f68-9126-d2cb67d20599 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:46.882293 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13857ef-cae2-4258-aa5a-7b3ab08ffa63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:46.883175 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13857ef-cae2-4258-aa5a-7b3ab08ffa63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:46.883462 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13857ef-cae2-4258-aa5a-7b3ab08ffa63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:46.883738 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13857ef-cae2-4258-aa5a-7b3ab08ffa63 admin admin] PATH_INFO: `/v3/projects/da2b6fc9b79f4c8db73a2d3e2600ee51/users/6c8926b55c6d4bc79609a95d2cb2cdef/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:46.898454 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13857ef-cae2-4258-aa5a-7b3ab08ffa63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da2b6fc9b79f4c8db73a2d3e2600ee51, user_id=6c8926b55c6d4bc79609a95d2cb2cdef, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:46.901467 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13857ef-cae2-4258-aa5a-7b3ab08ffa63 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:46.980265 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1443/2872] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:16:46 2022] PUT /identity/v3/projects/da2b6fc9b79f4c8db73a2d3e2600ee51/users/6c8926b55c6d4bc79609a95d2cb2cdef/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:16:46.991026 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840833f2-ad88-440f-9752-7836dfc57c23 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:46.991319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840833f2-ad88-440f-9752-7836dfc57c23 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:46.991597 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840833f2-ad88-440f-9752-7836dfc57c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:47.019276 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-840833f2-ad88-440f-9752-7836dfc57c23 None None] MFA Rules not processed for user `6c8926b55c6d4bc79609a95d2cb2cdef`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:16:47.020678 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-840833f2-ad88-440f-9752-7836dfc57c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:16:47.085842 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1430/2873] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:16:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:16:47.097650 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13857ef-cae2-4258-aa5a-7b3ab08ffa63 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:16:47.099514 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-e13857ef-cae2-4258-aa5a-7b3ab08ffa63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:16:47.156399 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13857ef-cae2-4258-aa5a-7b3ab08ffa63 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:16:47.160810 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a932482-1c91-4a0c-b949-b452580bace3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:16:47.161470 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a932482-1c91-4a0c-b949-b452580bace3 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:16:47.161763 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a932482-1c91-4a0c-b949-b452580bace3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:16:47.162048 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a932482-1c91-4a0c-b949-b452580bace3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:16:47.170382 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a932482-1c91-4a0c-b949-b452580bace3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:16:47.171812 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a932482-1c91-4a0c-b949-b452580bace3 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:16:47.181390 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1444/2874] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:16:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:16:57.082942 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=56,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:16:57.178009 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=47,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:17:00.622814 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840833f2-ad88-440f-9752-7836dfc57c23 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:17:00.685730 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840833f2-ad88-440f-9752-7836dfc57c23 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:17:00.690435 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db199ac1-cc41-4c7d-813d-565212f2dfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:17:00.691348 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db199ac1-cc41-4c7d-813d-565212f2dfc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:17:00.691647 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db199ac1-cc41-4c7d-813d-565212f2dfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:17:00.691920 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db199ac1-cc41-4c7d-813d-565212f2dfc6 admin admin] PATH_INFO: `/v3/users/6c8926b55c6d4bc79609a95d2cb2cdef` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:17:00.693316 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db199ac1-cc41-4c7d-813d-565212f2dfc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c8926b55c6d4bc79609a95d2cb2cdef)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:17:00.695301 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db199ac1-cc41-4c7d-813d-565212f2dfc6 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:17:00.924781 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-db199ac1-cc41-4c7d-813d-565212f2dfc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c8926b55c6d4bc79609a95d2cb2cdef'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:17:00.931809 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-db199ac1-cc41-4c7d-813d-565212f2dfc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c8926b55c6d4bc79609a95d2cb2cdef'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:17:00.932507 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-db199ac1-cc41-4c7d-813d-565212f2dfc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c8926b55c6d4bc79609a95d2cb2cdef'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:17:00.933111 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-db199ac1-cc41-4c7d-813d-565212f2dfc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c8926b55c6d4bc79609a95d2cb2cdef'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:17:01.014006 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-db199ac1-cc41-4c7d-813d-565212f2dfc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c8926b55c6d4bc79609a95d2cb2cdef'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:17:01.032434 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1431/2875] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:17:00 2022] DELETE /identity/v3/users/6c8926b55c6d4bc79609a95d2cb2cdef => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:17:01.036963 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92107f10-f223-4d7c-9185-8230c4668020 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:17:01.037444 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92107f10-f223-4d7c-9185-8230c4668020 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:17:01.037552 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92107f10-f223-4d7c-9185-8230c4668020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:17:01.054906 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-92107f10-f223-4d7c-9185-8230c4668020 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:17:01.056122 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-92107f10-f223-4d7c-9185-8230c4668020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:17:01.112983 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1445/2876] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:17:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:17:01.123060 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db199ac1-cc41-4c7d-813d-565212f2dfc6 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:17:01.124512 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-db199ac1-cc41-4c7d-813d-565212f2dfc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:17:01.182838 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db199ac1-cc41-4c7d-813d-565212f2dfc6 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:17:01.186536 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92e1a4-6374-474e-9146-2018346ed826 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:17:01.187191 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92e1a4-6374-474e-9146-2018346ed826 service neutron] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:17:01.187481 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92e1a4-6374-474e-9146-2018346ed826 service neutron] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:17:01.187761 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92e1a4-6374-474e-9146-2018346ed826 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:17:01.197655 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a92e1a4-6374-474e-9146-2018346ed826 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:17:01.199130 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a92e1a4-6374-474e-9146-2018346ed826 service neutron] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:17:01.208961 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1432/2877] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:17:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 21:17:01.570028 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92107f10-f223-4d7c-9185-8230c4668020 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:17:01.571468 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-92107f10-f223-4d7c-9185-8230c4668020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:17:01.583628 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92107f10-f223-4d7c-9185-8230c4668020 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:17:01.589578 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c002b1-dbd8-41f3-9feb-bfec92115ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:17:01.590756 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c002b1-dbd8-41f3-9feb-bfec92115ebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:17:01.591043 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c002b1-dbd8-41f3-9feb-bfec92115ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:17:01.591320 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c002b1-dbd8-41f3-9feb-bfec92115ebf admin admin] PATH_INFO: `/v3/projects/da2b6fc9b79f4c8db73a2d3e2600ee51` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:17:01.593122 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c002b1-dbd8-41f3-9feb-bfec92115ebf admin admin] RBAC: Authorizing `identity:delete_project(project_id=da2b6fc9b79f4c8db73a2d3e2600ee51)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:17:01.595634 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c002b1-dbd8-41f3-9feb-bfec92115ebf admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:17:01.723605 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b3c002b1-dbd8-41f3-9feb-bfec92115ebf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da2b6fc9b79f4c8db73a2d3e2600ee51', 'request_id': 'req-b3c002b1-dbd8-41f3-9feb-bfec92115ebf'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:17:01.730587 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b3c002b1-dbd8-41f3-9feb-bfec92115ebf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da2b6fc9b79f4c8db73a2d3e2600ee51', 'request_id': 'req-b3c002b1-dbd8-41f3-9feb-bfec92115ebf'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:17:01.736242 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b3c002b1-dbd8-41f3-9feb-bfec92115ebf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da2b6fc9b79f4c8db73a2d3e2600ee51', 'request_id': 'req-b3c002b1-dbd8-41f3-9feb-bfec92115ebf'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:17:01.801560 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b3c002b1-dbd8-41f3-9feb-bfec92115ebf admin admin] The token cache is being invalidate because project da2b6fc9b79f4c8db73a2d3e2600ee51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:17:01.801854 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b3c002b1-dbd8-41f3-9feb-bfec92115ebf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:17:01.802535 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-b3c002b1-dbd8-41f3-9feb-bfec92115ebf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:17:01.804116 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1446/2878] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:17:01 2022] DELETE /identity/v3/projects/da2b6fc9b79f4c8db73a2d3e2600ee51 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:17:01.815828 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5259cc-d3cb-4be3-8897-9e7e067c28b0 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:17:01.816331 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5259cc-d3cb-4be3-8897-9e7e067c28b0 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:17:01.816433 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5259cc-d3cb-4be3-8897-9e7e067c28b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:17:01.833570 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-da5259cc-d3cb-4be3-8897-9e7e067c28b0 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:17:01.835287 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-da5259cc-d3cb-4be3-8897-9e7e067c28b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:17:01.852545 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:17:01.894404 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1433/2879] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:17:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:17:01.902900 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ecd86-886c-4a0a-9ea7-e3152bc10fe8 None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:17:01.903193 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ecd86-886c-4a0a-9ea7-e3152bc10fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:17:01.903473 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ecd86-886c-4a0a-9ea7-e3152bc10fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:17:01.922224 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-a99ecd86-886c-4a0a-9ea7-e3152bc10fe8 None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:17:01.923423 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-a99ecd86-886c-4a0a-9ea7-e3152bc10fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:17:01.931413 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1447/2880] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:17:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:17:01.935804 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5259cc-d3cb-4be3-8897-9e7e067c28b0 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:17:01.945662 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5259cc-d3cb-4be3-8897-9e7e067c28b0 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:17:01.950261 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9cc79f-734e-400e-b9a3-04da8c39f6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:17:01.951145 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9cc79f-734e-400e-b9a3-04da8c39f6f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:17:01.951613 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9cc79f-734e-400e-b9a3-04da8c39f6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:17:01.952281 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9cc79f-734e-400e-b9a3-04da8c39f6f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:17:01.953011 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9cc79f-734e-400e-b9a3-04da8c39f6f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 21:17:01.953327 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9cc79f-734e-400e-b9a3-04da8c39f6f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:17:01.954948 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9cc79f-734e-400e-b9a3-04da8c39f6f9 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:17:01.966912 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1434/2881] 10.222.0.40 () {58 vars in 1152 bytes} [Mon Jul 11 21:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 21:17:01.970812 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ecd86-886c-4a0a-9ea7-e3152bc10fe8 None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:17:01.980551 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ecd86-886c-4a0a-9ea7-e3152bc10fe8 None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:17:01.985138 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1deffe9-1758-4c59-b38d-70de2b7a0c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:17:01.985787 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1deffe9-1758-4c59-b38d-70de2b7a0c4b admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:17:01.986075 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1deffe9-1758-4c59-b38d-70de2b7a0c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:17:01.986354 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1deffe9-1758-4c59-b38d-70de2b7a0c4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:17:01.987031 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1deffe9-1758-4c59-b38d-70de2b7a0c4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:17:01.988956 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1deffe9-1758-4c59-b38d-70de2b7a0c4b admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:17:02.094993 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1448/2882] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:17:01 2022] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:17:02.099055 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9cc79f-734e-400e-b9a3-04da8c39f6f9 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:17:02.109153 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9cc79f-734e-400e-b9a3-04da8c39f6f9 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:17:02.166377 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076909ff-24e0-4f60-b86f-9dcb8b8410a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:17:02.167055 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076909ff-24e0-4f60-b86f-9dcb8b8410a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:17:02.167344 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076909ff-24e0-4f60-b86f-9dcb8b8410a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:17:02.167624 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076909ff-24e0-4f60-b86f-9dcb8b8410a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:17:02.168358 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076909ff-24e0-4f60-b86f-9dcb8b8410a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:17:02.170257 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076909ff-24e0-4f60-b86f-9dcb8b8410a2 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:17:02.231100 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1435/2883] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:17:02 2022] POST /identity/v3/users => generated 289 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:17:02.236561 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1deffe9-1758-4c59-b38d-70de2b7a0c4b admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:17:02.247027 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1deffe9-1758-4c59-b38d-70de2b7a0c4b admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:17:02.251560 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed985bf3-93e2-4e13-84a7-dd280e0a409a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:17:02.252245 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed985bf3-93e2-4e13-84a7-dd280e0a409a admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:17:02.252535 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed985bf3-93e2-4e13-84a7-dd280e0a409a admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:17:02.252816 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed985bf3-93e2-4e13-84a7-dd280e0a409a admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:17:02.253546 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed985bf3-93e2-4e13-84a7-dd280e0a409a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:17:02.255157 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed985bf3-93e2-4e13-84a7-dd280e0a409a admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:17:02.266027 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1449/2884] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:17:02.269794 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076909ff-24e0-4f60-b86f-9dcb8b8410a2 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:17:02.280491 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076909ff-24e0-4f60-b86f-9dcb8b8410a2 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:17:02.285043 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436076a5-25a5-4203-8793-239e16af9554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:17:02.285720 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436076a5-25a5-4203-8793-239e16af9554 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:17:02.286007 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436076a5-25a5-4203-8793-239e16af9554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:17:02.286287 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436076a5-25a5-4203-8793-239e16af9554 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:17:02.287005 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436076a5-25a5-4203-8793-239e16af9554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:17:02.288680 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436076a5-25a5-4203-8793-239e16af9554 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:17:02.298434 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1436/2885] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:17:02.302291 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed985bf3-93e2-4e13-84a7-dd280e0a409a admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:17:02.312365 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed985bf3-93e2-4e13-84a7-dd280e0a409a admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:17:02.316929 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80deea3c-08df-45a9-aea1-b10c35dfec9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:17:02.317800 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80deea3c-08df-45a9-aea1-b10c35dfec9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:17:02.318598 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80deea3c-08df-45a9-aea1-b10c35dfec9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:17:02.318880 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80deea3c-08df-45a9-aea1-b10c35dfec9d admin admin] PATH_INFO: `/v3/projects/5469d8b29a0b4a63bf1431cffa9034a6/users/8fea3e5ee7ef4dd8b1c5312b2b69a160/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:17:02.333315 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80deea3c-08df-45a9-aea1-b10c35dfec9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5469d8b29a0b4a63bf1431cffa9034a6, user_id=8fea3e5ee7ef4dd8b1c5312b2b69a160, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:17:02.336652 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80deea3c-08df-45a9-aea1-b10c35dfec9d admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:17:02.403229 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1450/2886] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:17:02 2022] PUT /identity/v3/projects/5469d8b29a0b4a63bf1431cffa9034a6/users/8fea3e5ee7ef4dd8b1c5312b2b69a160/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:17:02.413323 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88753c-040b-4fd1-a964-d9d9326b3114 None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:17:02.413620 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88753c-040b-4fd1-a964-d9d9326b3114 None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:17:02.413910 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88753c-040b-4fd1-a964-d9d9326b3114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:17:02.440481 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-af88753c-040b-4fd1-a964-d9d9326b3114 None None] MFA Rules not processed for user `8fea3e5ee7ef4dd8b1c5312b2b69a160`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:17:02.441690 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-af88753c-040b-4fd1-a964-d9d9326b3114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:17:02.506704 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1437/2887] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:17:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:17:02.511106 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80deea3c-08df-45a9-aea1-b10c35dfec9d admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:17:02.531918 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:17:02.572965 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80deea3c-08df-45a9-aea1-b10c35dfec9d admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:17:02.577719 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34275cc-53be-405e-941c-e2b2461c5c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:17:02.578528 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34275cc-53be-405e-941c-e2b2461c5c1d admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:17:02.578744 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34275cc-53be-405e-941c-e2b2461c5c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:17:02.579029 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34275cc-53be-405e-941c-e2b2461c5c1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:17:02.579728 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34275cc-53be-405e-941c-e2b2461c5c1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:17:02.581776 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34275cc-53be-405e-941c-e2b2461c5c1d admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:17:02.655820 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1451/2888] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:17:02 2022] POST /identity/v3/projects => generated 375 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:17:02.659919 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88753c-040b-4fd1-a964-d9d9326b3114 None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:17:02.671225 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88753c-040b-4fd1-a964-d9d9326b3114 None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:17:02.684576 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:17:02.729194 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca6f13-0ac7-476d-ae20-37209f1f893f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:17:02.729982 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca6f13-0ac7-476d-ae20-37209f1f893f admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:17:02.730292 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca6f13-0ac7-476d-ae20-37209f1f893f admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:17:02.730570 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca6f13-0ac7-476d-ae20-37209f1f893f admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:17:02.731253 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca6f13-0ac7-476d-ae20-37209f1f893f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:17:02.733352 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca6f13-0ac7-476d-ae20-37209f1f893f admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:17:02.803088 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1438/2889] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:17:02 2022] POST /identity/v3/users => generated 288 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 21:17:02.807272 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34275cc-53be-405e-941c-e2b2461c5c1d admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:17:02.818607 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34275cc-53be-405e-941c-e2b2461c5c1d admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:17:02.824325 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42eb67-59bc-4a6a-b737-be13148a915b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:17:02.825009 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42eb67-59bc-4a6a-b737-be13148a915b admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:17:02.825300 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42eb67-59bc-4a6a-b737-be13148a915b admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:17:02.825584 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42eb67-59bc-4a6a-b737-be13148a915b admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:17:02.826317 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42eb67-59bc-4a6a-b737-be13148a915b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:17:02.827927 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42eb67-59bc-4a6a-b737-be13148a915b admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:17:02.838985 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1452/2890] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:17:02.843146 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca6f13-0ac7-476d-ae20-37209f1f893f admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:17:02.854087 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca6f13-0ac7-476d-ae20-37209f1f893f admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:17:02.858901 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128c845-44bc-4cf7-8c22-7b6fd98891b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:17:02.859598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128c845-44bc-4cf7-8c22-7b6fd98891b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:17:02.859888 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128c845-44bc-4cf7-8c22-7b6fd98891b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:17:02.860209 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128c845-44bc-4cf7-8c22-7b6fd98891b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:17:02.860942 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4128c845-44bc-4cf7-8c22-7b6fd98891b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:17:02.862567 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4128c845-44bc-4cf7-8c22-7b6fd98891b9 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:17:02.873821 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1439/2891] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:17:02.877990 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42eb67-59bc-4a6a-b737-be13148a915b admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:17:02.888225 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42eb67-59bc-4a6a-b737-be13148a915b admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:17:02.892951 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20f7d7-2190-4783-aab7-0ea90a466985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:17:02.893837 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20f7d7-2190-4783-aab7-0ea90a466985 admin admin] REQUEST_METHOD: `PUT` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:17:02.894129 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20f7d7-2190-4783-aab7-0ea90a466985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:17:02.894414 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20f7d7-2190-4783-aab7-0ea90a466985 admin admin] PATH_INFO: `/v3/projects/d77c786dc8604d55b77543703db853e3/users/0598e9a037fb47be881310b348d6e1b1/roles/cf0f875ea1ba45758bd4f52a845d807e` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:17:02.909739 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa20f7d7-2190-4783-aab7-0ea90a466985 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d77c786dc8604d55b77543703db853e3, user_id=0598e9a037fb47be881310b348d6e1b1, role_id=cf0f875ea1ba45758bd4f52a845d807e)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:17:02.913007 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa20f7d7-2190-4783-aab7-0ea90a466985 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:17:03.018945 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1453/2892] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:17:02 2022] PUT /identity/v3/projects/d77c786dc8604d55b77543703db853e3/users/0598e9a037fb47be881310b348d6e1b1/roles/cf0f875ea1ba45758bd4f52a845d807e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:17:03.029520 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c9a1a-c9ce-4258-b895-4cc29b753d2f None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:17:03.034191 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c9a1a-c9ce-4258-b895-4cc29b753d2f None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:17:03.034191 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c9a1a-c9ce-4258-b895-4cc29b753d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:17:03.056901 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-af1c9a1a-c9ce-4258-b895-4cc29b753d2f None None] MFA Rules not processed for user `0598e9a037fb47be881310b348d6e1b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:17:03.058106 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-af1c9a1a-c9ce-4258-b895-4cc29b753d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:17:03.120699 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1440/2893] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:17:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:17:03.125050 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20f7d7-2190-4783-aab7-0ea90a466985 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:17:03.186948 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20f7d7-2190-4783-aab7-0ea90a466985 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:17:03.191570 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bce0a7-9146-4f32-836a-39295e78725c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:17:03.192291 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bce0a7-9146-4f32-836a-39295e78725c admin admin] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:17:03.192582 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bce0a7-9146-4f32-836a-39295e78725c admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:17:03.192863 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bce0a7-9146-4f32-836a-39295e78725c admin admin] PATH_INFO: `/v3/projects` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:17:03.193543 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bce0a7-9146-4f32-836a-39295e78725c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:17:03.195502 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bce0a7-9146-4f32-836a-39295e78725c admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:17:03.295313 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1454/2894] 10.222.0.40 () {60 vars in 1152 bytes} [Mon Jul 11 21:17:03 2022] POST /identity/v3/projects => generated 377 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 21:17:03.299158 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c9a1a-c9ce-4258-b895-4cc29b753d2f None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:17:03.309941 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c9a1a-c9ce-4258-b895-4cc29b753d2f None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:17:03.365598 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b72c4-d72c-4285-827f-8a5b6ea67676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:17:03.366336 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b72c4-d72c-4285-827f-8a5b6ea67676 admin admin] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:17:03.366626 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b72c4-d72c-4285-827f-8a5b6ea67676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:17:03.366907 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b72c4-d72c-4285-827f-8a5b6ea67676 admin admin] PATH_INFO: `/v3/users` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:17:03.367594 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b72c4-d72c-4285-827f-8a5b6ea67676 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:17:03.369542 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b72c4-d72c-4285-827f-8a5b6ea67676 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:17:03.471130 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1441/2895] 10.222.0.40 () {60 vars in 1143 bytes} [Mon Jul 11 21:17:03 2022] POST /identity/v3/users => generated 295 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 21:17:03.475565 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bce0a7-9146-4f32-836a-39295e78725c admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:17:03.485907 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bce0a7-9146-4f32-836a-39295e78725c admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:17:03.490822 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcae723-7e16-4526-b5bb-e25755869204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:17:03.491486 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcae723-7e16-4526-b5bb-e25755869204 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:17:03.491781 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcae723-7e16-4526-b5bb-e25755869204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:17:03.492093 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcae723-7e16-4526-b5bb-e25755869204 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:17:03.492825 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcae723-7e16-4526-b5bb-e25755869204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:17:03.494423 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcae723-7e16-4526-b5bb-e25755869204 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:17:03.504855 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1455/2896] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:17:03.509255 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b72c4-d72c-4285-827f-8a5b6ea67676 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:17:03.519378 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b72c4-d72c-4285-827f-8a5b6ea67676 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:17:03.524984 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae159bc-b9af-4bb9-b949-a02dd65aaf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:17:03.526167 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae159bc-b9af-4bb9-b949-a02dd65aaf60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:17:03.526458 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae159bc-b9af-4bb9-b949-a02dd65aaf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:17:03.526741 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae159bc-b9af-4bb9-b949-a02dd65aaf60 admin admin] PATH_INFO: `/v3/projects/47cdd3cca4b74ea4a3fbd3f0da5eadcb/users/860db6a736bf4bec8f775e18ff7fefb8/roles/86273ff072f3438d822e870272491768` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:17:03.538733 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:17:03.541820 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae159bc-b9af-4bb9-b949-a02dd65aaf60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47cdd3cca4b74ea4a3fbd3f0da5eadcb, user_id=860db6a736bf4bec8f775e18ff7fefb8, role_id=86273ff072f3438d822e870272491768)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:17:03.544498 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae159bc-b9af-4bb9-b949-a02dd65aaf60 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:17:03.619837 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1442/2897] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:17:03 2022] PUT /identity/v3/projects/47cdd3cca4b74ea4a3fbd3f0da5eadcb/users/860db6a736bf4bec8f775e18ff7fefb8/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:17:03.623706 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcae723-7e16-4526-b5bb-e25755869204 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:17:03.634654 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcae723-7e16-4526-b5bb-e25755869204 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:17:03.677981 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:17:03.693041 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9150f519-07e9-48ac-8124-141ed54c8203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:17:03.694300 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150f519-07e9-48ac-8124-141ed54c8203 admin admin] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:17:03.694647 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150f519-07e9-48ac-8124-141ed54c8203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:17:03.694923 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150f519-07e9-48ac-8124-141ed54c8203 admin admin] PATH_INFO: `/v3/roles` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:17:03.695660 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9150f519-07e9-48ac-8124-141ed54c8203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:17:03.697311 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9150f519-07e9-48ac-8124-141ed54c8203 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:17:03.707328 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1456/2898] 10.222.0.40 () {58 vars in 1121 bytes} [Mon Jul 11 21:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 21:17:03.712127 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae159bc-b9af-4bb9-b949-a02dd65aaf60 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:17:03.722791 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae159bc-b9af-4bb9-b949-a02dd65aaf60 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:17:03.727741 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b5a2a-d541-4570-a4eb-f62907f00ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:17:03.728670 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b5a2a-d541-4570-a4eb-f62907f00ebc admin admin] REQUEST_METHOD: `PUT` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:17:03.729297 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b5a2a-d541-4570-a4eb-f62907f00ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:17:03.729297 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b5a2a-d541-4570-a4eb-f62907f00ebc admin admin] PATH_INFO: `/v3/projects/47cdd3cca4b74ea4a3fbd3f0da5eadcb/users/860db6a736bf4bec8f775e18ff7fefb8/roles/86273ff072f3438d822e870272491768` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:17:03.731220 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b5a2a-d541-4570-a4eb-f62907f00ebc admin admin] RBAC: Authorizing `identity:create_grant(project_id=47cdd3cca4b74ea4a3fbd3f0da5eadcb, user_id=860db6a736bf4bec8f775e18ff7fefb8, role_id=86273ff072f3438d822e870272491768)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:17:03.733962 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b5a2a-d541-4570-a4eb-f62907f00ebc admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:17:03.744949 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1443/2899] 10.222.0.40 () {60 vars in 1482 bytes} [Mon Jul 11 21:17:03 2022] PUT /identity/v3/projects/47cdd3cca4b74ea4a3fbd3f0da5eadcb/users/860db6a736bf4bec8f775e18ff7fefb8/roles/86273ff072f3438d822e870272491768 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:17:03.756685 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8c348-80b0-4736-a7da-3f021f19da3b None None] REQUEST_METHOD: `POST` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:17:03.757303 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8c348-80b0-4736-a7da-3f021f19da3b None None] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:17:03.757658 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8c348-80b0-4736-a7da-3f021f19da3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:17:03.785188 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.auth.core [None req-4cf8c348-80b0-4736-a7da-3f021f19da3b None None] MFA Rules not processed for user `860db6a736bf4bec8f775e18ff7fefb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:17:03.786418 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-4cf8c348-80b0-4736-a7da-3f021f19da3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:17:03.853748 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1457/2900] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:17:03 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:17:03.864802 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b5a2a-d541-4570-a4eb-f62907f00ebc admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:17:03.866743 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-389b5a2a-d541-4570-a4eb-f62907f00ebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:17:03.923213 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b5a2a-d541-4570-a4eb-f62907f00ebc admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:17:03.926862 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c655f4-5cb3-4fc0-8cc6-1a83d068410e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:17:03.927502 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c655f4-5cb3-4fc0-8cc6-1a83d068410e service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:17:03.928399 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c655f4-5cb3-4fc0-8cc6-1a83d068410e service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:17:03.928695 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c655f4-5cb3-4fc0-8cc6-1a83d068410e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:17:03.983948 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c655f4-5cb3-4fc0-8cc6-1a83d068410e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:17:03.985341 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c655f4-5cb3-4fc0-8cc6-1a83d068410e service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:17:03.994756 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1444/2901] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:17:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:17:05.811019 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8c348-80b0-4736-a7da-3f021f19da3b None None] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:17:05.812518 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-4cf8c348-80b0-4736-a7da-3f021f19da3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:17:05.824988 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8c348-80b0-4736-a7da-3f021f19da3b None None] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:17:05.828497 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15301234-a564-48da-b0d7-479691de2c31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:17:05.829143 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15301234-a564-48da-b0d7-479691de2c31 service cinder] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:17:05.829433 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15301234-a564-48da-b0d7-479691de2c31 service cinder] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:17:05.829717 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15301234-a564-48da-b0d7-479691de2c31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:17:05.885257 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15301234-a564-48da-b0d7-479691de2c31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:17:05.886778 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15301234-a564-48da-b0d7-479691de2c31 service cinder] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:17:05.895786 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1458/2902] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:17:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:17:07.171281 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c655f4-5cb3-4fc0-8cc6-1a83d068410e service cinder] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:17:07.180061 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c655f4-5cb3-4fc0-8cc6-1a83d068410e service cinder] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:17:07.183639 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07936121-2a3c-4a5d-a49a-00637d868177 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4ae1169746141bc8993707b12cacd80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:17:07.184319 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07936121-2a3c-4a5d-a49a-00637d868177 service cinder] REQUEST_METHOD: `GET` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:17:07.184608 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07936121-2a3c-4a5d-a49a-00637d868177 service cinder] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:17:07.184888 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07936121-2a3c-4a5d-a49a-00637d868177 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:17:07.193834 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07936121-2a3c-4a5d-a49a-00637d868177 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:17:07.195217 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07936121-2a3c-4a5d-a49a-00637d868177 service cinder] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:17:07.204567 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1445/2903] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:17:07 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:17:11.992353 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15301234-a564-48da-b0d7-479691de2c31 service cinder] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:17:12.053825 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15301234-a564-48da-b0d7-479691de2c31 service cinder] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:17:12.058479 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f257e7-f77f-4fc9-9403-d13827816582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:17:12.059352 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f257e7-f77f-4fc9-9403-d13827816582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:17:12.059641 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f257e7-f77f-4fc9-9403-d13827816582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:17:12.059921 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f257e7-f77f-4fc9-9403-d13827816582 admin admin] PATH_INFO: `/v3/users/8fea3e5ee7ef4dd8b1c5312b2b69a160` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:17:12.061131 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f257e7-f77f-4fc9-9403-d13827816582 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fea3e5ee7ef4dd8b1c5312b2b69a160)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:17:12.063077 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f257e7-f77f-4fc9-9403-d13827816582 admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:17:12.067584 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=100 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:17:12.271803 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-16f257e7-f77f-4fc9-9403-d13827816582 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fea3e5ee7ef4dd8b1c5312b2b69a160'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:17:12.279361 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-16f257e7-f77f-4fc9-9403-d13827816582 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fea3e5ee7ef4dd8b1c5312b2b69a160'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:17:12.280059 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-16f257e7-f77f-4fc9-9403-d13827816582 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fea3e5ee7ef4dd8b1c5312b2b69a160'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:17:12.280708 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-16f257e7-f77f-4fc9-9403-d13827816582 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fea3e5ee7ef4dd8b1c5312b2b69a160'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:17:12.361848 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-16f257e7-f77f-4fc9-9403-d13827816582 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fea3e5ee7ef4dd8b1c5312b2b69a160'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:17:12.380118 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1459/2904] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:17:11 2022] DELETE /identity/v3/users/8fea3e5ee7ef4dd8b1c5312b2b69a160 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:17:12.385183 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de27614-1456-44a3-a555-70b843339b6b None None] REQUEST_METHOD: `POST` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:17:12.385674 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de27614-1456-44a3-a555-70b843339b6b None None] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:17:12.385788 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de27614-1456-44a3-a555-70b843339b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:17:12.402955 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.auth.core [None req-3de27614-1456-44a3-a555-70b843339b6b None None] MFA Rules not processed for user `69c8f3089c874dc3bc848ee6f85bc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 21:17:12.404191 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-3de27614-1456-44a3-a555-70b843339b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:17:12.462112 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1446/2905] 10.222.0.40 () {58 vars in 957 bytes} [Mon Jul 11 21:17:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 21:17:12.471666 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f257e7-f77f-4fc9-9403-d13827816582 admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:17:12.473109 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-16f257e7-f77f-4fc9-9403-d13827816582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:17:12.529489 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f257e7-f77f-4fc9-9403-d13827816582 admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:17:12.532967 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a50817-fcb9-43ed-9b6e-57c328de620d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29046b079f1a4f4ea2244e69cbbaa805', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:17:12.533613 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a50817-fcb9-43ed-9b6e-57c328de620d service neutron] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:17:12.533895 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a50817-fcb9-43ed-9b6e-57c328de620d service neutron] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:17:12.534171 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a50817-fcb9-43ed-9b6e-57c328de620d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:17:12.543663 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a50817-fcb9-43ed-9b6e-57c328de620d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:17:12.545120 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a50817-fcb9-43ed-9b6e-57c328de620d service neutron] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:17:12.555141 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1460/2906] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:17:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:17:12.952946 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de27614-1456-44a3-a555-70b843339b6b None None] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:17:12.954625 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-3de27614-1456-44a3-a555-70b843339b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:17:12.968345 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de27614-1456-44a3-a555-70b843339b6b None None] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:17:12.972656 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4d6f4-63eb-4bac-8ccb-750a22065867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:17:12.973616 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4d6f4-63eb-4bac-8ccb-750a22065867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:17:12.973900 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4d6f4-63eb-4bac-8ccb-750a22065867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:17:12.974180 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4d6f4-63eb-4bac-8ccb-750a22065867 admin admin] PATH_INFO: `/v3/projects/5469d8b29a0b4a63bf1431cffa9034a6` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:17:12.975366 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d4d6f4-63eb-4bac-8ccb-750a22065867 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5469d8b29a0b4a63bf1431cffa9034a6)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:17:12.977373 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d4d6f4-63eb-4bac-8ccb-750a22065867 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:17:12.993961 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:17:13.094792 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e2d4d6f4-63eb-4bac-8ccb-750a22065867 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5469d8b29a0b4a63bf1431cffa9034a6', 'request_id': 'req-e2d4d6f4-63eb-4bac-8ccb-750a22065867'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:17:13.101602 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e2d4d6f4-63eb-4bac-8ccb-750a22065867 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5469d8b29a0b4a63bf1431cffa9034a6', 'request_id': 'req-e2d4d6f4-63eb-4bac-8ccb-750a22065867'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:17:13.107002 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e2d4d6f4-63eb-4bac-8ccb-750a22065867 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5469d8b29a0b4a63bf1431cffa9034a6', 'request_id': 'req-e2d4d6f4-63eb-4bac-8ccb-750a22065867'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:17:13.172922 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e2d4d6f4-63eb-4bac-8ccb-750a22065867 admin admin] The token cache is being invalidate because project 5469d8b29a0b4a63bf1431cffa9034a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:17:13.173212 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e2d4d6f4-63eb-4bac-8ccb-750a22065867 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:17:13.173839 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-e2d4d6f4-63eb-4bac-8ccb-750a22065867 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:17:13.175378 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1447/2907] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:17:12 2022] DELETE /identity/v3/projects/5469d8b29a0b4a63bf1431cffa9034a6 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:17:13.179763 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a50817-fcb9-43ed-9b6e-57c328de620d service neutron] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:17:13.189545 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a50817-fcb9-43ed-9b6e-57c328de620d service neutron] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:17:13.244825 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d811e0-09d0-4a8c-b0bf-02c740e6d6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:17:13.245696 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d811e0-09d0-4a8c-b0bf-02c740e6d6ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:17:13.245989 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d811e0-09d0-4a8c-b0bf-02c740e6d6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:17:13.246269 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d811e0-09d0-4a8c-b0bf-02c740e6d6ac admin admin] PATH_INFO: `/v3/users/0598e9a037fb47be881310b348d6e1b1` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:17:13.247452 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d811e0-09d0-4a8c-b0bf-02c740e6d6ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=0598e9a037fb47be881310b348d6e1b1)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:17:13.249404 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d811e0-09d0-4a8c-b0bf-02c740e6d6ac admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:17:13.346761 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:17:13.427628 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-65d811e0-09d0-4a8c-b0bf-02c740e6d6ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0598e9a037fb47be881310b348d6e1b1'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:17:13.434375 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-65d811e0-09d0-4a8c-b0bf-02c740e6d6ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0598e9a037fb47be881310b348d6e1b1'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:17:13.435035 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-65d811e0-09d0-4a8c-b0bf-02c740e6d6ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0598e9a037fb47be881310b348d6e1b1'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:17:13.435640 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-65d811e0-09d0-4a8c-b0bf-02c740e6d6ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0598e9a037fb47be881310b348d6e1b1'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:17:13.539538 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-65d811e0-09d0-4a8c-b0bf-02c740e6d6ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0598e9a037fb47be881310b348d6e1b1'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:17:13.557252 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1461/2908] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:17:13 2022] DELETE /identity/v3/users/0598e9a037fb47be881310b348d6e1b1 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:17:13.963517 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4d6f4-63eb-4bac-8ccb-750a22065867 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:17:13.965006 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-e2d4d6f4-63eb-4bac-8ccb-750a22065867 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:17:13.978019 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4d6f4-63eb-4bac-8ccb-750a22065867 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:17:14.035853 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c38238-9d78-42d9-8a1f-1bbe762dadc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:17:14.036869 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c38238-9d78-42d9-8a1f-1bbe762dadc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:17:14.037155 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c38238-9d78-42d9-8a1f-1bbe762dadc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:17:14.037934 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c38238-9d78-42d9-8a1f-1bbe762dadc2 admin admin] PATH_INFO: `/v3/projects/d77c786dc8604d55b77543703db853e3` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:17:14.039125 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c38238-9d78-42d9-8a1f-1bbe762dadc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d77c786dc8604d55b77543703db853e3)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:17:14.041086 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c38238-9d78-42d9-8a1f-1bbe762dadc2 admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:17:14.144259 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-37c38238-9d78-42d9-8a1f-1bbe762dadc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd77c786dc8604d55b77543703db853e3', 'request_id': 'req-37c38238-9d78-42d9-8a1f-1bbe762dadc2'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:17:14.150420 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-37c38238-9d78-42d9-8a1f-1bbe762dadc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd77c786dc8604d55b77543703db853e3', 'request_id': 'req-37c38238-9d78-42d9-8a1f-1bbe762dadc2'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:17:14.156265 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-37c38238-9d78-42d9-8a1f-1bbe762dadc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd77c786dc8604d55b77543703db853e3', 'request_id': 'req-37c38238-9d78-42d9-8a1f-1bbe762dadc2'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:17:14.259046 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-37c38238-9d78-42d9-8a1f-1bbe762dadc2 admin admin] The token cache is being invalidate because project d77c786dc8604d55b77543703db853e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:17:14.259341 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-37c38238-9d78-42d9-8a1f-1bbe762dadc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:17:14.259958 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-37c38238-9d78-42d9-8a1f-1bbe762dadc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:17:14.265565 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1448/2909] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:17:13 2022] DELETE /identity/v3/projects/d77c786dc8604d55b77543703db853e3 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:17:14.265709 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d811e0-09d0-4a8c-b0bf-02c740e6d6ac admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:17:14.267193 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-65d811e0-09d0-4a8c-b0bf-02c740e6d6ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:17:14.280153 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d811e0-09d0-4a8c-b0bf-02c740e6d6ac admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:17:14.336693 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b98fb-c1ad-47e5-ac09-cc1ea3bf77cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:17:14.337574 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b98fb-c1ad-47e5-ac09-cc1ea3bf77cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:17:14.337857 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b98fb-c1ad-47e5-ac09-cc1ea3bf77cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:17:14.338132 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b98fb-c1ad-47e5-ac09-cc1ea3bf77cf admin admin] PATH_INFO: `/v3/users/860db6a736bf4bec8f775e18ff7fefb8` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:17:14.339302 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1b98fb-c1ad-47e5-ac09-cc1ea3bf77cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=860db6a736bf4bec8f775e18ff7fefb8)` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:17:14.341233 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1b98fb-c1ad-47e5-ac09-cc1ea3bf77cf admin admin] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:17:14.518345 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3c1b98fb-c1ad-47e5-ac09-cc1ea3bf77cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '860db6a736bf4bec8f775e18ff7fefb8'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:17:14.525008 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3c1b98fb-c1ad-47e5-ac09-cc1ea3bf77cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '860db6a736bf4bec8f775e18ff7fefb8'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:17:14.527315 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3c1b98fb-c1ad-47e5-ac09-cc1ea3bf77cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '860db6a736bf4bec8f775e18ff7fefb8'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:17:14.527315 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3c1b98fb-c1ad-47e5-ac09-cc1ea3bf77cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '860db6a736bf4bec8f775e18ff7fefb8'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:17:14.579108 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.notifications [None req-3c1b98fb-c1ad-47e5-ac09-cc1ea3bf77cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '860db6a736bf4bec8f775e18ff7fefb8'} {{(pid=80375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:17:14.597152 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1462/2910] 10.222.0.40 () {58 vars in 1223 bytes} [Mon Jul 11 21:17:14 2022] DELETE /identity/v3/users/860db6a736bf4bec8f775e18ff7fefb8 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:17:14.997476 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c38238-9d78-42d9-8a1f-1bbe762dadc2 admin admin] Authenticating user token {{(pid=80374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:17:14.999304 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.fernet_utils [None req-37c38238-9d78-42d9-8a1f-1bbe762dadc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:17:15.012075 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c38238-9d78-42d9-8a1f-1bbe762dadc2 admin admin] Validating token access rules against request {{(pid=80374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:17:15.046135 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:17:15.075311 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072076b7-6dea-468d-92e4-3501501b78ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69c8f3089c874dc3bc848ee6f85bc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8bc79b1b6b4f7088e951983d34a626', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:17:15.079530 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072076b7-6dea-468d-92e4-3501501b78ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:17:15.079530 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072076b7-6dea-468d-92e4-3501501b78ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:17:15.079530 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072076b7-6dea-468d-92e4-3501501b78ba admin admin] PATH_INFO: `/v3/projects/47cdd3cca4b74ea4a3fbd3f0da5eadcb` {{(pid=80374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:17:15.079530 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072076b7-6dea-468d-92e4-3501501b78ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=47cdd3cca4b74ea4a3fbd3f0da5eadcb)` {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:17:15.080038 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072076b7-6dea-468d-92e4-3501501b78ba admin admin] RBAC: Authorization granted {{(pid=80374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:17:15.299680 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-072076b7-6dea-468d-92e4-3501501b78ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47cdd3cca4b74ea4a3fbd3f0da5eadcb', 'request_id': 'req-072076b7-6dea-468d-92e4-3501501b78ba'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:17:15.306024 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-072076b7-6dea-468d-92e4-3501501b78ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47cdd3cca4b74ea4a3fbd3f0da5eadcb', 'request_id': 'req-072076b7-6dea-468d-92e4-3501501b78ba'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:17:15.311502 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-072076b7-6dea-468d-92e4-3501501b78ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47cdd3cca4b74ea4a3fbd3f0da5eadcb', 'request_id': 'req-072076b7-6dea-468d-92e4-3501501b78ba'} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:17:15.407430 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-072076b7-6dea-468d-92e4-3501501b78ba admin admin] The token cache is being invalidate because project 47cdd3cca4b74ea4a3fbd3f0da5eadcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 21:17:15.407717 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-072076b7-6dea-468d-92e4-3501501b78ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:17:15.408401 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG keystone.notifications [None req-072076b7-6dea-468d-92e4-3501501b78ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 21:17:15.409972 dv-cinder-849022-2-smb devstack@keystone.service[80374]: [pid: 80374|app: 0|req: 1449/2911] 10.222.0.40 () {58 vars in 1232 bytes} [Mon Jul 11 21:17:14 2022] DELETE /identity/v3/projects/47cdd3cca4b74ea4a3fbd3f0da5eadcb => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 21:17:24.593614 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=72,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:17:25.404262 dv-cinder-849022-2-smb devstack@keystone.service[80374]: DEBUG dbcounter [-] [80374] Writing DB stats keystone:SELECT=36,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 21:19:22.771316 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b98fb-c1ad-47e5-ac09-cc1ea3bf77cf admin admin] Authenticating user token {{(pid=80375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 21:19:22.773378 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-3c1b98fb-c1ad-47e5-ac09-cc1ea3bf77cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:19:22.842672 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b98fb-c1ad-47e5-ac09-cc1ea3bf77cf admin admin] Validating token access rules against request {{(pid=80375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 21:19:22.900918 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e482f992-3674-4a4f-bfb6-94192be3596a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '177a912380ad43b6a5e31b787a07ce7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eca3ef2561fa435e80ff451aeab14f3b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 21:19:22.901576 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482f992-3674-4a4f-bfb6-94192be3596a service placement] REQUEST_METHOD: `GET` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 21:19:22.901868 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482f992-3674-4a4f-bfb6-94192be3596a service placement] SCRIPT_NAME: `/identity` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 21:19:22.902153 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482f992-3674-4a4f-bfb6-94192be3596a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 21:19:22.904266 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.fernet_utils [None req-e482f992-3674-4a4f-bfb6-94192be3596a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 21:19:22.915473 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e482f992-3674-4a4f-bfb6-94192be3596a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 21:19:22.917107 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e482f992-3674-4a4f-bfb6-94192be3596a service placement] RBAC: Authorization granted {{(pid=80375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 21:19:22.927032 dv-cinder-849022-2-smb devstack@keystone.service[80375]: [pid: 80375|app: 0|req: 1463/2912] 10.222.0.40 () {60 vars in 1365 bytes} [Mon Jul 11 21:19:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 21:19:32.922827 dv-cinder-849022-2-smb devstack@keystone.service[80375]: DEBUG dbcounter [-] [80375] Writing DB stats keystone:SELECT=58 {{(pid=80375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}